00000001:02000400:0.0F:1783071221.019338:0:3302:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg438-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1783071236.000178:0:3522:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg438-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1783071237.590552:0:3585:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 738 MB/s 00000001:01000000:3.0:1783071237.841055:0:3585:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1235 MB/s 00000001:01000000:1.0F:1783071238.090621:0:3585:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 6599 MB/s 00000020:02000000:0.0:1783071238.640199:0:3614:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_83_g8e46928 00000400:02000000:3.0:1783071239.437195:0:3629:0:(api-ni.c:2752:lnet_startup_lndni()) Added LNI 192.168.204.138@tcp [8/256/0/180] 00008000:02000000:1.0:1783071242.740217:0:3779:0:(echo_client.c:2573:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1783071287.632153:0:5744:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg438-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1783071298.723056:0:6493:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:1.0:1783071298.723063:0:6493:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1783071298.723065:0:6493:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1783071298.723224:0:6493:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000f404632b 00000080:02000400:1.0:1783071298.723233:0:6493:0:(super25.c:154:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1783071298.732145:0:6493:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1783071298.732159:0:6493:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1783071298.732880:0:6493:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000008f654a8b) 00000020:00000080:1.0:1783071298.732899:0:6493:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1783071298.782912:0:6493:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1783071298.782974:0:6493:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:2.0:1783071298.810219:0:6493:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1783071298.810550:0:6493:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1783071298.810566:0:6493:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1783071298.810578:0:6493:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6b58994c2cbdbae4 00000020:01000004:2.0:1783071298.810585:0:6493:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1783071298.810589:0:6493:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1783071298.810594:0:6493:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000f404632b from MGS 00000020:01000004:2.0:1783071298.810598:0:6493:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1783071298.810615:0:6493:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000af75942d) 00000020:00000080:2.0:1783071298.810627:0:6493:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1783071298.810755:0:6493:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f404632b from MGS, refs=2 00080000:01000000:2.0:1783071298.810894:0:6493:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1783071298.810900:0:6493:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6b58994c2cbdbaf2 00000100:00100000:2.0:1783071298.810986:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1783071298.811108:0:6493:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1783071298.811113:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1783071298.811711:0:6493:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1783071298.811718:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1783071298.812621:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783071298.813065:0:6493:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1783071298.813070:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1783071298.817272:0:6493:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1783071298.817286:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1783071298.817989:0:6493:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1783071298.817996:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1783071298.823030:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071298.823036:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071298.823039:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071298.823399:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071298.823402:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071298.823403:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071298.824583:0:6493:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1783071298.829531:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1783071299.074668:0:6493:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3759 MB/s 00000001:01000000:0.0:1783071299.324513:0:6493:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2979 MB/s 00000001:01000000:2.0:1783071299.575500:0:6493:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 525 MB/s 00000001:01000000:2.0:1783071299.825616:0:6493:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 935 MB/s 00080000:10000000:2.0:1783071299.829883:0:6493:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:2.0:1783071299.837105:0:6493:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1783071299.837880:0:6507:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1783071299.837925:0:6493:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1783071299.837963:0:6493:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1783071299.838100:0:6493:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1783071299.838121:0:6493:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1783071299.838462:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783071299.838615:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1783071299.838621:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00010000:00010000:3.0:1783071299.842571:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071299.843451:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1783071299.843464:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1783071299.843860:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1783071299.843866:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1783071299.844408:0:6493:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1783071299.844437:0:6493:0:(obd_mount.c:402:lustre_start_mgc()) Start MGC 'MGC192.168.204.138@tcp' 00000020:01000004:1.0:1783071299.844439:0:6493:0:(obd_mount.c:411:lustre_start_mgc()) mgs NIDs (null). 00000100:00080000:0.0:1783071299.844597:0:6512:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 00000020:01000004:1.0:1783071299.844632:0:6493:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGC192.168.204.138@tcp (typ=mgc) 00000020:00000080:1.0:1783071299.844642:0:6493:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.138@tcp (00000000fadf62e2) 00000020:00000080:1.0:1783071299.844658:0:6493:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1783071299.844732:0:6493:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000047aee93@MGC192.168.204.138@tcp: add connection 192.168.204.138@tcp at head 00010000:00010000:1.0:1783071299.844878:0:6493:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.138@tcp-0 is initialized 00000040:01000000:1.0:1783071299.844883:0:6493:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.138@tcp ctxt 1 is initialized 10000000:01000000:0.0:1783071299.848848:0:6513:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1783071299.850860:0:6493:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.138@tcp (uuid feaa1501-b927-4e07-baad-3200e92d7497) 00000020:00000080:1.0:1783071299.850889:0:6493:0:(genops.c:1406:class_connect()) connect: client feaa1501-b927-4e07-baad-3200e92d7497, cookie 0x6b58994c2cbdbb00 00000100:00080000:1.0:1783071299.850902:0:6493:0:(import.c:512:import_select_connection()) MGC192.168.204.138@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783071299.850907:0:6493:0:(import.c:626:import_select_connection()) MGC192.168.204.138@tcp: import 00000000047aee93 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:1.0:1783071299.850948:0:6493:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000003f7055fe x1869685707505792/t0(0) o250->MGC192.168.204.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783071299.850977:0:6493:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import feaa1501-b927-4e07-baad-3200e92d7497->MGS 00000020:01000004:1.0:1783071299.850991:0:6493:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1783071299.850997:0:6493:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1783071299.851008:0:6493:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000618ebd4a) 00000020:00000080:1.0:1783071299.851019:0:6493:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1783071299.852781:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000003f7055fe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:feaa1501-b927-4e07-baad-3200e92d7497:3644:1869685707505792:0@lo:250: 00000100:00100000:2.0:1783071299.852881:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071299.855633:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707505792 00000100:00100000:3.0:1783071299.855647:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707505792 00000100:00100000:3.0:1783071299.855708:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783071299.855715:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e8e3e515 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3644:x1869685707505792:12345-0@lo:250: 00010000:00080000:3.0:1783071299.855744:0:6508:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from feaa1501-b927-4e07-baad-3200e92d7497@0@lo t0 exp 0000000000000000 cur 201 last 0 00000020:00000080:3.0:1783071299.855772:0:6508:0:(genops.c:1406:class_connect()) connect: client feaa1501-b927-4e07-baad-3200e92d7497, cookie 0x6b58994c2cbdbb0e 00000100:00080000:3.0:1783071299.855920:0:6508:0:(import.c:65:import_set_state_nolock()) 00000000d454cbba : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783071299.856003:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e8e3e515 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+5:3644:x1869685707505792:12345-0@lo:250: Request processed in 287us (3122us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071299.856011:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783071299.856071:0:3644:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.204.138@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1783071299.856080:0:3644:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.204.138@tcp: connect to target with instance 0 00000100:00080000:3.0:1783071299.856086:0:3644:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.204.138@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1783071299.856091:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1783071299.856094:0:3644:0:(import.c:65:import_set_state_nolock()) 00000000047aee93 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1783071299.856096:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1783071299.856105:0:3644:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1783071299.856115:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000003f7055fe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:feaa1501-b927-4e07-baad-3200e92d7497:3644:1869685707505792:0@lo:250: 00000100:00100000:1.0:1783071299.865322:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783071299.869765:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1783071299.869777:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1783071299.870718:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1783071299.870728:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1783071299.871077:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1783071299.871083:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1783071299.872028:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783071299.872189:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1783071299.872194:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1783071299.872781:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1783071299.872787:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1783071299.920514:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783071299.921275:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1783071299.921283:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1783071299.922237:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1783071299.922245:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1783071299.922897:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783071299.923039:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1783071299.923045:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1783071299.923572:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1783071299.923578:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1783071299.924058:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783071299.924205:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1783071299.924212:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1783071299.924688:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1783071299.924695:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1783071299.925164:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783071299.925311:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1783071299.925316:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1783071299.925861:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1783071299.925868:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1783071299.945146:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783071299.945353:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1783071299.945360:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1783071299.946654:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1783071299.946665:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1783071299.947510:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1783071299.947519:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1783071299.948216:0:6493:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1783071299.948243:0:6493:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1783071299.948250:0:6493:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.138@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1783071299.948355:0:6493:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.138@tcp ctxt 0 is initialized 00000020:01000004:2.0:1783071299.948522:0:6493:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.138@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1783071299.948527:0:6493:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1783071299.948528:0:6493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783071299.948530:0:6493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783071299.948531:0:6493:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783071299.948532:0:6493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783071299.948533:0:6493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783071299.948543:0:6493:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783071299.948545:0:6493:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783071299.948547:0:6493:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783071299.948548:0:6493:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783071299.948549:0:6493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783071299.948551:0:6493:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783071299.948553:0:6493:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1783071299.948555:0:6493:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783071299.948556:0:6493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783071299.948557:0:6493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783071299.948558:0:6493:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783071299.948559:0:6493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783071299.948560:0:6493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783071299.948561:0:6493:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783071299.948567:0:6493:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783071299.948568:0:6493:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783071299.948568:0:6493:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783071299.948569:0:6493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783071299.948570:0:6493:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783071299.948606:0:6493:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1783071299.948621:0:6493:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000edb4fbc4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:6493:1869685707505920:0@lo:253: 00000100:00100000:2.0:1783071299.948690:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071299.948765:0:6493:0:(client.c:2701:ptlrpc_set_wait()) set 00000000d1b15516 going to sleep for 11 seconds 00000100:00100000:1.0:1783071299.948814:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707505920 00000100:00100000:1.0:1783071299.948822:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707505920 00000100:00100000:1.0:1783071299.948895:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783071299.948904:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000034eb5d17 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+5:6493:x1869685707505920:12345-0@lo:253: 20000000:01000000:1.0:1783071299.948950:0:6511:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1783071299.948953:0:6511:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1783071299.949227:0:6533:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1783071299.949276:0:6511:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1783071299.949630:0:6511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783071299.950505:0:6534:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1783071299.950699:0:6511:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1783071299.950704:0:6511:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1783071299.950709:0:6511:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1783071299.950712:0:6511:0:(mgs_llog.c:3603:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1783071299.950725:0:6511:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1783071299.950869:0:6511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783071299.951073:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1783071299.951088:0:6511:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1783071299.951112:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1783071299.951128:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1783071299.951141:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1783071299.951206:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1783071299.951213:0:6511:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1783071299.951226:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1783071299.951232:0:6511:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1783071299.951241:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1783071299.951245:0:6511:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1783071299.951257:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1783071299.951271:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1783071299.951297:0:6511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1783071299.951301:0:6511:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1783071299.951309:0:6511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783071299.951475:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1783071299.951485:0:6511:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1783071299.951501:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1783071299.951516:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1783071299.951531:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1783071299.951549:0:6511:0:(mgs_llog.c:3120:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1783071299.951575:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1783071299.951583:0:6511:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1783071299.951594:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1783071299.951606:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1783071299.951619:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1783071299.951627:0:6511:0:(mgs_llog.c:3085:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1783071299.951651:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1783071299.951658:0:6511:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1783071299.951670:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1783071299.951683:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1783071299.951743:0:6511:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1783071299.951764:0:6511:0:(mgs_llog.c:3300:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1783071299.951776:0:6511:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1783071299.952236:0:6535:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1783071299.952698:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1783071299.952717:0:6511:0:(mgs_llog.c:3346:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.138@tcp for mdt 20000000:01000000:1.0:1783071299.952719:0:6511:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.204.138@tcp (null) (null) (null) 00000040:00080000:1.0:1783071299.952734:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1783071299.952740:0:6511:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1783071299.952752:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1783071299.952757:0:6511:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.138@tcp (null) (null) 00000040:00080000:1.0:1783071299.952767:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1783071299.952774:0:6511:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1783071299.952785:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1783071299.952799:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1783071299.952823:0:6511:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1783071299.952825:0:6511:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1783071299.952829:0:6511:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1783071299.952887:0:6511:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1783071299.952890:0:6511:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1783071299.953172:0:6536:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1783071299.953316:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1783071299.953335:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1783071299.953348:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:1.0:1783071299.953355:0:6511:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1783071299.953356:0:6511:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1783071299.953691:0:6537:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:1.0:1783071299.953825:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1783071299.953842:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:1.0:1783071299.953854:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:1.0:1783071299.953863:0:6511:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783071299.953865:0:6511:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1783071299.953869:0:6511:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1783071299.953870:0:6511:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1783071299.953874:0:6511:0:(mgs_llog.c:5063:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1783071299.953880:0:6511:0:(mgs_llog.c:1376:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1783071299.954142:0:6538:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1783071299.954234:0:6511:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1783071299.960674:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1783071299.960714:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1783071299.960729:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1783071299.960748:0:6511:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1783071299.960768:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000005a053e71/0x6b58994c2cbdbb15 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071299.960783:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005a053e71/0x6b58994c2cbdbb15 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071299.960793:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005a053e71/0x6b58994c2cbdbb15 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071299.960800:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005a053e71/0x6b58994c2cbdbb15 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071299.960805:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000005a053e71/0x6b58994c2cbdbb15 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071299.960812:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000005a053e71/0x6b58994c2cbdbb15 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071299.960818:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005a053e71 already unused, calling callback (000000006c37b471) 00010000:00010000:1.0:1783071299.960821:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000005a053e71/0x6b58994c2cbdbb15 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071299.960828:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000005a053e71/0x6b58994c2cbdbb15 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071299.960842:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000005a053e71/0x6b58994c2cbdbb15 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071299.960864:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000005a053e71/0x6b58994c2cbdbb15 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071299.960869:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005a053e71/0x6b58994c2cbdbb15 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783071299.960886:0:6511:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1783071299.968882:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000034eb5d17 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+5:6493:x1869685707505920:12345-0@lo:253: Request processed in 19972us (20186us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071299.968901:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783071299.969040:0:6493:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000edb4fbc4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:6493:1869685707505920:0@lo:253: 10000000:01000000:2.0:1783071299.969055:0:6493:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1783071299.969058:0:6493:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783071299.969060:0:6493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783071299.969062:0:6493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783071299.969063:0:6493:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1783071299.969064:0:6493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783071299.969065:0:6493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783071299.969066:0:6493:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783071299.969068:0:6493:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783071299.969069:0:6493:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1783071299.969070:0:6493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783071299.969071:0:6493:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1783071299.969089:0:6493:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000f404632b from lustre-MDT0000 10000000:01000000:2.0:1783071299.969121:0:6493:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1783071299.969124:0:6493:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1783071299.969128:0:6493:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8f8b06c74d40 10000000:01000000:2.0:1783071299.969132:0:6493:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783071299.969140:0:6493:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff8f8b06c74d40 from 1 10000000:01000000:2.0:1783071299.969143:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1783071299.969180:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: 00000000a61119e6/0x6b58994c2cbdbb1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071299.969190:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: 00000000a61119e6/0x6b58994c2cbdbb1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071299.969210:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: 00000000a61119e6/0x6b58994c2cbdbb1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071299.969229:0:6493:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000edb4fbc4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:6493:1869685707506048:0@lo:101: 00000100:00100000:2.0:1783071299.969265:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071299.969309:0:6493:0:(client.c:2701:ptlrpc_set_wait()) set 0000000092a9d776 going to sleep for 11 seconds 00000100:00100000:0.0:1783071299.969359:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707506048 00000100:00100000:0.0:1783071299.969392:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707506048 00000100:00100000:0.0:1783071299.969440:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783071299.969447:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bc35edc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+5:6493:x1869685707506048:12345-0@lo:101: 00010000:00010000:0.0:1783071299.969460:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071299.969473:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006f817603/0x6b58994c2cbdbb23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdbb1c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071299.969493:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006f817603/0x6b58994c2cbdbb23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdbb1c expref: 6 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071299.969502:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006f817603/0x6b58994c2cbdbb23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbb1c expref: 6 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071299.969510:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006f817603, rc 0) 00000100:00100000:0.0:1783071299.969561:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bc35edc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+6:6493:x1869685707506048:12345-0@lo:101: Request processed in 115us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071299.969568:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783071299.969665:0:6493:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000edb4fbc4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:6493:1869685707506048:0@lo:101: 00010000:00010000:2.0:1783071299.969677:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: 00000000a61119e6/0x6b58994c2cbdbb1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbb23 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071299.969685:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: 00000000a61119e6/0x6b58994c2cbdbb1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdbb23 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071299.969744:0:6493:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000edb4fbc4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:6493:1869685707506176:0@lo:501: 00000100:00100000:2.0:1783071299.969770:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071299.969785:0:6493:0:(client.c:2701:ptlrpc_set_wait()) set 0000000092a9d776 going to sleep for 11 seconds 00000100:00100000:2.0:1783071299.969800:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707506176 00000100:00100000:2.0:1783071299.969803:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707506176 00000100:00100000:2.0:1783071299.969829:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783071299.969834:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e19ebb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+6:6493:x1869685707506176:12345-0@lo:501: 00000100:00100000:2.0:1783071299.969904:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e19ebb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+6:6493:x1869685707506176:12345-0@lo:501: Request processed in 70us (133us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783071299.969911:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783071299.969941:0:6493:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000edb4fbc4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:6493:1869685707506176:0@lo:501: 10000000:01000000:2.0:1783071299.969963:0:6493:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1783071299.969975:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: 00000000a61119e6/0x6b58994c2cbdbb1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbb23 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071299.969988:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: 00000000a61119e6/0x6b58994c2cbdbb1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbb23 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071299.969995:0:6493:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f8b10f7e000 10000000:01000000:2.0:1783071299.969998:0:6493:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1783071299.970002:0:6493:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8f8b10f7e000 10000000:01000000:2.0:1783071299.970004:0:6493:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1783071299.970006:0:6493:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff8f8b10f7e000 from 1 10000000:01000000:2.0:1783071299.970008:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1783071299.970021:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: 00000000fd217e1c/0x6b58994c2cbdbb2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071299.970027:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: 00000000fd217e1c/0x6b58994c2cbdbb2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071299.970033:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: 00000000fd217e1c/0x6b58994c2cbdbb2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071299.970044:0:6493:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000edb4fbc4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:6493:1869685707506304:0@lo:101: 00000100:00100000:2.0:1783071299.970067:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071299.970086:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707506304 00000100:00100000:2.0:1783071299.970090:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707506304 00000100:00100000:2.0:1783071299.970109:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783071299.970115:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000134799e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+6:6493:x1869685707506304:12345-0@lo:101: 00010000:00010000:2.0:1783071299.970121:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071299.970130:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000000f1f67b/0x6b58994c2cbdbb31 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdbb2a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071299.970152:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000000f1f67b/0x6b58994c2cbdbb31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdbb2a expref: 7 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071299.970160:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000000f1f67b/0x6b58994c2cbdbb31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbb2a expref: 7 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071299.970166:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000000f1f67b, rc 0) 00000100:00100000:2.0:1783071299.970189:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000134799e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+7:6493:x1869685707506304:12345-0@lo:101: Request processed in 75us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071299.970195:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783071299.970217:0:6493:0:(client.c:2701:ptlrpc_set_wait()) set 0000000092a9d776 going to sleep for 11 seconds 00000100:00100000:2.0:1783071299.970227:0:6493:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000edb4fbc4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:6493:1869685707506304:0@lo:101: 00010000:00010000:2.0:1783071299.970235:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: 00000000fd217e1c/0x6b58994c2cbdbb2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbb31 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071299.970242:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: 00000000fd217e1c/0x6b58994c2cbdbb2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdbb31 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071299.970251:0:6493:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1783071299.970254:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: 00000000fd217e1c/0x6b58994c2cbdbb2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbb31 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071299.970260:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: 00000000fd217e1c/0x6b58994c2cbdbb2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbb31 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071299.970266:0:6493:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1783071299.970269:0:6493:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783071299.970272:0:6493:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8f8b10f7e000 10000000:01000000:2.0:1783071299.970280:0:6493:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1783071299.970283:0:6493:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1783071299.970285:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1783071299.970297:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: 00000000a0753b5b/0x6b58994c2cbdbb38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071299.970303:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: 00000000a0753b5b/0x6b58994c2cbdbb38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071299.970309:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: 00000000a0753b5b/0x6b58994c2cbdbb38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071299.970320:0:6493:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000edb4fbc4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:6493:1869685707506432:0@lo:101: 00000100:00100000:2.0:1783071299.970342:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071299.970358:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707506432 00000100:00100000:2.0:1783071299.970386:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707506432 00000100:00100000:2.0:1783071299.970409:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783071299.970415:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000079ced8ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+7:6493:x1869685707506432:12345-0@lo:101: 00010000:00010000:2.0:1783071299.970422:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071299.970428:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000098db3fbf/0x6b58994c2cbdbb3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdbb38 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071299.970440:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000098db3fbf/0x6b58994c2cbdbb3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdbb38 expref: 8 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071299.970446:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000098db3fbf/0x6b58994c2cbdbb3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbb38 expref: 8 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071299.970452:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000098db3fbf, rc 0) 00000100:00100000:2.0:1783071299.970474:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000079ced8ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+8:6493:x1869685707506432:12345-0@lo:101: Request processed in 60us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071299.970486:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783071299.970508:0:6493:0:(client.c:2701:ptlrpc_set_wait()) set 0000000092a9d776 going to sleep for 11 seconds 00000100:00100000:2.0:1783071299.970518:0:6493:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000edb4fbc4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:6493:1869685707506432:0@lo:101: 00010000:00010000:2.0:1783071299.970526:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: 00000000a0753b5b/0x6b58994c2cbdbb38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbb3f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071299.970532:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: 00000000a0753b5b/0x6b58994c2cbdbb38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdbb3f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071299.970579:0:6493:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000edb4fbc4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:6493:1869685707506560:0@lo:501: 00000100:00100000:2.0:1783071299.970601:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071299.970619:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707506560 00000100:00100000:2.0:1783071299.970623:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707506560 00000100:00100000:2.0:1783071299.970643:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783071299.970648:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000523d5ce7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+8:6493:x1869685707506560:12345-0@lo:501: 00000100:00100000:2.0:1783071299.970732:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000523d5ce7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+9:6493:x1869685707506560:12345-0@lo:501: Request processed in 84us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071299.970738:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783071299.970755:0:6493:0:(client.c:2701:ptlrpc_set_wait()) set 0000000086775a0c going to sleep for 11 seconds 00000100:00100000:2.0:1783071299.970764:0:6493:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000edb4fbc4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:6493:1869685707506560:0@lo:501: 00000100:00100000:2.0:1783071299.970782:0:6493:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000edb4fbc4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:6493:1869685707506688:0@lo:503: 00000100:00100000:2.0:1783071299.970812:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071299.970828:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707506688 00000100:00100000:2.0:1783071299.970831:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707506688 00000100:00100000:2.0:1783071299.970851:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783071299.970856:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009d40ec1f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+9:6493:x1869685707506688:12345-0@lo:503: 00000100:00100000:2.0:1783071299.970924:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009d40ec1f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+9:6493:x1869685707506688:12345-0@lo:503: Request processed in 68us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071299.970930:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783071299.970960:0:6493:0:(client.c:2701:ptlrpc_set_wait()) set 0000000086775a0c going to sleep for 11 seconds 00000100:00100000:2.0:1783071299.970970:0:6493:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000edb4fbc4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:6493:1869685707506688:0@lo:503: 00000100:00100000:0.0:1783071299.971920:0:6539:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000039c9bb67 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:6539:1869685707506816:0@lo:502: 00000100:00100000:0.0:1783071299.971977:0:6539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071299.972035:0:6539:0:(client.c:2701:ptlrpc_set_wait()) set 000000003c36c03d going to sleep for 11 seconds 00000100:00100000:2.0:1783071299.972064:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707506816 00000100:00100000:2.0:1783071299.972070:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707506816 00000100:00100000:2.0:1783071299.972135:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783071299.972143:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002bd06d0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+9:6539:x1869685707506816:12345-0@lo:502: 00000100:00100000:2.0:1783071299.972241:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002bd06d0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+9:6539:x1869685707506816:12345-0@lo:502: Request processed in 100us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071299.972248:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783071299.972310:0:6539:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000039c9bb67 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:6539:1869685707506816:0@lo:502: 00000020:01000000:1.0:1783071299.972333:0:6539:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783071299.972344:0:6539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783071299.972346:0:6539:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1783071299.972350:0:6539:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1783071299.972353:0:6539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783071299.972395:0:6539:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000a032996f) 00000020:00000080:1.0:1783071299.972412:0:6539:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1783071299.972418:0:6539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1783071299.972498:0:6539:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:1.0:1783071299.972506:0:6539:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6b58994c2cbdbb4d 00000020:00000080:1.0:1783071299.972761:0:6539:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1783071299.972765:0:6539:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783071299.972768:0:6539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783071299.972769:0:6539:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1783071299.972771:0:6539:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783071299.972775:0:6539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783071299.972776:0:6539:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1783071299.972779:0:6539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783071299.972793:0:6539:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000ce5c66c2) 00000020:00000080:1.0:1783071299.972804:0:6539:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1783071299.972808:0:6539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1783071299.972809:0:6539:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1783071299.972816:0:6539:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1783071299.972822:0:6539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1783071299.972861:0:6539:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f404632b from lustre-MDT0000, refs=3 00000020:00000080:1.0:1783071299.972872:0:6539:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000058798d16) 00000020:00000080:1.0:1783071299.972879:0:6539:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1783071299.972950:0:6539:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1783071299.972955:0:6539:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6b58994c2cbdbb62 00000020:00000080:1.0:1783071299.973053:0:6539:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1783071299.973059:0:6539:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1783071299.973064:0:6539:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x6b58994c2cbdbb69 00080000:01000000:1.0:1783071299.973069:0:6539:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:1.0:1783071299.973072:0:6539:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6b58994c2cbdbb70 00080000:10000000:1.0:1783071299.973505:0:6539:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1783071299.973657:0:6539:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1783071299.978053:0:6539:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:1.0:1783071300.034979:0:6539:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:1.0:1783071300.035278:0:6539:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1783071300.038775:0:6539:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1783071300.039079:0:6539:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1783071300.041906:0:6539:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000008176ed6f) 00000020:00000080:1.0:1783071300.041927:0:6539:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1783071300.042012:0:6539:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:1.0:1783071300.042020:0:6539:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6b58994c2cbdbb7e 00000020:00000080:2.0:1783071300.045974:0:6539:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1783071300.046920:0:6539:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:3.0:1783071300.050743:0:6539:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:2.0:1783071300.056267:0:6539:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:2.0:1783071300.062823:0:6539:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:2.0:1783071300.064950:0:6539:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:2.0:1783071300.067005:0:6539:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:2.0:1783071300.068889:0:6539:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x6b58994c2cbdbb85 00000020:00000080:2.0:1783071300.069652:0:6539:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1783071300.069664:0:6539:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783071300.069671:0:6539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071300.069673:0:6539:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1783071300.069677:0:6539:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783071300.069681:0:6539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071300.069683:0:6539:0:(obd_config.c:1561:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783071300.069686:0:6539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783071300.069688:0:6539:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1783071300.069698:0:6539:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783071300.069701:0:6539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071300.069702:0:6539:0:(obd_config.c:1561:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:2.0:1783071300.069705:0:6539:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783071300.069710:0:6539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071300.069711:0:6539:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1783071300.069715:0:6539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1783071300.069760:0:6539:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1783071300.069821:0:6539:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000edb4fbc4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:6539:1869685707506944:0@lo:502: 00000100:00100000:2.0:1783071300.069907:0:6539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071300.069980:0:6539:0:(client.c:2701:ptlrpc_set_wait()) set 00000000c597094e going to sleep for 11 seconds 00000100:00100000:3.0:1783071300.071241:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707506944 00000100:00100000:3.0:1783071300.071253:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707506944 00000100:00100000:3.0:1783071300.071348:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783071300.071357:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000022c45a07 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+9:6539:x1869685707506944:12345-0@lo:502: 00000100:00100000:3.0:1783071300.071554:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000022c45a07 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+9:6539:x1869685707506944:12345-0@lo:502: Request processed in 196us (1646us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071300.071568:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783071300.071588:0:6539:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000edb4fbc4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:6539:1869685707506944:0@lo:502: 00000020:01000000:2.0:1783071300.071621:0:6539:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783071300.071627:0:6539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071300.071629:0:6539:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1783071300.071632:0:6539:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1783071300.071802:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1783071300.071825:0:6493:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1783071300.071847:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: 00000000a0753b5b/0x6b58994c2cbdbb38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbb3f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071300.071857:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: 00000000a0753b5b/0x6b58994c2cbdbb38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbb3f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783071300.071875:0:6493:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8f8b10f7e000 from 1 10000000:01000000:1.0:1783071300.071877:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783071300.071906:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: 000000005a053e71/0x6b58994c2cbdbb8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071300.071912:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: 000000005a053e71/0x6b58994c2cbdbb8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071300.071920:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: 000000005a053e71/0x6b58994c2cbdbb8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071300.071937:0:6493:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001f50c05d pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:6493:1869685707507072:0@lo:101: 00000100:00100000:1.0:1783071300.071999:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071300.079179:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707507072 00000100:00100000:0.0:1783071300.079195:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707507072 00000100:00100000:1.0:1783071300.079241:0:6493:0:(client.c:2701:ptlrpc_set_wait()) set 00000000e7fabdd3 going to sleep for 11 seconds 00000100:00100000:0.0:1783071300.079339:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783071300.079347:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c6e62d45 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+9:6493:x1869685707507072:12345-0@lo:101: 00010000:00010000:0.0:1783071300.079444:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071300.079464:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000032edb8b4/0x6b58994c2cbdbb93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdbb8c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071300.079491:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000032edb8b4/0x6b58994c2cbdbb93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdbb8c expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071300.079502:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000032edb8b4/0x6b58994c2cbdbb93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbb8c expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071300.079510:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000032edb8b4, rc 0) 00000100:00100000:0.0:1783071300.079593:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c6e62d45 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+10:6493:x1869685707507072:12345-0@lo:101: Request processed in 247us (7594us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071300.079601:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783071300.079623:0:6493:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001f50c05d pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:6493:1869685707507072:0@lo:101: 00010000:00010000:1.0:1783071300.079640:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: 000000005a053e71/0x6b58994c2cbdbb8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbb93 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071300.079650:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: 000000005a053e71/0x6b58994c2cbdbb8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdbb93 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071300.081493:0:6493:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001f50c05d pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:6493:1869685707507200:0@lo:256: 00000100:00100000:1.0:1783071300.081609:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071300.081651:0:6493:0:(client.c:2701:ptlrpc_set_wait()) set 00000000e7fabdd3 going to sleep for 11 seconds 00000100:00100000:3.0:1783071300.081702:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707507200 00000100:00100000:3.0:1783071300.081710:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707507200 00000100:00100000:3.0:1783071300.081762:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783071300.081770:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006830b9bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+10:6493:x1869685707507200:12345-0@lo:256: 20000000:01000000:3.0:1783071300.081789:0:6508:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1783071300.081808:0:6508:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1783071300.081888:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006830b9bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+10:6493:x1869685707507200:12345-0@lo:256: Request processed in 119us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071300.081895:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783071300.081929:0:6493:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001f50c05d pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:6493:1869685707507200:0@lo:256: 10000000:01000000:1.0:1783071300.082879:0:6493:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783071300.082905:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: 000000005a053e71/0x6b58994c2cbdbb8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbb93 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071300.082927:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: 000000005a053e71/0x6b58994c2cbdbb8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbb93 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783071300.082935:0:6493:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8f8b10f7e000 from 1 10000000:01000000:1.0:1783071300.082938:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783071300.082977:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: 00000000612b690b/0x6b58994c2cbdbb9a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071300.082984:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: 00000000612b690b/0x6b58994c2cbdbb9a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071300.082992:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: 00000000612b690b/0x6b58994c2cbdbb9a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071300.083009:0:6493:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001f50c05d pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:6493:1869685707507328:0@lo:101: 00000100:00100000:1.0:1783071300.083051:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071300.083076:0:6493:0:(client.c:2701:ptlrpc_set_wait()) set 00000000e7fabdd3 going to sleep for 11 seconds 00000100:00100000:0.0:1783071300.083188:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707507328 00000100:00100000:0.0:1783071300.083193:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707507328 00000100:00100000:0.0:1783071300.083232:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783071300.083238:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d1d2d55b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+10:6493:x1869685707507328:12345-0@lo:101: 00010000:00010000:0.0:1783071300.083250:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071300.083271:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000ffb5347/0x6b58994c2cbdbba1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdbb9a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071300.083292:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000ffb5347/0x6b58994c2cbdbba1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdbb9a expref: 11 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071300.083308:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000ffb5347/0x6b58994c2cbdbba1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbb9a expref: 11 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071300.083317:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000ffb5347, rc 0) 00000100:00100000:0.0:1783071300.083356:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d1d2d55b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+11:6493:x1869685707507328:12345-0@lo:101: Request processed in 118us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071300.083395:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783071300.083700:0:6493:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001f50c05d pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:6493:1869685707507328:0@lo:101: 00010000:00010000:1.0:1783071300.083714:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: 00000000612b690b/0x6b58994c2cbdbb9a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbba1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071300.083723:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: 00000000612b690b/0x6b58994c2cbdbb9a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdbba1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071300.083778:0:6493:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001f50c05d pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:6493:1869685707507456:0@lo:501: 00000100:00100000:1.0:1783071300.083807:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071300.083836:0:6493:0:(client.c:2701:ptlrpc_set_wait()) set 00000000e7fabdd3 going to sleep for 11 seconds 00000100:00100000:3.0:1783071300.083873:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707507456 00000100:00100000:3.0:1783071300.083879:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707507456 00000100:00100000:3.0:1783071300.083914:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783071300.083920:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ac70708 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+11:6493:x1869685707507456:12345-0@lo:501: 00000100:00100000:3.0:1783071300.084096:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ac70708 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+11:6493:x1869685707507456:12345-0@lo:501: Request processed in 176us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071300.084103:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783071300.084241:0:6493:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001f50c05d pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:6493:1869685707507456:0@lo:501: 00000100:00100000:1.0:1783071300.084269:0:6493:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001f50c05d pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:6493:1869685707507584:0@lo:503: 00000100:00100000:1.0:1783071300.084309:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071300.084332:0:6493:0:(client.c:2701:ptlrpc_set_wait()) set 00000000e7fabdd3 going to sleep for 11 seconds 00000100:00100000:0.0:1783071300.084353:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707507584 00000100:00100000:0.0:1783071300.084358:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707507584 00000100:00100000:0.0:1783071300.084399:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783071300.084405:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000950ad5a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+11:6493:x1869685707507584:12345-0@lo:503: 00000040:00080000:0.0:1783071300.084435:0:6511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783071300.084543:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000950ad5a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+11:6493:x1869685707507584:12345-0@lo:503: Request processed in 138us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071300.084550:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783071300.085680:0:6493:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001f50c05d pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:6493:1869685707507584:0@lo:503: 00000040:00080000:2.0:1783071300.086902:0:6543:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1783071300.087099:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1783071300.087118:0:6493:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783071300.087167:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: 00000000612b690b/0x6b58994c2cbdbb9a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbba1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071300.087178:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: 00000000612b690b/0x6b58994c2cbdbb9a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbba1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783071300.087230:0:6493:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1783071300.087233:0:6493:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f8b10f7e000 10000000:01000000:1.0:1783071300.087236:0:6493:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f8b10f7e000 10000000:01000000:1.0:1783071300.087241:0:6493:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783071300.087246:0:6493:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8f8b10f7e000 from 1 10000000:01000000:1.0:1783071300.087248:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783071300.087289:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: 000000005c90fa58/0x6b58994c2cbdbba8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071300.087297:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: 000000005c90fa58/0x6b58994c2cbdbba8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071300.087306:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: 000000005c90fa58/0x6b58994c2cbdbba8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071300.087328:0:6493:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001f50c05d pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:6493:1869685707507712:0@lo:101: 00000100:00100000:1.0:1783071300.087427:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071300.087465:0:6493:0:(client.c:2701:ptlrpc_set_wait()) set 000000000e8f3419 going to sleep for 11 seconds 00000100:00100000:3.0:1783071300.087570:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707507712 00000100:00100000:3.0:1783071300.087577:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707507712 00000100:00100000:3.0:1783071300.087639:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783071300.087649:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006181152b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+11:6493:x1869685707507712:12345-0@lo:101: 00010000:00010000:3.0:1783071300.087662:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071300.087676:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007b735a56/0x6b58994c2cbdbbaf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdbba8 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071300.087698:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007b735a56/0x6b58994c2cbdbbaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdbba8 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071300.087725:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007b735a56/0x6b58994c2cbdbbaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbba8 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071300.087733:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007b735a56, rc 0) 00000100:00100000:3.0:1783071300.087780:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006181152b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+12:6493:x1869685707507712:12345-0@lo:101: Request processed in 134us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071300.087788:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783071300.087809:0:6493:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001f50c05d pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:6493:1869685707507712:0@lo:101: 00010000:00010000:1.0:1783071300.087824:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: 000000005c90fa58/0x6b58994c2cbdbba8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbbaf expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071300.087832:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: 000000005c90fa58/0x6b58994c2cbdbba8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdbbaf expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071300.087875:0:6493:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001f50c05d pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:6493:1869685707507840:0@lo:501: 00000100:00100000:1.0:1783071300.087896:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071300.087915:0:6493:0:(client.c:2701:ptlrpc_set_wait()) set 000000000e8f3419 going to sleep for 11 seconds 00000100:00100000:2.0:1783071300.087956:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707507840 00000100:00100000:2.0:1783071300.087960:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707507840 00000100:00100000:2.0:1783071300.088012:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783071300.088018:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005d003244 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+12:6493:x1869685707507840:12345-0@lo:501: 00000100:00100000:2.0:1783071300.088138:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005d003244 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+12:6493:x1869685707507840:12345-0@lo:501: Request processed in 120us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071300.088144:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783071300.088194:0:6493:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001f50c05d pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:6493:1869685707507840:0@lo:501: 00000100:00100000:3.0:1783071300.088231:0:6493:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000013bd6105 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:6493:1869685707507968:0@lo:503: 00000100:00100000:3.0:1783071300.088262:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071300.088494:0:6493:0:(client.c:2701:ptlrpc_set_wait()) set 0000000071d74baa going to sleep for 11 seconds 00000100:00100000:1.0:1783071300.088562:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707507968 00000100:00100000:1.0:1783071300.088566:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707507968 00000100:00100000:1.0:1783071300.088586:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783071300.088592:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007f006ca9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+12:6493:x1869685707507968:12345-0@lo:503: 00000100:00100000:1.0:1783071300.088669:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007f006ca9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+12:6493:x1869685707507968:12345-0@lo:503: Request processed in 77us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071300.088675:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783071300.088740:0:6493:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000013bd6105 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:6493:1869685707507968:0@lo:503: 00000100:00100000:3.0:1783071300.089020:0:6544:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000013bd6105 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:6544:1869685707508096:0@lo:502: 00000100:00100000:3.0:1783071300.089054:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071300.089076:0:6544:0:(client.c:2701:ptlrpc_set_wait()) set 000000005e8f7825 going to sleep for 11 seconds 00000100:00100000:1.0:1783071300.089116:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707508096 00000100:00100000:1.0:1783071300.089119:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707508096 00000100:00100000:1.0:1783071300.089134:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783071300.089138:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000023e39baf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+12:6544:x1869685707508096:12345-0@lo:502: 00000100:00100000:1.0:1783071300.089212:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000023e39baf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+12:6544:x1869685707508096:12345-0@lo:502: Request processed in 73us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071300.089219:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783071300.089291:0:6544:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000013bd6105 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:6544:1869685707508096:0@lo:502: 00000020:01000004:3.0:1783071300.089345:0:6544:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1783071300.089386:0:6544:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000006aab6f9a) 00000020:00000080:3.0:1783071300.089406:0:6544:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1783071300.089621:0:6544:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f404632b from lustre-MDT0000, refs=4 00000020:01000004:3.0:1783071300.089625:0:6544:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000f404632b from lustre-MDT0000, refs=4 00000020:01000004:3.0:1783071300.089628:0:6544:0:(obd_mount.c:701:lustre_put_lsi()) put 00000000f404632b 4 00010000:00080000:3.0:1783071300.089655:0:6544:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000c013000a@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.138@tcp at head 00010000:00010000:3.0:1783071300.091826:0:6544:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1783071300.091932:0:6544:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1783071300.091981:0:6544:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783071300.091993:0:6544:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x6b58994c2cbdbbbd 00000100:00080000:3.0:1783071300.092002:0:6544:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783071300.092006:0:6544:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000c013000a using connection 192.168.204.138@tcp/0@lo 00000100:00100000:3.0:1783071300.092049:0:6544:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000013bd6105 x1869685707508224/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783071300.092094:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000013bd6105 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1869685707508224:0@lo:38: 00000100:00100000:3.0:1783071300.092172:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783071300.092213:0:6544:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1783071300.093900:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707508224 00000100:00100000:1.0:1783071300.093916:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707508224 00000100:00100000:1.0:1783071300.093956:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783071300.093962:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000298e5c44 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1869685707508224:12345-0@lo:38: 00000100:00100000:1.0:1783071300.094044:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000298e5c44 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1869685707508224:12345-0@lo:38: Request processed in 81us (1872us total) trans 0 rc -11/-11 00000100:00100000:1.0:1783071300.094051:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783071300.094101:0:3644:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783071300.094108:0:3644:0:(import.c:65:import_set_state_nolock()) 00000000c013000a lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783071300.094112:0:3644:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783071300.094115:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000013bd6105 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1869685707508224:0@lo:38: 00000100:00100000:3.0:1783071300.094504:0:6544:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000006802afaa pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:6544:1869685707508352:0@lo:502: 00000100:00100000:3.0:1783071300.094562:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071300.094591:0:6544:0:(client.c:2701:ptlrpc_set_wait()) set 000000005e8f7825 going to sleep for 11 seconds 00000100:00100000:1.0:1783071300.094668:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707508352 00000100:00100000:1.0:1783071300.094673:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707508352 00000100:00100000:1.0:1783071300.094700:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783071300.094706:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000048c61749 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+12:6544:x1869685707508352:12345-0@lo:502: 00000100:00100000:1.0:1783071300.094802:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000048c61749 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+12:6544:x1869685707508352:12345-0@lo:502: Request processed in 96us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071300.094809:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783071300.094891:0:6544:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000006802afaa pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:6544:1869685707508352:0@lo:502: 00000040:00080000:3.0:1783071300.094910:0:6544:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1783071300.095046:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1783071300.095067:0:6493:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783071300.095086:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: 000000005c90fa58/0x6b58994c2cbdbba8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbbaf expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071300.095096:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: 000000005c90fa58/0x6b58994c2cbdbba8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbbaf expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1783071300.095141:0:6493:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1783071300.095143:0:6493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783071300.095144:0:6493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783071300.095145:0:6493:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783071300.095149:0:6493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783071300.095151:0:6493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783071300.095152:0:6493:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783071300.095153:0:6493:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783071300.095154:0:6493:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783071300.095155:0:6493:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783071300.095157:0:6493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783071300.095158:0:6493:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783071300.095161:0:6493:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1783071300.095163:0:6493:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783071300.095165:0:6493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783071300.095166:0:6493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783071300.095166:0:6493:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783071300.095167:0:6493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783071300.095168:0:6493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783071300.095169:0:6493:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783071300.095170:0:6493:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783071300.095170:0:6493:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783071300.095171:0:6493:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783071300.095172:0:6493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783071300.095173:0:6493:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783071300.095186:0:6493:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1783071300.095194:0:6493:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007a328933 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:6493:1869685707508480:0@lo:253: 00000100:00100000:1.0:1783071300.095236:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071300.095255:0:6493:0:(client.c:2701:ptlrpc_set_wait()) set 00000000e7fabdd3 going to sleep for 11 seconds 00000100:00100000:0.0:1783071300.095258:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707508480 00000100:00100000:0.0:1783071300.095262:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707508480 00000100:00100000:0.0:1783071300.095287:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783071300.095293:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000047f40c8e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+12:6493:x1869685707508480:12345-0@lo:253: 20000000:01000000:0.0:1783071300.095312:0:6508:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1783071300.095326:0:6508:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1783071300.102570:0:6508:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783071300.102636:0:6508:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1783071300.103337:0:6533:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1783071300.103344:0:6533:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1783071300.103428:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000d161545a/0x6b58994c2cbdbbc4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071300.103447:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000032edb8b4/0x6b58994c2cbdbb93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbb8c expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071300.103455:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000d161545a/0x6b58994c2cbdbbc4 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071300.103506:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000032edb8b4/0x6b58994c2cbdbb93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6b58994c2cbdbb8c expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071300.103577:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000032edb8b4/0x6b58994c2cbdbb93 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6b58994c2cbdbb8c expref: 12 pid: 6511 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071300.103591:0:6533:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000000a80d70 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1869685707508608:0@lo:104: 00000100:00100000:1.0:1783071300.103644:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071300.103661:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000047f40c8e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+12:6493:x1869685707508480:12345-0@lo:253: Request processed in 8368us (8426us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071300.103673:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783071300.103695:0:6533:0:(client.c:2701:ptlrpc_set_wait()) set 000000001ae4d2d8 going to sleep for 11 seconds 00000100:00100000:3.0:1783071300.103802:0:6493:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007a328933 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:6493:1869685707508480:0@lo:253: 10000000:01000000:3.0:1783071300.103818:0:6493:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1783071300.103821:0:6493:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783071300.103823:0:6493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783071300.103824:0:6493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783071300.103826:0:6493:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783071300.103827:0:6493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783071300.103828:0:6493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783071300.103829:0:6493:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783071300.103830:0:6493:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783071300.103831:0:6493:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783071300.103832:0:6493:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783071300.103833:0:6493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783071300.103834:0:6493:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1783071300.103849:0:6493:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1783071300.104074:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707508608 00000100:00100000:2.0:1783071300.104082:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707508608 00000100:00100000:2.0:1783071300.104137:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783071300.104146:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cb776a9e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:feaa1501-b927-4e07-baad-3200e92d7497+3:6533:x1869685707508608:12345-0@lo:104: 00010000:00010000:2.0:1783071300.104159:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: 000000005a053e71/0x6b58994c2cbdbb8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbb93 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071300.104230:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783071300.104235:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cb776a9e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:feaa1501-b927-4e07-baad-3200e92d7497+3:6533:x1869685707508608:12345-0@lo:104: Request processed in 91us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071300.104242:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1783071300.104268:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783071300.104278:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: 000000005a053e71/0x6b58994c2cbdbb8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbb93 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071300.104286:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005a053e71 already unused, calling callback (0000000048d7fc16) 10000000:00010000:0.0:1783071300.104289:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: 000000005a053e71/0x6b58994c2cbdbb8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6b58994c2cbdbb93 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071300.104297:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: 000000005a053e71/0x6b58994c2cbdbb8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6b58994c2cbdbb93 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783071300.104303:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: 000000005a053e71/0x6b58994c2cbdbb8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6b58994c2cbdbb93 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783071300.104308:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:1.0:1783071300.104346:0:6533:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000000a80d70 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1869685707508608:0@lo:104: 00010000:00010000:0.0:1783071300.104348:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: 000000005a053e71/0x6b58994c2cbdbb8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbb93 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071300.104357:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783071300.104386:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000d161545a/0x6b58994c2cbdbbc4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071300.104401:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: 000000005a053e71/0x6b58994c2cbdbb8c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbb93 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071300.104410:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: 000000005a053e71/0x6b58994c2cbdbb8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbb93 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071300.104427:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071300.104428:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071300.104430:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071300.105798:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000984591f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:feaa1501-b927-4e07-baad-3200e92d7497:3646:1869685707508736:0@lo:103: 00000100:00100000:0.0:1783071300.105859:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071300.107496:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707508736 00000100:00100000:1.0:1783071300.107511:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707508736 00010000:00010000:1.0:1783071300.107566:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000032edb8b4/0x6b58994c2cbdbb93 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbb8c expref: 12 pid: 6511 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071300.107608:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783071300.107616:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bedd4aaf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:feaa1501-b927-4e07-baad-3200e92d7497+12:3646:x1869685707508736:12345-0@lo:103: 00010000:00010000:1.0:1783071300.107630:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071300.107634:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000032edb8b4/0x6b58994c2cbdbb93 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbb8c expref: 12 pid: 6511 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071300.107644:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000032edb8b4/0x6b58994c2cbdbb93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6b58994c2cbdbb8c expref: 12 pid: 6511 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071300.107659:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000032edb8b4/0x6b58994c2cbdbb93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6b58994c2cbdbb8c expref: 12 pid: 6511 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071300.107674:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000d161545a/0x6b58994c2cbdbbc4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071300.107690:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d161545a/0x6b58994c2cbdbbc4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783071300.107706:0:6501:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004362953s 00010000:00010000:1.0:1783071300.107710:0:6501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d161545a/0x6b58994c2cbdbbc4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071300.107715:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d161545a/0x6b58994c2cbdbbc4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071300.107721:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000d161545a/0x6b58994c2cbdbbc4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071300.107727:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000d161545a/0x6b58994c2cbdbbc4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071300.107733:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d161545a already unused, calling callback (000000006c37b471) 00010000:00010000:1.0:1783071300.107736:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000d161545a/0x6b58994c2cbdbbc4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071300.107743:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000d161545a/0x6b58994c2cbdbbc4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071300.107765:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000d161545a/0x6b58994c2cbdbbc4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071300.107775:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071300.107835:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bedd4aaf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:feaa1501-b927-4e07-baad-3200e92d7497+11:3646:x1869685707508736:12345-0@lo:103: Request processed in 221us (1977us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071300.107843:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783071300.107941:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000984591f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:feaa1501-b927-4e07-baad-3200e92d7497:3646:1869685707508736:0@lo:103: 00010000:00010000:2.0:1783071300.108006:0:6533:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000d161545a/0x6b58994c2cbdbbc4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071300.108016:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000d161545a/0x6b58994c2cbdbbc4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071300.108022:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d161545a/0x6b58994c2cbdbbc4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1783071300.116847:0:6493:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:3.0:1783071300.117026:0:6493:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1783071300.117278:0:6493:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:3.0:1783071300.117631:0:6493:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1783071300.117885:0:6493:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:3.0:1783071300.118022:0:6493:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:1.0:1783071300.119069:0:6493:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:1.0:1783071300.119308:0:6493:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:1.0:1783071300.119779:0:6493:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:1.0:1783071300.119935:0:6493:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:1.0:1783071300.120210:0:6493:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:1.0:1783071300.120634:0:6493:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:1.0:1783071300.124030:0:6493:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1783071300.138982:0:6493:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1783071300.140041:0:6549:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1783071300.140048:0:6549:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1783071300.140488:0:6550:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1783071300.141820:0:6493:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1783071300.141932:0:6493:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1783071300.142450:0:6493:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1783071300.142458:0:6493:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1783071300.142572:0:6493:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783071300.143795:0:6493:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1783071300.144505:0:6493:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1783071300.144552:0:6493:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1783071300.146086:0:6493:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1783071300.149062:0:6493:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:0.0:1783071300.150121:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1783071300.150260:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1783071300.150859:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1783071300.151002:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1783071300.151149:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1783071300.151287:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1783071300.151673:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00000040:00080000:3.0:1783071300.151964:0:6550:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00100000:10000000:0.0:1783071300.151996:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1783071300.152204:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1783071300.154890:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1783071300.155086:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1783071300.155238:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1783071300.155399:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1783071300.155547:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1783071300.155705:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1783071300.155845:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1783071300.156153:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1783071300.156313:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1783071300.156510:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1783071300.156658:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1783071300.156797:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1783071300.156972:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1783071300.157122:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1783071300.157275:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1783071300.157450:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00000040:00080000:3.0:1783071300.161590:0:6550:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1783071300.161695:0:6550:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1783071300.161700:0:6550:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:1.0:1783071300.162870:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1783071300.163050:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1783071300.163204:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1783071300.163859:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1783071300.164022:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1783071300.164165:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1783071300.164567:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1783071300.164868:0:6493:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:1.0:1783071300.168146:0:6493:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1783071300.168185:0:6493:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9cbcc1b87988 00100000:10000000:1.0:1783071300.168193:0:6493:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1783071300.169133:0:6493:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1783071300.169148:0:6493:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.138@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1783071300.169165:0:6493:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1783071300.169182:0:6493:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1783071300.176215:0:6493:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783071300.176461:0:6493:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1783071300.866611:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071301.893557:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071302.915681:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783071303.785951:0:6794:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg438-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1783071303.938527:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783071304.527189:0:6846:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783071304.527444:0:6846:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783071304.963332:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071305.540145:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000000a80d70 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:feaa1501-b927-4e07-baad-3200e92d7497:3647:1869685707508864:0@lo:400: 00000100:00100000:2.0:1783071305.540225:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783071305.540311:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1783071305.540316:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783071305.540333:0:8:0:(import.c:65:import_set_state_nolock()) 00000000c013000a lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783071305.540342:0:8:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000c013000a using connection 192.168.204.138@tcp/0@lo 00000100:00100000:1.0:1783071305.540389:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000002c137a37 x1869685707508992/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783071305.540484:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707508864 00000100:00100000:0.0:1783071305.540493:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707508864 00000100:00100000:0.0:1783071305.540539:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783071305.540547:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000032efc9e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+11:3647:x1869685707508864:12345-0@lo:400: 00000100:00100000:3.0:1783071305.541187:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002c137a37 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1869685707508992:0@lo:38: 00000100:00100000:3.0:1783071305.541227:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071305.541394:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707508992 00000100:00100000:1.0:1783071305.541399:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707508992 00000100:00100000:1.0:1783071305.541441:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783071305.541446:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006802afaa pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1869685707508992:12345-0@lo:38: 00010000:00080000:1.0:1783071305.541469:0:6518:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 207 last 0 00000020:00000080:1.0:1783071305.541502:0:6518:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x6b58994c2cbdbbcb 00000004:00100000:1.0:1783071305.541550:0:6518:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1783071305.542028:0:6518:0:(import.c:65:import_set_state_nolock()) 0000000077f8a456 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783071305.542187:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006802afaa pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1869685707508992:12345-0@lo:38: Request processed in 738us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071305.542194:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783071305.542322:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000032efc9e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+11:3647:x1869685707508864:12345-0@lo:400: Request processed in 1775us (2097us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071305.542332:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1783071305.542457:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000002c137a37 x1869685707508992/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783071315 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783071305.542471:0:3644:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1783071305.542478:0:3644:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1783071305.542482:0:3644:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1783071305.542484:0:3644:0:(import.c:65:import_set_state_nolock()) 00000000c013000a lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1783071305.542489:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002c137a37 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1869685707508992:0@lo:38: 00000100:00100000:2.0:1783071305.545954:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000000a80d70 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:feaa1501-b927-4e07-baad-3200e92d7497:3647:1869685707508864:0@lo:400: 00010000:00010000:1.0:1783071305.987217:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071307.010632:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783071307.117898:0:6948:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783071307.118115:0:6948:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:2.0:1783071307.587038:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783071307.587046:0:6513:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8f8b10f7e000 from 3 10000000:01000000:2.0:1783071307.587051:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783071307.587095:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: 00000000a82f37a0/0x6b58994c2cbdbbd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071307.587107:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: 00000000a82f37a0/0x6b58994c2cbdbbd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071307.587118:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: 00000000a82f37a0/0x6b58994c2cbdbbd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071307.587140:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000edb4fbc4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707509120:0@lo:101: 00000100:00100000:2.0:1783071307.587222:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071307.587283:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set 000000007ce614bb going to sleep for 11 seconds 00000100:00100000:0.0:1783071307.587730:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707509120 00000100:00100000:0.0:1783071307.587738:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707509120 00000100:00100000:0.0:1783071307.588762:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783071307.588774:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001941ddef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+11:6513:x1869685707509120:12345-0@lo:101: 00010000:00010000:0.0:1783071307.589029:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071307.589047:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000032edb8b4/0x6b58994c2cbdbbd9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdbbd2 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071307.589082:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000032edb8b4/0x6b58994c2cbdbbd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdbbd2 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071307.589089:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000032edb8b4/0x6b58994c2cbdbbd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbbd2 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071307.589095:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000032edb8b4, rc 0) 00000100:00100000:0.0:1783071307.589152:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001941ddef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+12:6513:x1869685707509120:12345-0@lo:101: Request processed in 382us (1931us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071307.589157:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783071307.589356:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000edb4fbc4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707509120:0@lo:101: 00010000:00010000:3.0:1783071307.589423:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: 00000000a82f37a0/0x6b58994c2cbdbbd2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbbd9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071307.589434:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: 00000000a82f37a0/0x6b58994c2cbdbbd2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdbbd9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071307.589498:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000008d016288 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707509248:0@lo:256: 00000100:00100000:3.0:1783071307.589538:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071307.589572:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set 00000000e0e5cdd7 going to sleep for 11 seconds 00000100:00100000:0.0:1783071307.589603:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707509248 00000100:00100000:0.0:1783071307.589610:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707509248 00000100:00100000:0.0:1783071307.589648:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783071307.589654:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004445fa1f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+12:6513:x1869685707509248:12345-0@lo:256: 20000000:01000000:0.0:1783071307.589668:0:6510:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783071307.589684:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783071307.589687:0:6510:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1783071307.589775:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004445fa1f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+12:6513:x1869685707509248:12345-0@lo:256: Request processed in 120us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071307.589782:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783071307.589811:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000008d016288 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707509248:0@lo:256: 10000000:01000000:0.0:1783071307.589851:0:6513:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783071307.589858:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: 00000000a82f37a0/0x6b58994c2cbdbbd2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbbd9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071307.589866:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: 00000000a82f37a0/0x6b58994c2cbdbbd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbbd9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071308.040029:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071309.060935:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071310.082689:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071310.660690:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783071310.660714:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000002cbf3a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869685707509504:0@lo:400: 00000100:00100000:0.0:1783071310.660790:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071310.660851:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707509504 00000100:00100000:0.0:1783071310.660858:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707509504 00000100:00100000:0.0:1783071310.660903:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783071310.660910:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005c2f8f21 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869685707509504:12345-0@lo:400: 00000100:00100000:0.0:1783071310.660960:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005c2f8f21 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869685707509504:12345-0@lo:400: Request processed in 50us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071310.660966:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1783071310.661012:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000002cbf3a8 x1869685707509504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071310.661024:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000002cbf3a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869685707509504:0@lo:400: 00000100:00100000:2.0:1783071310.661129:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000984591f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:feaa1501-b927-4e07-baad-3200e92d7497:3648:1869685707509376:0@lo:400: 00000100:00100000:2.0:1783071310.661165:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071310.661243:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707509376 00000100:00100000:0.0:1783071310.661247:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707509376 00000100:00100000:0.0:1783071310.661315:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783071310.661323:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000df468655 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+12:3648:x1869685707509376:12345-0@lo:400: 00000100:00100000:0.0:1783071310.661386:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000df468655 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+12:3648:x1869685707509376:12345-0@lo:400: Request processed in 65us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071310.661393:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783071310.662552:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000984591f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:feaa1501-b927-4e07-baad-3200e92d7497:3648:1869685707509376:0@lo:400: 00010000:00010000:0.0:1783071311.110716:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071312.131591:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071313.164978:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071314.186843:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071315.202569:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1783071315.583836:0:7446:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1783071315.583840:0:7446:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1783071315.583841:0:7446:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1783071315.583977:0:7446:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000a46aaa3d 00000020:01000004:2.0:1783071315.583993:0:7446:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:2.0:1783071315.584003:0:7446:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1783071315.584015:0:7446:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (00000000c7cd2283) 00000020:00000080:2.0:1783071315.584030:0:7446:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1783071315.632218:0:7446:0:(scrub.c:229:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:2.0:1783071315.632303:0:7446:0:(scrub.c:229:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:0.0:1783071315.662078:0:7446:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1783071315.662311:0:7446:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1783071315.662551:0:7446:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:0.0:1783071315.662566:0:7446:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x6b58994c2cbdbbe7 00000020:01000004:0.0:1783071315.662573:0:7446:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1783071315.662593:0:7446:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.204.138@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1783071315.662597:0:7446:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.138@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1783071315.662603:0:7446:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1783071315.662629:0:7446:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1783071315.662634:0:7446:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.138@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1783071315.676995:0:7446:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.138@tcp ctxt 0 is initialized 00000020:01000004:0.0:1783071315.677034:0:7446:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.138@tcp, index=0001, flags=0x20061 00000020:01000004:0.0:1783071315.677038:0:7446:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1783071315.677040:0:7446:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1783071315.677041:0:7446:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783071315.677043:0:7446:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783071315.677044:0:7446:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783071315.677045:0:7446:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783071315.677047:0:7446:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783071315.677048:0:7446:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783071315.677049:0:7446:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783071315.677050:0:7446:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783071315.677052:0:7446:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783071315.677055:0:7446:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:0.0:1783071315.677057:0:7446:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783071315.677058:0:7446:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1783071315.677059:0:7446:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783071315.677060:0:7446:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783071315.677061:0:7446:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783071315.677062:0:7446:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783071315.677063:0:7446:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783071315.677064:0:7446:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783071315.677065:0:7446:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783071315.677066:0:7446:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783071315.677067:0:7446:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783071315.677099:0:7446:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1783071315.677116:0:7446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000002cbf3a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:7446:1869685707509632:0@lo:253: 00000100:00100000:0.0:1783071315.677188:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071315.677283:0:7446:0:(client.c:2701:ptlrpc_set_wait()) set 0000000091244daf going to sleep for 11 seconds 00000100:00100000:3.0:1783071315.677453:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707509632 00000100:00100000:3.0:1783071315.677461:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707509632 00000100:00100000:3.0:1783071315.677549:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783071315.677559:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008a35b272 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+12:7446:x1869685707509632:12345-0@lo:253: 20000000:01000000:3.0:1783071315.677589:0:6508:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1783071315.677594:0:6508:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:3.0:1783071315.677598:0:6508:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:3.0:1783071315.677602:0:6508:0:(mgs_llog.c:3603:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:3.0:1783071315.677633:0:6508:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:3.0:1783071315.677805:0:6508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783071315.677915:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1783071315.677928:0:6508:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1783071315.677943:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1783071315.677956:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1783071315.677969:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1783071315.678015:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:3.0:1783071315.678023:0:6508:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:3.0:1783071315.678033:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:3.0:1783071315.678044:0:6508:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:3.0:1783071315.678057:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:3.0:1783071315.678061:0:6508:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:3.0:1783071315.678071:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1783071315.678083:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1783071315.678172:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:3.0:1783071315.678180:0:6508:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.204.138@tcp (null) (null) (null) 00000040:00080000:3.0:1783071315.678191:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:3.0:1783071315.678197:0:6508:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1783071315.678208:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:3.0:1783071315.678214:0:6508:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.204.138@tcp (null) (null) 00000040:00080000:3.0:1783071315.678225:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:3.0:1783071315.678230:0:6508:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1783071315.678255:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1783071315.678275:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1783071315.678285:0:6508:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1783071315.678456:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:3.0:1783071315.678466:0:6508:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:3.0:1783071315.678479:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1783071315.678492:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1783071315.678505:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:3.0:1783071315.678510:0:6508:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:3.0:1783071315.678521:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1783071315.678540:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1783071315.678544:0:6508:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:3.0:1783071315.678565:0:6508:0:(mgs_llog.c:3300:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1783071315.678571:0:6508:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:3.0:1783071315.679112:0:7452:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1783071315.679313:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1783071315.679333:0:6508:0:(mgs_llog.c:3346:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.138@tcp for mdt 20000000:01000000:0.0:1783071315.679334:0:6508:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.204.138@tcp (null) (null) (null) 00000040:00080000:0.0:1783071315.679347:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1783071315.679352:0:6508:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1783071315.679392:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1783071315.679399:0:6508:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.204.138@tcp (null) (null) 00000040:00080000:0.0:1783071315.679416:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1783071315.679423:0:6508:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:0.0:1783071315.679435:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:0.0:1783071315.679449:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:0.0:1783071315.679492:0:6508:0:(mgs_llog.c:3426:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:0.0:1783071315.679500:0:6508:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:2.0:1783071315.683017:0:7453:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:0.0:1783071315.683305:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1783071315.683333:0:6508:0:(mgs_llog.c:3484:mgs_write_log_osp_to_mdt()) add nid 192.168.204.138@tcp for mdt 20000000:01000000:0.0:1783071315.683335:0:6508:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.204.138@tcp (null) (null) (null) 00000040:00080000:0.0:1783071315.683350:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1783071315.683356:0:6508:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1783071315.683397:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1783071315.683404:0:6508:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.204.138@tcp (null) (null) 00000040:00080000:0.0:1783071315.683414:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1783071315.683420:0:6508:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:0.0:1783071315.683431:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1783071315.683445:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:0.0:1783071315.683583:0:6508:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1783071315.683587:0:6508:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1783071315.683592:0:6508:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1783071315.683653:0:6508:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1783071315.683656:0:6508:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1783071315.685794:0:7454:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:1.0:1783071315.685838:0:7454:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:1.0:1783071315.685926:0:7454:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1783071315.686267:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:0.0:1783071315.686289:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:0.0:1783071315.686317:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:0.0:1783071315.686325:0:6508:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1783071315.686327:0:6508:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1783071315.686824:0:7455:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1783071315.686910:0:7455:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1783071315.686928:0:7455:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:0.0:1783071315.687078:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1783071315.687095:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1783071315.687109:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:0.0:1783071315.687117:0:6508:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1783071315.687118:0:6508:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1783071315.689408:0:7456:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1783071315.689463:0:7456:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1783071315.689478:0:7456:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1783071315.689656:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1783071315.689680:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1783071315.689719:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1783071315.689736:0:6508:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1783071315.689738:0:6508:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1783071315.689743:0:6508:0:(mgs_llog.c:5063:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1783071315.689750:0:6508:0:(mgs_llog.c:1376:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1783071315.691063:0:7457:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:0.0:1783071315.691282:0:6508:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:0.0:1783071315.704256:0:6508:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1783071315.704293:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000003b718b38/0x6b58994c2cbdbbee lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071315.704403:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000006f817603/0x6b58994c2cbdbb23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbb1c expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071315.704412:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000098db3fbf/0x6b58994c2cbdbb3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbb38 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071315.704419:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000007b735a56/0x6b58994c2cbdbbaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbba8 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071315.704425:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000003b718b38/0x6b58994c2cbdbbee lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071315.704543:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000007b735a56/0x6b58994c2cbdbbaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6b58994c2cbdbba8 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071315.704560:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000007b735a56/0x6b58994c2cbdbbaf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6b58994c2cbdbba8 expref: 12 pid: 6508 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071315.704588:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000087318771 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1869685707509760:0@lo:104: 00000100:00100000:0.0:1783071315.704660:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783071315.704718:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000098db3fbf/0x6b58994c2cbdbb3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6b58994c2cbdbb38 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071315.704726:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000098db3fbf/0x6b58994c2cbdbb3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6b58994c2cbdbb38 expref: 12 pid: 6510 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071315.704735:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002ddb02d5 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1869685707509888:0@lo:104: 00000100:00100000:2.0:1783071315.704750:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707509760 00000100:00100000:2.0:1783071315.704759:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707509760 00000100:00100000:2.0:1783071315.704822:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783071315.704832:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004edf9324 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:feaa1501-b927-4e07-baad-3200e92d7497+3:6508:x1869685707509760:12345-0@lo:104: 00010000:00010000:2.0:1783071315.704845:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: 000000005c90fa58/0x6b58994c2cbdbba8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbbaf expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071315.704907:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783071315.704913:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004edf9324 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:feaa1501-b927-4e07-baad-3200e92d7497+3:6508:x1869685707509760:12345-0@lo:104: Request processed in 84us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071315.704920:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1783071315.704954:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1783071315.704957:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783071315.704962:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: 000000005c90fa58/0x6b58994c2cbdbba8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbbaf expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071315.704970:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005c90fa58 already unused, calling callback (0000000048d7fc16) 10000000:00010000:3.0:1783071315.704973:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: 000000005c90fa58/0x6b58994c2cbdbba8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6b58994c2cbdbbaf expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071315.704980:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: 000000005c90fa58/0x6b58994c2cbdbba8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6b58994c2cbdbbaf expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783071315.704987:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: 000000005c90fa58/0x6b58994c2cbdbba8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6b58994c2cbdbbaf expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071315.704992:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000006f817603/0x6b58994c2cbdbb23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6b58994c2cbdbb1c expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783071315.704994:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783071315.705007:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000006f817603/0x6b58994c2cbdbb23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6b58994c2cbdbb1c expref: 12 pid: 6510 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071315.705016:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007b2b7ba4 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1869685707510016:0@lo:104: 00010000:00010000:3.0:1783071315.705037:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: 000000005c90fa58/0x6b58994c2cbdbba8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbbaf expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071315.705046:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783071315.705051:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1783071315.705068:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set 00000000987284de going to sleep for 11 seconds 00010000:00010000:3.0:1783071315.705077:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: 000000005c90fa58/0x6b58994c2cbdbba8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbbaf expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071315.705085:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: 000000005c90fa58/0x6b58994c2cbdbba8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbbaf expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071315.705092:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000087318771 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1869685707509760:0@lo:104: 00000100:00100000:2.0:1783071315.705113:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707509888 00010000:00010000:3.0:1783071315.705116:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071315.705117:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071315.705119:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071315.705125:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707509888 00000100:00100000:3.0:1783071315.705133:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000060137f26 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:feaa1501-b927-4e07-baad-3200e92d7497:3646:1869685707510144:0@lo:103: 00000100:00100000:2.0:1783071315.705145:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707510016 00000100:00100000:2.0:1783071315.705150:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707510016 00000100:00100000:3.0:1783071315.705168:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071315.705178:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783071315.705186:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004d55dd68 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:feaa1501-b927-4e07-baad-3200e92d7497+4:6508:x1869685707509888:12345-0@lo:104: 00010000:00010000:2.0:1783071315.705195:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: 00000000a0753b5b/0x6b58994c2cbdbb38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbb3f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071315.705258:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783071315.705263:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004d55dd68 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:feaa1501-b927-4e07-baad-3200e92d7497+4:6508:x1869685707509888:12345-0@lo:104: Request processed in 79us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071315.705270:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1783071315.705278:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783071315.705283:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: 00000000a0753b5b/0x6b58994c2cbdbb38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbb3f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071315.705284:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002ddb02d5 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1869685707509888:0@lo:104: 00000100:00100000:2.0:1783071315.705290:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1783071315.705300:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a0753b5b already unused, calling callback (0000000048d7fc16) 00000100:00100000:2.0:1783071315.705300:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001b60568c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:feaa1501-b927-4e07-baad-3200e92d7497+3:6508:x1869685707510016:12345-0@lo:104: 10000000:00010000:3.0:1783071315.705304:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: 00000000a0753b5b/0x6b58994c2cbdbb38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6b58994c2cbdbb3f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071315.705311:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: 00000000a61119e6/0x6b58994c2cbdbb1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbb23 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071315.705313:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: 00000000a0753b5b/0x6b58994c2cbdbb38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6b58994c2cbdbb3f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783071315.705329:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: 00000000a0753b5b/0x6b58994c2cbdbb38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6b58994c2cbdbb3f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783071315.705335:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1783071315.705347:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707510144 00000100:00100000:1.0:1783071315.705353:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707510144 00010000:00010000:2.0:1783071315.705387:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1783071315.705393:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000007b735a56/0x6b58994c2cbdbbaf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbba8 expref: 13 pid: 6508 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071315.705394:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001b60568c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:feaa1501-b927-4e07-baad-3200e92d7497+3:6508:x1869685707510016:12345-0@lo:104: Request processed in 97us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071315.705402:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783071315.705428:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007b2b7ba4 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1869685707510016:0@lo:104: 00010000:00010000:2.0:1783071315.705448:0:6508:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000003b718b38/0x6b58994c2cbdbbee lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071315.705541:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783071315.705555:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000da356266 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:feaa1501-b927-4e07-baad-3200e92d7497+13:3646:x1869685707510144:12345-0@lo:103: 00010000:00010000:1.0:1783071315.705565:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071315.705570:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000007b735a56/0x6b58994c2cbdbbaf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbba8 expref: 13 pid: 6508 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071315.705580:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000007b735a56/0x6b58994c2cbdbbaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6b58994c2cbdbba8 expref: 13 pid: 6508 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071315.705591:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007b735a56/0x6b58994c2cbdbbaf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6b58994c2cbdbba8 expref: 13 pid: 6508 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071315.705603:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071315.705632:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000da356266 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:feaa1501-b927-4e07-baad-3200e92d7497+12:3646:x1869685707510144:12345-0@lo:103: Request processed in 79us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071315.705638:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1783071315.705875:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: 00000000a0753b5b/0x6b58994c2cbdbb38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbb3f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071315.705883:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783071315.705903:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: 00000000a0753b5b/0x6b58994c2cbdbb38 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbb3f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071315.705909:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: 00000000a0753b5b/0x6b58994c2cbdbb38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbb3f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071315.705929:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783071315.705932:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: 00000000a61119e6/0x6b58994c2cbdbb1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbb23 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071315.705938:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a61119e6 already unused, calling callback (0000000048d7fc16) 10000000:00010000:3.0:1783071315.705940:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: 00000000a61119e6/0x6b58994c2cbdbb1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6b58994c2cbdbb23 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071315.705946:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: 00000000a61119e6/0x6b58994c2cbdbb1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6b58994c2cbdbb23 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783071315.705951:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: 00000000a61119e6/0x6b58994c2cbdbb1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6b58994c2cbdbb23 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783071315.705956:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1783071315.706522:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000003a6dc92d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:feaa1501-b927-4e07-baad-3200e92d7497:3647:1869685707510272:0@lo:103: 00000100:00100000:1.0:1783071315.706560:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071315.706608:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707510272 00000100:00100000:2.0:1783071315.706615:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707510272 00010000:00010000:2.0:1783071315.706640:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000098db3fbf/0x6b58994c2cbdbb3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbb38 expref: 12 pid: 6510 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071315.706678:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783071315.706685:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007e2cb2b1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:feaa1501-b927-4e07-baad-3200e92d7497+12:3647:x1869685707510272:12345-0@lo:103: 00010000:00010000:2.0:1783071315.706696:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071315.706700:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000098db3fbf/0x6b58994c2cbdbb3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbb38 expref: 12 pid: 6510 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071315.706709:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000098db3fbf/0x6b58994c2cbdbb3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6b58994c2cbdbb38 expref: 12 pid: 6510 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071315.706721:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000098db3fbf/0x6b58994c2cbdbb3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6b58994c2cbdbb38 expref: 12 pid: 6510 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071315.706732:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071315.706765:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007e2cb2b1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:feaa1501-b927-4e07-baad-3200e92d7497+11:3647:x1869685707510272:12345-0@lo:103: Request processed in 82us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071315.706772:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783071315.706809:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000003a6dc92d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:feaa1501-b927-4e07-baad-3200e92d7497:3647:1869685707510272:0@lo:103: 00000100:00100000:2.0:1783071315.707663:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000060137f26 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:feaa1501-b927-4e07-baad-3200e92d7497:3646:1869685707510144:0@lo:103: 00010000:00010000:2.0:1783071315.707684:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071315.709055:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: 00000000a61119e6/0x6b58994c2cbdbb1c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbb23 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071315.709069:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783071315.709103:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: 00000000a61119e6/0x6b58994c2cbdbb1c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbb23 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071315.709112:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: 00000000a61119e6/0x6b58994c2cbdbb1c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbb23 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071315.709132:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071315.709134:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071315.709136:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071315.709151:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000068ed750 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:feaa1501-b927-4e07-baad-3200e92d7497:3648:1869685707510400:0@lo:103: 00000100:00100000:3.0:1783071315.709217:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071315.709284:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707510400 00000100:00100000:0.0:1783071315.709291:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707510400 00010000:00010000:0.0:1783071315.709314:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000006f817603/0x6b58994c2cbdbb23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbb1c expref: 11 pid: 6510 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071315.709404:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783071315.709412:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d4f9c2ba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:feaa1501-b927-4e07-baad-3200e92d7497+11:3648:x1869685707510400:12345-0@lo:103: 00010000:00010000:0.0:1783071315.709430:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071315.709435:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000006f817603/0x6b58994c2cbdbb23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbb1c expref: 11 pid: 6510 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071315.709445:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000006f817603/0x6b58994c2cbdbb23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6b58994c2cbdbb1c expref: 11 pid: 6510 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071315.709467:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006f817603/0x6b58994c2cbdbb23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6b58994c2cbdbb1c expref: 11 pid: 6510 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071315.709481:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000003b718b38/0x6b58994c2cbdbbee lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071315.709489:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003b718b38/0x6b58994c2cbdbbee lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071315.709503:0:6502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003b718b38/0x6b58994c2cbdbbee lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071315.709510:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003b718b38/0x6b58994c2cbdbbee lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071315.709516:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000003b718b38/0x6b58994c2cbdbbee lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071315.709522:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000003b718b38/0x6b58994c2cbdbbee lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071315.709527:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003b718b38 already unused, calling callback (000000006c37b471) 00010000:00010000:0.0:1783071315.709530:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000003b718b38/0x6b58994c2cbdbbee lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071315.709546:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000003b718b38/0x6b58994c2cbdbbee lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071315.709565:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000003b718b38/0x6b58994c2cbdbbee lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071315.709574:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783071315.709600:0:6508:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000003b718b38/0x6b58994c2cbdbbee lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071315.709611:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000003b718b38/0x6b58994c2cbdbbee lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071315.709616:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d4f9c2ba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:feaa1501-b927-4e07-baad-3200e92d7497+10:3648:x1869685707510400:12345-0@lo:103: Request processed in 204us (399us total) trans 0 rc 0/0 00010000:00010000:3.0:1783071315.709620:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003b718b38/0x6b58994c2cbdbbee lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071315.709631:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 20000000:01000000:3.0:1783071315.709644:0:6508:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1783071315.709676:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000068ed750 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:feaa1501-b927-4e07-baad-3200e92d7497:3648:1869685707510400:0@lo:103: 00000100:00100000:2.0:1783071315.714671:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008a35b272 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+9:7446:x1869685707509632:12345-0@lo:253: Request processed in 37105us (37475us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071315.714690:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783071315.714789:0:7446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000002cbf3a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:7446:1869685707509632:0@lo:253: 10000000:01000000:0.0:1783071315.714804:0:7446:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1783071315.714808:0:7446:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783071315.714810:0:7446:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1783071315.714811:0:7446:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783071315.714813:0:7446:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:0.0:1783071315.714814:0:7446:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783071315.714816:0:7446:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783071315.714817:0:7446:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783071315.714818:0:7446:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1783071315.714820:0:7446:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783071315.714820:0:7446:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1783071315.714839:0:7446:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000a46aaa3d from lustre-MDT0001 10000000:01000000:0.0:1783071315.714874:0:7446:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1783071315.714877:0:7446:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1783071315.714884:0:7446:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8f8b06c74d40 local copy 10000000:01000000:0.0:1783071315.714889:0:7446:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1783071315.714926:0:7446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: 00000000ec2968b3/0x6b58994c2cbdbbf5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071315.714937:0:7446:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.138@tcp lock: 00000000ec2968b3/0x6b58994c2cbdbbf5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071315.714961:0:7446:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: 00000000ec2968b3/0x6b58994c2cbdbbf5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071315.714981:0:7446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000002cbf3a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:7446:1869685707510528:0@lo:101: 00000100:00100000:0.0:1783071315.715021:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071315.715125:0:7446:0:(client.c:2701:ptlrpc_set_wait()) set 000000001a73da79 going to sleep for 11 seconds 00000100:00100000:3.0:1783071315.715235:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707510528 00000100:00100000:3.0:1783071315.715251:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707510528 00000100:00100000:3.0:1783071315.715345:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783071315.715354:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009cecc9cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+9:7446:x1869685707510528:12345-0@lo:101: 00010000:00010000:3.0:1783071315.715615:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071315.715629:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009b5876fa/0x6b58994c2cbdbbfc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdbbf5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071315.715651:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009b5876fa/0x6b58994c2cbdbbfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdbbf5 expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071315.715662:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009b5876fa/0x6b58994c2cbdbbfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbbf5 expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071315.715671:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009b5876fa, rc 0) 00000100:00100000:3.0:1783071315.715712:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009cecc9cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+10:7446:x1869685707510528:12345-0@lo:101: Request processed in 359us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071315.715728:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783071315.715791:0:7446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000002cbf3a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:7446:1869685707510528:0@lo:101: 00010000:00010000:0.0:1783071315.715803:0:7446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: 00000000ec2968b3/0x6b58994c2cbdbbf5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x6b58994c2cbdbbfc expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071315.715811:0:7446:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: 00000000ec2968b3/0x6b58994c2cbdbbf5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x6b58994c2cbdbbfc expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071315.715905:0:7446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000002cbf3a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:7446:1869685707510656:0@lo:501: 00000100:00100000:0.0:1783071315.715933:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071315.716120:0:7446:0:(client.c:2701:ptlrpc_set_wait()) set 000000001a73da79 going to sleep for 11 seconds 00000100:00100000:1.0:1783071315.716158:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707510656 00000100:00100000:1.0:1783071315.716164:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707510656 00000100:00100000:3.0:1783071315.716205:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783071315.716212:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000412fff8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+10:7446:x1869685707510656:12345-0@lo:501: 00000100:00100000:3.0:1783071315.716287:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000412fff8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+10:7446:x1869685707510656:12345-0@lo:501: Request processed in 76us (354us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783071315.716293:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783071315.716425:0:7446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000002cbf3a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:7446:1869685707510656:0@lo:501: 10000000:01000000:0.0:1783071315.716438:0:7446:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.138@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1783071315.716455:0:7446:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.138@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1783071315.716472:0:7446:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: 00000000ec2968b3/0x6b58994c2cbdbbf5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x6b58994c2cbdbbfc expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071315.716479:0:7446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: 00000000ec2968b3/0x6b58994c2cbdbbf5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x6b58994c2cbdbbfc expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071315.716485:0:7446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.138@tcp lock: 00000000ec2968b3/0x6b58994c2cbdbbf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x6b58994c2cbdbbfc expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071315.716515:0:7446:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1783071315.716539:0:7446:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f8b3447b000 10000000:01000000:0.0:1783071315.716544:0:7446:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1783071315.716548:0:7446:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8f8b06c74d40 10000000:01000000:0.0:1783071315.716550:0:7446:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1783071315.716553:0:7446:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8f8b06c74d40 from 1 10000000:01000000:0.0:1783071315.716556:0:7446:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1783071315.716573:0:7446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: 000000006f817603/0x6b58994c2cbdbc03 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071315.716581:0:7446:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: 000000006f817603/0x6b58994c2cbdbc03 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071315.716592:0:7446:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: 000000006f817603/0x6b58994c2cbdbc03 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071315.716605:0:7446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000002cbf3a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:7446:1869685707510784:0@lo:101: 00000100:00100000:0.0:1783071315.716634:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071315.716653:0:7446:0:(client.c:2701:ptlrpc_set_wait()) set 00000000987284de going to sleep for 11 seconds 00010000:00010000:2.0:1783071315.716775:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783071315.716781:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: 00000000ec2968b3/0x6b58994c2cbdbbf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x6b58994c2cbdbbfc expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071315.716788:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ec2968b3 already unused, calling callback (0000000048d7fc16) 10000000:00010000:2.0:1783071315.716800:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: 00000000ec2968b3/0x6b58994c2cbdbbf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x6b58994c2cbdbbfc expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071315.716807:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: 00000000ec2968b3/0x6b58994c2cbdbbf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x6b58994c2cbdbbfc expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783071315.716814:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: 00000000ec2968b3/0x6b58994c2cbdbbf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x6b58994c2cbdbbfc expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071315.716818:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783071315.716837:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: 00000000ec2968b3/0x6b58994c2cbdbbf5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x6b58994c2cbdbbfc expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071315.716843:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783071315.716869:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: 00000000ec2968b3/0x6b58994c2cbdbbf5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x6b58994c2cbdbbfc expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071315.716876:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: 00000000ec2968b3/0x6b58994c2cbdbbf5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x6b58994c2cbdbbfc expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071315.716890:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071315.716892:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071315.716893:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071315.716900:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783071315.716910:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002999954a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:feaa1501-b927-4e07-baad-3200e92d7497:3646:1869685707510912:0@lo:103: 00000100:00100000:2.0:1783071315.716941:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071315.716972:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707510912 00000100:00100000:2.0:1783071315.716976:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707510912 00000100:00100000:2.0:1783071315.717007:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783071315.717013:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cfdca438 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:feaa1501-b927-4e07-baad-3200e92d7497+10:3646:x1869685707510912:12345-0@lo:103: 00010000:00010000:2.0:1783071315.717023:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071315.717041:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009b5876fa/0x6b58994c2cbdbbfc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6b58994c2cbdbbf5 expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071315.717053:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071315.717082:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cfdca438 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:feaa1501-b927-4e07-baad-3200e92d7497+9:3646:x1869685707510912:12345-0@lo:103: Request processed in 69us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071315.717088:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783071315.717113:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002999954a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:feaa1501-b927-4e07-baad-3200e92d7497:3646:1869685707510912:0@lo:103: 00000100:00100000:2.0:1783071315.717134:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707510784 00000100:00100000:2.0:1783071315.717137:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707510784 00000100:00100000:2.0:1783071315.717154:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783071315.717159:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b5f0ee5d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+9:7446:x1869685707510784:12345-0@lo:101: 00010000:00010000:2.0:1783071315.717167:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071315.717175:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000098db3fbf/0x6b58994c2cbdbc0a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdbc03 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071315.717204:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000098db3fbf/0x6b58994c2cbdbc0a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdbc03 expref: 10 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071315.717212:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000098db3fbf/0x6b58994c2cbdbc0a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbc03 expref: 10 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071315.717219:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000098db3fbf, rc 0) 00000100:00100000:2.0:1783071315.717260:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b5f0ee5d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+10:7446:x1869685707510784:12345-0@lo:101: Request processed in 101us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071315.717266:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783071315.717358:0:7446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000002cbf3a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:7446:1869685707510784:0@lo:101: 00010000:00010000:0.0:1783071315.717397:0:7446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: 000000006f817603/0x6b58994c2cbdbc03 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbc0a expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071315.717404:0:7446:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: 000000006f817603/0x6b58994c2cbdbc03 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdbc0a expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783071315.717419:0:7446:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1783071315.717426:0:7446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: 000000006f817603/0x6b58994c2cbdbc03 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbc0a expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071315.717439:0:7446:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: 000000006f817603/0x6b58994c2cbdbc03 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbc0a expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783071315.717447:0:7446:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8f8b3447b000 10000000:01000000:0.0:1783071315.717451:0:7446:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1783071315.717454:0:7446:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff8f8b3447b000 from 1 10000000:01000000:0.0:1783071315.717594:0:7446:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1783071315.717611:0:7446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: 0000000070fe9d28/0x6b58994c2cbdbc11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071315.717618:0:7446:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: 0000000070fe9d28/0x6b58994c2cbdbc11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071315.717624:0:7446:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: 0000000070fe9d28/0x6b58994c2cbdbc11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071315.717636:0:7446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000002cbf3a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:7446:1869685707511040:0@lo:101: 00000100:00100000:0.0:1783071315.717665:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071315.717678:0:7446:0:(client.c:2701:ptlrpc_set_wait()) set 00000000987284de going to sleep for 11 seconds 00000100:00100000:2.0:1783071315.717771:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707511040 00000100:00100000:2.0:1783071315.717776:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707511040 00000100:00100000:2.0:1783071315.717795:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783071315.717807:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007491014b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+10:7446:x1869685707511040:12345-0@lo:101: 00010000:00010000:2.0:1783071315.717814:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071315.717821:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d0184ac3/0x6b58994c2cbdbc18 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdbc11 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071315.717835:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d0184ac3/0x6b58994c2cbdbc18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdbc11 expref: 11 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071315.717843:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d0184ac3/0x6b58994c2cbdbc18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbc11 expref: 11 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071315.717849:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d0184ac3, rc 0) 00000100:00100000:2.0:1783071315.717876:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007491014b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+11:7446:x1869685707511040:12345-0@lo:101: Request processed in 70us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071315.717882:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783071315.717960:0:7446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000002cbf3a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:7446:1869685707511040:0@lo:101: 00010000:00010000:0.0:1783071315.717969:0:7446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: 0000000070fe9d28/0x6b58994c2cbdbc11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbc18 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071315.717975:0:7446:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: 0000000070fe9d28/0x6b58994c2cbdbc11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdbc18 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783071315.717985:0:7446:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1783071315.717998:0:7446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: 0000000070fe9d28/0x6b58994c2cbdbc11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbc18 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071315.718011:0:7446:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: 0000000070fe9d28/0x6b58994c2cbdbc11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbc18 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783071315.718017:0:7446:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1783071315.718020:0:7446:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783071315.718024:0:7446:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8f8b3447b000 10000000:01000000:0.0:1783071315.718027:0:7446:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1783071315.718029:0:7446:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1783071315.718031:0:7446:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1783071315.718044:0:7446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: 00000000fd2ff347/0x6b58994c2cbdbc1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071315.718050:0:7446:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: 00000000fd2ff347/0x6b58994c2cbdbc1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071315.718057:0:7446:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: 00000000fd2ff347/0x6b58994c2cbdbc1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071315.718067:0:7446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000002cbf3a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:7446:1869685707511168:0@lo:101: 00000100:00100000:0.0:1783071315.718091:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071315.718109:0:7446:0:(client.c:2701:ptlrpc_set_wait()) set 00000000987284de going to sleep for 11 seconds 00000100:00100000:2.0:1783071315.718160:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707511168 00000100:00100000:2.0:1783071315.718164:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707511168 00000100:00100000:2.0:1783071315.718181:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783071315.718186:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d2594f45 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+11:7446:x1869685707511168:12345-0@lo:101: 00010000:00010000:2.0:1783071315.718192:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071315.718200:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a61119e6/0x6b58994c2cbdbc26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdbc1f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071315.718212:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a61119e6/0x6b58994c2cbdbc26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdbc1f expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071315.718219:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a61119e6/0x6b58994c2cbdbc26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbc1f expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071315.718225:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a61119e6, rc 0) 00000100:00100000:2.0:1783071315.718277:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d2594f45 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+12:7446:x1869685707511168:12345-0@lo:101: Request processed in 91us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071315.718282:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783071315.718356:0:7446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000002cbf3a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:7446:1869685707511168:0@lo:101: 00010000:00010000:0.0:1783071315.718391:0:7446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: 00000000fd2ff347/0x6b58994c2cbdbc1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbc26 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071315.718398:0:7446:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: 00000000fd2ff347/0x6b58994c2cbdbc1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdbc26 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071315.718645:0:7446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000002cbf3a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:7446:1869685707511296:0@lo:501: 00000100:00100000:0.0:1783071315.718671:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071315.718693:0:7446:0:(client.c:2701:ptlrpc_set_wait()) set 00000000987284de going to sleep for 11 seconds 00000100:00100000:2.0:1783071315.718743:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707511296 00000100:00100000:2.0:1783071315.718746:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707511296 00000100:00100000:2.0:1783071315.718764:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783071315.718769:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000008cab687 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+12:7446:x1869685707511296:12345-0@lo:501: 00000100:00100000:2.0:1783071315.718877:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000008cab687 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+12:7446:x1869685707511296:12345-0@lo:501: Request processed in 108us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071315.718885:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783071315.718949:0:7446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000002cbf3a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:7446:1869685707511296:0@lo:501: 00000100:00100000:0.0:1783071315.718974:0:7446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000002cbf3a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:7446:1869685707511424:0@lo:503: 00000100:00100000:0.0:1783071315.719010:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071315.719037:0:7446:0:(client.c:2701:ptlrpc_set_wait()) set 00000000987284de going to sleep for 11 seconds 00000100:00100000:2.0:1783071315.719084:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707511424 00000100:00100000:2.0:1783071315.719089:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707511424 00000100:00100000:2.0:1783071315.719106:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783071315.719111:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a9588a56 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+12:7446:x1869685707511424:12345-0@lo:503: 00000100:00100000:2.0:1783071315.719191:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a9588a56 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+12:7446:x1869685707511424:12345-0@lo:503: Request processed in 80us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071315.719198:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783071315.719278:0:7446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000002cbf3a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:7446:1869685707511424:0@lo:503: 00000040:00080000:0.0:1783071315.719862:0:7446:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783071315.719943:0:7446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000002cbf3a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:7446:1869685707511552:0@lo:502: 00000100:00100000:0.0:1783071315.719983:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071315.720044:0:7446:0:(client.c:2701:ptlrpc_set_wait()) set 00000000987284de going to sleep for 11 seconds 00000100:00100000:1.0:1783071315.720135:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707511552 00000100:00100000:1.0:1783071315.720140:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707511552 00000100:00100000:1.0:1783071315.720163:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783071315.720168:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000da785b66 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+12:7446:x1869685707511552:12345-0@lo:502: 00000100:00100000:1.0:1783071315.720263:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000da785b66 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+12:7446:x1869685707511552:12345-0@lo:502: Request processed in 95us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071315.720270:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783071315.720482:0:7446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000002cbf3a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:7446:1869685707511552:0@lo:502: 00000040:00080000:0.0:1783071315.720659:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1783071315.720685:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:0.0:1783071315.720696:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:0.0:1783071315.720708:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:0.0:1783071315.720718:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:0.0:1783071315.720730:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:0.0:1783071315.720742:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:0.0:1783071315.720752:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:0.0:1783071315.720763:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:0.0:1783071315.720774:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:0.0:1783071315.720786:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:0.0:1783071315.720798:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:0.0:1783071315.720822:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:0.0:1783071315.720843:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:0.0:1783071315.720854:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:0.0:1783071315.720864:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:0.0:1783071315.720876:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:0.0:1783071315.720888:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:0.0:1783071315.720900:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:0.0:1783071315.720912:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:0.0:1783071315.720924:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:0.0:1783071315.720935:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:0.0:1783071315.720946:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:0.0:1783071315.720966:0:7446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000002cbf3a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:7446:1869685707511680:0@lo:502: 00000100:00100000:0.0:1783071315.721002:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071315.721038:0:7446:0:(client.c:2701:ptlrpc_set_wait()) set 00000000987284de going to sleep for 11 seconds 00000100:00100000:1.0:1783071315.721168:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707511680 00000100:00100000:1.0:1783071315.721173:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707511680 00000100:00100000:1.0:1783071315.721209:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783071315.721222:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000094c17f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+12:7446:x1869685707511680:12345-0@lo:502: 00000100:00100000:1.0:1783071315.721312:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000094c17f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+12:7446:x1869685707511680:12345-0@lo:502: Request processed in 91us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071315.721320:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783071315.723282:0:7446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000002cbf3a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:7446:1869685707511680:0@lo:502: 00000040:00080000:0.0:1783071315.723403:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:0.0:1783071315.723418:0:7446:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:2.0:1783071315.724656:0:7458:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783071315.724682:0:7458:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071315.724684:0:7458:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1783071315.724690:0:7458:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1783071315.724694:0:7458:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783071315.724712:0:7458:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (0000000067fd0fb5) 00000020:00000080:2.0:1783071315.724737:0:7458:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:2.0:1783071315.724744:0:7458:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1783071315.724829:0:7458:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1783071315.724835:0:7458:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x6b58994c2cbdbc34 00000020:00000080:2.0:1783071315.725039:0:7458:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1783071315.725044:0:7458:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783071315.725052:0:7458:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071315.725054:0:7458:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1783071315.725057:0:7458:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783071315.725060:0:7458:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071315.725061:0:7458:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1783071315.725064:0:7458:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783071315.725071:0:7458:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (00000000f3e3f950) 00000020:00000080:2.0:1783071315.725082:0:7458:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:2.0:1783071315.725086:0:7458:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1783071315.725087:0:7458:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1783071315.725090:0:7458:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1783071315.725097:0:7458:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1783071315.725160:0:7458:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000a46aaa3d from lustre-MDT0001, refs=2 00000020:00000080:2.0:1783071315.725178:0:7458:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000726bca4f) 00000020:00000080:2.0:1783071315.725187:0:7458:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:2.0:1783071315.725265:0:7458:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1783071315.725271:0:7458:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x6b58994c2cbdbc49 00000020:00000080:2.0:1783071315.725357:0:7458:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1783071315.725556:0:7458:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1783071315.725564:0:7458:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x6b58994c2cbdbc50 00080000:01000000:2.0:1783071315.725570:0:7458:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:2.0:1783071315.725574:0:7458:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x6b58994c2cbdbc57 00080000:10000000:2.0:1783071315.725987:0:7458:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1783071315.726117:0:7458:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00000100:00100000:1.0:1783071315.778617:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000002cbf3a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869685707511808:0@lo:400: 00000100:00100000:1.0:1783071315.778697:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071315.778843:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707511808 00000100:00100000:0.0:1783071315.778851:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707511808 00000100:00100000:0.0:1783071315.778905:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783071315.778916:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008382c59d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869685707511808:12345-0@lo:400: 00000100:00100000:0.0:1783071315.778973:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008382c59d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869685707511808:12345-0@lo:400: Request processed in 59us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071315.778980:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1783071315.779020:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000002cbf3a8 x1869685707511808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071315.779034:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000002cbf3a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869685707511808:0@lo:400: 00010000:00010000:2.0:1783071315.837255:0:7458:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:2.0:1783071315.839067:0:7458:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:2.0:1783071315.841554:0:7458:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1783071315.841922:0:7458:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1783071315.860172:0:7458:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1783071315.860189:0:7458:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783071315.860201:0:7458:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783071315.860203:0:7458:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1783071315.860207:0:7458:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783071315.860213:0:7458:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783071315.860214:0:7458:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1783071315.860217:0:7458:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1783071315.860222:0:7458:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.138@tcp to nid 0x20000c0a8cc8a (192.168.204.138@tcp) 00000020:00000080:0.0:1783071315.860263:0:7458:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783071315.860288:0:7458:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (00000000eae94b1e) 00000020:00000080:0.0:1783071315.860313:0:7458:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1783071315.860320:0:7458:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1783071315.860549:0:7458:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1783071315.860555:0:7458:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:0.0:1783071315.860562:0:7458:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x6b58994c2cbdbc65 00010000:00080000:0.0:1783071315.860594:0:7458:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000cc762501@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.138@tcp at head 00010000:00010000:0.0:1783071315.863188:0:7458:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:3.0:1783071315.864874:0:7458:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1783071315.864886:0:7458:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1783071315.864919:0:7458:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1783071315.864944:0:7458:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x6b58994c2cbdbc6c 00000100:00080000:3.0:1783071315.864956:0:7458:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783071315.864960:0:7458:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 00000000cc762501 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:3.0:1783071315.864999:0:7458:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000068ed750 x1869685707511936/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783071315.865025:0:7458:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:3.0:1783071315.865075:0:7458:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783071315.865079:0:7458:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071315.865080:0:7458:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1783071315.865083:0:7458:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1783071315.865086:0:7458:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1783071315.865087:0:7458:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783071315.865089:0:7458:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783071315.865090:0:7458:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1783071315.865091:0:7458:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071315.865093:0:7458:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1783071315.865094:0:7458:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783071315.865099:0:7458:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071315.865100:0:7458:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1783071315.865103:0:7458:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1783071315.865137:0:7458:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1783071315.865149:0:7458:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783071315.865152:0:7458:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071315.865153:0:7458:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1783071315.865156:0:7458:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783071315.865158:0:7458:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071315.865159:0:7458:0:(obd_config.c:1561:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783071315.865161:0:7458:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783071315.865163:0:7458:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1783071315.865188:0:7458:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783071315.865190:0:7458:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071315.865191:0:7458:0:(obd_config.c:1561:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:3.0:1783071315.865194:0:7458:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000020:01000000:0.0:1783071315.865388:0:7446:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:0.0:1783071315.865418:0:7446:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1783071315.865436:0:7446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: 00000000fd2ff347/0x6b58994c2cbdbc1f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbc26 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071315.865457:0:7446:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: 00000000fd2ff347/0x6b58994c2cbdbc1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbc26 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783071315.865465:0:7446:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8f8b3447b000 from 1 10000000:01000000:0.0:1783071315.865468:0:7446:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783071315.865494:0:7446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: 00000000ec2968b3/0x6b58994c2cbdbc73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071315.865501:0:7446:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: 00000000ec2968b3/0x6b58994c2cbdbc73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071315.865524:0:7446:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: 00000000ec2968b3/0x6b58994c2cbdbc73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071315.865547:0:7446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000002cbf3a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:7446:1869685707512064:0@lo:101: 00000100:00100000:0.0:1783071315.865618:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071315.865669:0:7446:0:(client.c:2701:ptlrpc_set_wait()) set 00000000e5c5209f going to sleep for 11 seconds 00000100:00100000:0.0:1783071315.865695:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707512064 00000100:00100000:0.0:1783071315.865702:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707512064 00000100:00100000:0.0:1783071315.865742:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783071315.865751:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000069ba5307 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+12:7446:x1869685707512064:12345-0@lo:101: 00010000:00010000:0.0:1783071315.865766:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071315.865777:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003b718b38/0x6b58994c2cbdbc7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdbc73 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071315.865800:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003b718b38/0x6b58994c2cbdbc7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdbc73 expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071315.865809:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003b718b38/0x6b58994c2cbdbc7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbc73 expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071315.865817:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003b718b38, rc 0) 00000100:00100000:0.0:1783071315.865851:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000069ba5307 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+13:7446:x1869685707512064:12345-0@lo:101: Request processed in 101us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071315.865858:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783071315.865903:0:7446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000002cbf3a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:7446:1869685707512064:0@lo:101: 00010000:00010000:0.0:1783071315.865916:0:7446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: 00000000ec2968b3/0x6b58994c2cbdbc73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbc7a expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071315.865935:0:7446:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: 00000000ec2968b3/0x6b58994c2cbdbc73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdbc7a expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071315.867191:0:7446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000002cbf3a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:7446:1869685707512192:0@lo:256: 00000100:00100000:0.0:1783071315.867280:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071315.867310:0:7446:0:(client.c:2701:ptlrpc_set_wait()) set 00000000e5c5209f going to sleep for 11 seconds 00000100:00100000:2.0:1783071315.867545:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000068ed750 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1869685707511936:0@lo:38: 00000100:00100000:2.0:1783071315.867587:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071315.867749:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707512192 00000100:00100000:3.0:1783071315.867756:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707512192 00000100:00100000:3.0:1783071315.867795:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783071315.867802:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000003f451b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+13:7446:x1869685707512192:12345-0@lo:256: 20000000:01000000:3.0:1783071315.867826:0:6510:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1783071315.867850:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1783071315.867853:0:6510:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1783071315.867961:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000003f451b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+13:7446:x1869685707512192:12345-0@lo:256: Request processed in 159us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071315.867969:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783071315.868607:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707511936 00000100:00100000:0.0:1783071315.868614:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707511936 00000100:00100000:0.0:1783071315.868642:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783071315.868647:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002999954a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1869685707511936:12345-0@lo:38: 00010000:00080000:0.0:1783071315.868667:0:6522:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 217 last 0 00000020:00000080:0.0:1783071315.868700:0:6522:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x6b58994c2cbdbc81 00000004:00100000:0.0:1783071315.868715:0:6522:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1783071315.868721:0:6522:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1783071315.868814:0:7446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000002cbf3a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:7446:1869685707512192:0@lo:256: 10000000:01000000:0.0:1783071315.873721:0:7446:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783071315.873753:0:7446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: 00000000ec2968b3/0x6b58994c2cbdbc73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbc7a expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071315.873766:0:7446:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: 00000000ec2968b3/0x6b58994c2cbdbc73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbc7a expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783071315.873774:0:7446:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8f8b3447b000 from 1 10000000:01000000:0.0:1783071315.873777:0:7446:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783071315.873836:0:7446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: 00000000812f5ccb/0x6b58994c2cbdbc88 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071315.873854:0:7446:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: 00000000812f5ccb/0x6b58994c2cbdbc88 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071315.873865:0:7446:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: 00000000812f5ccb/0x6b58994c2cbdbc88 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071315.873888:0:7446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000002cbf3a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:7446:1869685707512320:0@lo:101: 00000100:00100000:0.0:1783071315.873955:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071315.874002:0:7446:0:(client.c:2701:ptlrpc_set_wait()) set 00000000e5c5209f going to sleep for 11 seconds 00000100:00100000:1.0:1783071315.874192:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707512320 00000100:00100000:1.0:1783071315.874200:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707512320 00000100:00100000:1.0:1783071315.874256:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783071315.874264:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001d4376e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+13:7446:x1869685707512320:12345-0@lo:101: 00010000:00010000:1.0:1783071315.874278:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071315.874291:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f5be14d8/0x6b58994c2cbdbc8f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdbc88 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071315.874313:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f5be14d8/0x6b58994c2cbdbc8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdbc88 expref: 14 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071315.874323:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f5be14d8/0x6b58994c2cbdbc8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbc88 expref: 14 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071315.874331:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f5be14d8, rc 0) 00000100:00100000:1.0:1783071315.874407:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001d4376e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+14:7446:x1869685707512320:12345-0@lo:101: Request processed in 144us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071315.874415:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783071315.875201:0:7446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000002cbf3a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:7446:1869685707512320:0@lo:101: 00010000:00010000:0.0:1783071315.875223:0:7446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: 00000000812f5ccb/0x6b58994c2cbdbc88 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbc8f expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071315.875232:0:7446:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: 00000000812f5ccb/0x6b58994c2cbdbc88 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdbc8f expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071315.875348:0:7446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000002cbf3a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:7446:1869685707512448:0@lo:501: 00000100:00100000:0.0:1783071315.875578:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071315.875661:0:7446:0:(client.c:2701:ptlrpc_set_wait()) set 00000000e5c5209f going to sleep for 11 seconds 00000100:00080000:1.0:1783071315.877628:0:6522:0:(import.c:65:import_set_state_nolock()) 000000002bfa3b6e : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783071315.877791:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002999954a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1869685707511936:12345-0@lo:38: Request processed in 9140us (10201us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071315.877807:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783071315.877966:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707512448 00000100:00100000:3.0:1783071315.877973:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707512448 00000100:00100000:3.0:1783071315.878017:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783071315.878024:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008bc90e46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+14:7446:x1869685707512448:12345-0@lo:501: 00000100:00100000:3.0:1783071315.878124:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008bc90e46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+14:7446:x1869685707512448:12345-0@lo:501: Request processed in 101us (2548us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071315.878131:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783071315.878226:0:7446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000002cbf3a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:7446:1869685707512448:0@lo:501: 00000100:00100000:0.0:1783071315.878286:0:7446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000002cbf3a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:7446:1869685707512576:0@lo:503: 00000100:00100000:0.0:1783071315.878341:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071315.878396:0:7446:0:(client.c:2701:ptlrpc_set_wait()) set 00000000e5c5209f going to sleep for 11 seconds 00000100:00100000:3.0:1783071315.878582:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707512576 00000100:00100000:3.0:1783071315.878587:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707512576 00000100:00100000:3.0:1783071315.878612:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783071315.878617:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006b4304d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+14:7446:x1869685707512576:12345-0@lo:503: 00000040:00080000:3.0:1783071315.878651:0:6510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783071315.878687:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006b4304d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+14:7446:x1869685707512576:12345-0@lo:503: Request processed in 69us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071315.878693:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783071315.878815:0:7446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000002cbf3a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:7446:1869685707512576:0@lo:503: 00000040:00080000:0.0:1783071315.879048:0:7446:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783071315.879112:0:7446:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:0.0:1783071315.879178:0:7446:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783071315.880162:0:7463:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:1.0:1783071315.880303:0:7446:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1783071315.880339:0:7446:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783071315.880436:0:7446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: 00000000812f5ccb/0x6b58994c2cbdbc88 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbc8f expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071315.880459:0:7446:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: 00000000812f5ccb/0x6b58994c2cbdbc88 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbc8f expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783071315.880508:0:7446:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1783071315.880511:0:7446:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f8b3447b000 10000000:01000000:1.0:1783071315.880514:0:7446:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f8b3447b000 10000000:01000000:1.0:1783071315.880518:0:7446:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783071315.880523:0:7446:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8f8b3447b000 from 1 10000000:01000000:1.0:1783071315.880525:0:7446:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783071315.880555:0:7446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: 000000005c90fa58/0x6b58994c2cbdbc96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071315.880561:0:7446:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: 000000005c90fa58/0x6b58994c2cbdbc96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071315.880569:0:7446:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: 000000005c90fa58/0x6b58994c2cbdbc96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071315.880584:0:7446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000b95721cb pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:7446:1869685707512704:0@lo:101: 00000100:00100000:1.0:1783071315.880639:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071315.880672:0:7446:0:(client.c:2701:ptlrpc_set_wait()) set 00000000b071fe28 going to sleep for 11 seconds 00000100:00100000:0.0:1783071315.880810:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707512704 00000100:00100000:0.0:1783071315.880816:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707512704 00000100:00100000:0.0:1783071315.880856:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783071315.880863:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000016ebd930 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+14:7446:x1869685707512704:12345-0@lo:101: 00010000:00010000:0.0:1783071315.880876:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071315.880887:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003226b68a/0x6b58994c2cbdbc9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdbc96 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071315.880909:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003226b68a/0x6b58994c2cbdbc9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdbc96 expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071315.880919:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003226b68a/0x6b58994c2cbdbc9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbc96 expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071315.880927:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003226b68a, rc 0) 00000100:00100000:0.0:1783071315.880964:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000016ebd930 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+15:7446:x1869685707512704:12345-0@lo:101: Request processed in 101us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071315.880970:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783071315.881196:0:3644:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783071315.881205:0:3644:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1783071315.881224:0:3644:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1783071315.881230:0:3644:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1783071315.881246:0:3644:0:(import.c:65:import_set_state_nolock()) 00000000cc762501 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783071315.881265:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000068ed750 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1869685707511936:0@lo:38: 00000100:00100000:1.0:1783071315.881354:0:7446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000b95721cb pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:7446:1869685707512704:0@lo:101: 00010000:00010000:1.0:1783071315.881582:0:7446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: 000000005c90fa58/0x6b58994c2cbdbc96 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbc9d expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071315.881602:0:7446:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: 000000005c90fa58/0x6b58994c2cbdbc96 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdbc9d expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071315.881964:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000002cbf3a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707512832:0@lo:41: 00000100:00100000:2.0:1783071315.882007:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071315.882089:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707512832 00000100:00100000:0.0:1783071315.882095:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707512832 00000100:00100000:0.0:1783071315.882133:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783071315.882140:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e797c365 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3647:x1869685707512832:12345-0@lo:41: 00000004:00000024:0.0:1783071315.882169:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1783071315.882210:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e797c365 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3647:x1869685707512832:12345-0@lo:41: Request processed in 70us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071315.882216:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783071315.882300:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000002cbf3a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707512832:0@lo:41: 00000100:00100000:0.0:1783071315.882517:0:7446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000008602a06a pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:7446:1869685707512960:0@lo:501: 00000100:00100000:0.0:1783071315.882546:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071315.882563:0:7446:0:(client.c:2701:ptlrpc_set_wait()) set 0000000021bd99ce going to sleep for 11 seconds 00000100:00100000:2.0:1783071315.882670:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707512960 00000100:00100000:2.0:1783071315.882674:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707512960 00000100:00100000:2.0:1783071315.882706:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783071315.882713:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000020c43079 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+15:7446:x1869685707512960:12345-0@lo:501: 00000100:00100000:2.0:1783071315.882815:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000020c43079 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+15:7446:x1869685707512960:12345-0@lo:501: Request processed in 103us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071315.882822:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783071315.882855:0:7446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000008602a06a pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:7446:1869685707512960:0@lo:501: 00000100:00100000:2.0:1783071315.882881:0:7446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000741c5f6a pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:7446:1869685707513088:0@lo:503: 00000100:00100000:2.0:1783071315.882919:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071315.882940:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707513088 00000100:00100000:2.0:1783071315.882944:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707513088 00000100:00100000:2.0:1783071315.882965:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783071315.882971:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fa8b74f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+15:7446:x1869685707513088:12345-0@lo:503: 00000100:00100000:2.0:1783071315.883040:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fa8b74f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+15:7446:x1869685707513088:12345-0@lo:503: Request processed in 69us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071315.883046:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783071315.883077:0:7446:0:(client.c:2701:ptlrpc_set_wait()) set 0000000089fc4379 going to sleep for 11 seconds 00000100:00100000:2.0:1783071315.883092:0:7446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000741c5f6a pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:7446:1869685707513088:0@lo:503: 00000040:00080000:2.0:1783071315.883423:0:7446:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783071315.883578:0:7446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000741c5f6a pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:7446:1869685707513216:0@lo:502: 00000100:00100000:2.0:1783071315.883620:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071315.883648:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707513216 00000100:00100000:2.0:1783071315.883652:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707513216 00000100:00100000:2.0:1783071315.883674:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783071315.883679:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006a8f81ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+15:7446:x1869685707513216:12345-0@lo:502: 00000100:00100000:2.0:1783071315.883753:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006a8f81ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+15:7446:x1869685707513216:12345-0@lo:502: Request processed in 73us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071315.883760:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783071315.883790:0:7446:0:(client.c:2701:ptlrpc_set_wait()) set 0000000089fc4379 going to sleep for 11 seconds 00000100:00100000:2.0:1783071315.883803:0:7446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000741c5f6a pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:7446:1869685707513216:0@lo:502: 00000040:00080000:2.0:1783071315.883969:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1783071315.883994:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1783071315.884007:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1783071315.884018:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1783071315.884030:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1783071315.884041:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1783071315.884058:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1783071315.884073:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1783071315.884088:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1783071315.884102:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1783071315.884115:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1783071315.884133:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1783071315.884150:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1783071315.884165:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1783071315.885310:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1783071315.885353:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1783071315.886245:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1783071315.886269:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1783071315.886288:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1783071315.886301:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1783071315.886315:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1783071315.886330:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1783071315.886344:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1783071315.886358:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1783071315.886402:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1783071315.886418:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1783071315.886430:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1783071315.886440:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:2.0:1783071315.886481:0:7446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000741c5f6a pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:7446:1869685707513344:0@lo:502: 00000100:00100000:2.0:1783071315.886564:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071315.886615:0:7446:0:(client.c:2701:ptlrpc_set_wait()) set 0000000089fc4379 going to sleep for 11 seconds 00000100:00100000:0.0:1783071315.887286:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707513344 00000100:00100000:0.0:1783071315.887295:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707513344 00000100:00100000:0.0:1783071315.887360:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783071315.887402:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ab948470 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+15:7446:x1869685707513344:12345-0@lo:502: 00000100:00100000:0.0:1783071315.887628:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ab948470 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+15:7446:x1869685707513344:12345-0@lo:502: Request processed in 228us (1064us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071315.887636:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783071315.887821:0:7446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000741c5f6a pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:7446:1869685707513344:0@lo:502: 00000040:00080000:2.0:1783071315.887900:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1783071315.887910:0:7446:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1783071315.890259:0:7464:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1783071315.890276:0:7464:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (000000003c9300f7) 00000020:00000080:0.0:1783071315.890298:0:7464:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1783071315.890489:0:7464:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000a46aaa3d from lustre-MDT0001, refs=3 00000020:01000004:0.0:1783071315.890493:0:7464:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000a46aaa3d from lustre-MDT0001, refs=3 00000020:01000004:0.0:1783071315.890495:0:7464:0:(obd_mount.c:701:lustre_put_lsi()) put 00000000a46aaa3d 3 00010000:00080000:0.0:1783071315.890521:0:7464:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000ef356347@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.138@tcp at head 00010000:00010000:0.0:1783071315.896628:0:7464:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:0.0:1783071315.896752:0:7464:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1783071315.896795:0:7464:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1783071315.896806:0:7464:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x6b58994c2cbdbcab 00000100:00080000:0.0:1783071315.896815:0:7464:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783071315.896820:0:7464:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 00000000ef356347 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:0.0:1783071315.896855:0:7464:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000037eb47ea x1869685707513472/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783071315.896879:0:7464:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1783071315.897091:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000037eb47ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1869685707513472:0@lo:38: 00000100:00100000:2.0:1783071315.897158:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071315.897184:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707513472 00000100:00100000:1.0:1783071315.897192:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707513472 00000100:00100000:1.0:1783071315.897251:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783071315.897259:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000741c5f6a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1869685707513472:12345-0@lo:38: 00010000:00080000:1.0:1783071315.897282:0:6516:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 217 last 0 00000020:00000080:1.0:1783071315.897313:0:6516:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x6b58994c2cbdbcb2 00000004:00100000:1.0:1783071315.897341:0:6516:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1783071315.897389:0:6516:0:(import.c:65:import_set_state_nolock()) 0000000067780f83 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783071315.897442:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000741c5f6a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1869685707513472:12345-0@lo:38: Request processed in 182us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071315.897526:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1783071315.898080:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000037eb47ea x1869685707513472/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783071325 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071315.898092:0:3644:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783071315.898100:0:3644:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1783071315.898107:0:3644:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1783071315.898111:0:3644:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1783071315.898114:0:3644:0:(import.c:65:import_set_state_nolock()) 00000000ef356347 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783071315.898118:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000037eb47ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1869685707513472:0@lo:38: 00000040:00080000:2.0:1783071315.898426:0:7464:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1783071315.898535:0:7446:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1783071315.898563:0:7446:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783071315.898579:0:7446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: 000000005c90fa58/0x6b58994c2cbdbc96 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbc9d expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071315.898589:0:7446:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: 000000005c90fa58/0x6b58994c2cbdbc96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbc9d expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783071315.898658:0:7446:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1783071315.898661:0:7446:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1783071315.898662:0:7446:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783071315.898663:0:7446:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783071315.898664:0:7446:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783071315.898665:0:7446:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783071315.898666:0:7446:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783071315.898668:0:7446:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783071315.898670:0:7446:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783071315.898671:0:7446:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783071315.898672:0:7446:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783071315.898676:0:7446:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:2.0:1783071315.898678:0:7446:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783071315.898679:0:7446:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1783071315.898680:0:7446:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783071315.898681:0:7446:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783071315.898682:0:7446:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783071315.898683:0:7446:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783071315.898684:0:7446:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783071315.898685:0:7446:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783071315.898686:0:7446:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783071315.898686:0:7446:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783071315.898687:0:7446:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783071315.898706:0:7446:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1783071315.898719:0:7446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e1dc44b5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:7446:1869685707513600:0@lo:253: 00000100:00100000:2.0:1783071315.898767:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071315.898804:0:7446:0:(client.c:2701:ptlrpc_set_wait()) set 00000000530012c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783071315.898868:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707513600 00000100:00100000:0.0:1783071315.898874:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707513600 00000100:00100000:0.0:1783071315.898920:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783071315.898928:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000078716ec1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+15:7446:x1869685707513600:12345-0@lo:253: 20000000:01000000:0.0:1783071315.899081:0:6510:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1783071315.899096:0:6510:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 40000000:00080000:1.0:1783071315.901161:0:7466:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000001:00100000:0.0:1783071315.902525:0:6495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1783071315.903500:0:6510:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783071315.903517:0:6510:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1783071315.903597:0:6533:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783071315.903602:0:6533:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783071315.903620:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000004d6ce9d3/0x6b58994c2cbdbcb9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071315.903640:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000032edb8b4/0x6b58994c2cbdbbd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbbd2 expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071315.903648:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000003b718b38/0x6b58994c2cbdbc7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbc73 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071315.903657:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000004d6ce9d3/0x6b58994c2cbdbcb9 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071315.903697:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000003b718b38/0x6b58994c2cbdbc7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6b58994c2cbdbc73 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071315.903710:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000003b718b38/0x6b58994c2cbdbc7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6b58994c2cbdbc73 expref: 15 pid: 6511 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071315.903725:0:6533:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000096ccbd9e pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1869685707513728:0@lo:104: 00000100:00100000:0.0:1783071315.903784:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783071315.903833:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000032edb8b4/0x6b58994c2cbdbbd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6b58994c2cbdbbd2 expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071315.903842:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000032edb8b4/0x6b58994c2cbdbbd9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6b58994c2cbdbbd2 expref: 15 pid: 6508 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071315.903857:0:6533:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000003e6482d5 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1869685707513856:0@lo:104: 00000100:00100000:0.0:1783071315.903880:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071315.903898:0:6533:0:(client.c:2701:ptlrpc_set_wait()) set 00000000701ff851 going to sleep for 11 seconds 00000100:00100000:2.0:1783071315.904035:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707513728 00000100:00100000:2.0:1783071315.904112:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707513728 00000100:00100000:2.0:1783071315.904152:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707513856 00000100:00100000:2.0:1783071315.904156:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707513856 00000100:00100000:2.0:1783071315.904169:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783071315.904176:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c1232120 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:feaa1501-b927-4e07-baad-3200e92d7497+4:6533:x1869685707513728:12345-0@lo:104: 00010000:00010000:2.0:1783071315.904187:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: 00000000ec2968b3/0x6b58994c2cbdbc73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbc7a expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071315.904324:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783071315.904330:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c1232120 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:feaa1501-b927-4e07-baad-3200e92d7497+4:6533:x1869685707513728:12345-0@lo:104: Request processed in 154us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071315.904337:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783071315.904355:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783071315.904360:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006b4a358b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:feaa1501-b927-4e07-baad-3200e92d7497+3:6533:x1869685707513856:12345-0@lo:104: 00010000:00010000:2.0:1783071315.904389:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: 00000000a82f37a0/0x6b58994c2cbdbbd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbbd9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071315.904432:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783071315.904437:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006b4a358b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:feaa1501-b927-4e07-baad-3200e92d7497+3:6533:x1869685707513856:12345-0@lo:104: Request processed in 78us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071315.904444:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1783071315.904464:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783071315.904470:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: 00000000ec2968b3/0x6b58994c2cbdbc73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbc7a expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071315.904477:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ec2968b3 already unused, calling callback (0000000048d7fc16) 10000000:00010000:2.0:1783071315.904499:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: 00000000ec2968b3/0x6b58994c2cbdbc73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6b58994c2cbdbc7a expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071315.904508:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: 00000000ec2968b3/0x6b58994c2cbdbc73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6b58994c2cbdbc7a expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783071315.904514:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: 00000000ec2968b3/0x6b58994c2cbdbc73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6b58994c2cbdbc7a expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071315.904519:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783071315.904546:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: 00000000ec2968b3/0x6b58994c2cbdbc73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbc7a expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071315.904553:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783071315.904569:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: 00000000ec2968b3/0x6b58994c2cbdbc73 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbc7a expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071315.904576:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: 00000000ec2968b3/0x6b58994c2cbdbc73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbc7a expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071315.904587:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783071315.904589:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: 00000000a82f37a0/0x6b58994c2cbdbbd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbbd9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071315.904595:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a82f37a0 already unused, calling callback (0000000048d7fc16) 10000000:00010000:2.0:1783071315.904597:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: 00000000a82f37a0/0x6b58994c2cbdbbd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6b58994c2cbdbbd9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071315.904602:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: 00000000a82f37a0/0x6b58994c2cbdbbd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6b58994c2cbdbbd9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783071315.904620:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: 00000000a82f37a0/0x6b58994c2cbdbbd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6b58994c2cbdbbd9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071315.904625:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783071315.904639:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: 00000000a82f37a0/0x6b58994c2cbdbbd2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbbd9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071315.904644:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783071315.904659:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: 00000000a82f37a0/0x6b58994c2cbdbbd2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbbd9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071315.904665:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: 00000000a82f37a0/0x6b58994c2cbdbbd2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbbd9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071315.904679:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071315.904680:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071315.904681:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071315.904692:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d5568d3e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:feaa1501-b927-4e07-baad-3200e92d7497:3648:1869685707513984:0@lo:103: 00000100:00100000:2.0:1783071315.904721:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071315.904756:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000000e6b341b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:feaa1501-b927-4e07-baad-3200e92d7497:3645:1869685707514112:0@lo:103: 00000100:00100000:2.0:1783071315.904781:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071315.904833:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707513984 00000100:00100000:2.0:1783071315.904837:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707513984 00010000:00010000:2.0:1783071315.904852:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000003b718b38/0x6b58994c2cbdbc7a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbc73 expref: 16 pid: 6511 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071315.904871:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707514112 00000100:00100000:2.0:1783071315.904873:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707514112 00010000:00010000:2.0:1783071315.904881:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000032edb8b4/0x6b58994c2cbdbbd9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbbd2 expref: 17 pid: 6508 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071315.904902:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783071315.904907:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000065534fbb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:feaa1501-b927-4e07-baad-3200e92d7497+17:3648:x1869685707513984:12345-0@lo:103: 00010000:00010000:2.0:1783071315.904931:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071315.904935:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000003b718b38/0x6b58994c2cbdbc7a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbc73 expref: 17 pid: 6511 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071315.904944:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000003b718b38/0x6b58994c2cbdbc7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6b58994c2cbdbc73 expref: 17 pid: 6511 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071315.904959:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783071315.904982:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071315.904990:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000065534fbb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:feaa1501-b927-4e07-baad-3200e92d7497+17:3648:x1869685707513984:12345-0@lo:103: Request processed in 82us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071315.904997:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783071315.905010:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783071315.905014:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a737a9d3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:feaa1501-b927-4e07-baad-3200e92d7497+16:3645:x1869685707514112:12345-0@lo:103: 00010000:00010000:2.0:1783071315.905021:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071315.905024:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000032edb8b4/0x6b58994c2cbdbbd9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbbd2 expref: 16 pid: 6508 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071315.905031:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000032edb8b4/0x6b58994c2cbdbbd9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6b58994c2cbdbbd2 expref: 16 pid: 6508 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071315.905041:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000004d6ce9d3/0x6b58994c2cbdbcb9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071315.905060:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004d6ce9d3/0x6b58994c2cbdbcb9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783071315.905081:0:6502:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004362953s 00010000:00010000:2.0:1783071315.905084:0:6502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004d6ce9d3/0x6b58994c2cbdbcb9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071315.905090:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004d6ce9d3/0x6b58994c2cbdbcb9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071315.905095:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000004d6ce9d3/0x6b58994c2cbdbcb9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071315.905100:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000004d6ce9d3/0x6b58994c2cbdbcb9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071315.905105:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004d6ce9d3 already unused, calling callback (000000006c37b471) 00010000:00010000:2.0:1783071315.905108:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000004d6ce9d3/0x6b58994c2cbdbcb9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071315.905114:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000004d6ce9d3/0x6b58994c2cbdbcb9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071315.905121:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000004d6ce9d3/0x6b58994c2cbdbcb9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071315.905129:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071315.905165:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a737a9d3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:feaa1501-b927-4e07-baad-3200e92d7497+16:3645:x1869685707514112:12345-0@lo:103: Request processed in 150us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071315.905171:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783071315.905255:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d5568d3e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:feaa1501-b927-4e07-baad-3200e92d7497:3648:1869685707513984:0@lo:103: 00000100:00100000:2.0:1783071315.905308:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000078716ec1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+15:7446:x1869685707513600:12345-0@lo:253: Request processed in 6383us (6543us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071315.905322:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783071315.905590:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000000e6b341b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:feaa1501-b927-4e07-baad-3200e92d7497:3645:1869685707514112:0@lo:103: 00000100:00100000:2.0:1783071315.905684:0:7446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e1dc44b5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:7446:1869685707513600:0@lo:253: 10000000:01000000:2.0:1783071315.905695:0:7446:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1783071315.905698:0:7446:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783071315.905700:0:7446:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1783071315.905702:0:7446:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783071315.905703:0:7446:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783071315.905704:0:7446:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783071315.905705:0:7446:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783071315.905706:0:7446:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783071315.905707:0:7446:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783071315.905709:0:7446:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783071315.905710:0:7446:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783071315.905711:0:7446:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1783071315.905722:0:7446:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1783071315.906551:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003b718b38/0x6b58994c2cbdbc7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6b58994c2cbdbc73 expref: 14 pid: 6511 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071315.906567:0:6533:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000096ccbd9e pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1869685707513728:0@lo:104: 00010000:00010000:0.0:1783071315.906579:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000032edb8b4/0x6b58994c2cbdbbd9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6b58994c2cbdbbd2 expref: 13 pid: 6508 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071315.906590:0:6533:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000003e6482d5 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1869685707513856:0@lo:104: 00010000:00010000:0.0:1783071315.906606:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000004d6ce9d3/0x6b58994c2cbdbcb9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071315.906614:0:6533:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000004d6ce9d3/0x6b58994c2cbdbcb9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071315.906619:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000004d6ce9d3/0x6b58994c2cbdbcb9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071315.906624:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004d6ce9d3/0x6b58994c2cbdbcb9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1783071315.912957:0:7446:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:2.0:1783071315.913256:0:7446:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1783071315.914178:0:7446:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1783071315.915260:0:7446:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1783071315.917632:0:7446:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1783071315.917864:0:7446:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1783071315.920769:0:7446:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1783071315.921144:0:7446:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1783071315.921449:0:7446:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:2.0:1783071315.921607:0:7446:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1783071315.921777:0:7446:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:2.0:1783071315.922019:0:7446:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:3.0:1783071315.924964:0:7446:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:0.0:1783071315.924971:0:7469:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1783071315.924977:0:7469:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1783071315.926318:0:7470:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:3.0:1783071315.926420:0:7470:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000081cdc0de pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7470:1869685707514240:0@lo:700: 00000100:00100000:3.0:1783071315.926495:0:7470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071315.926553:0:7470:0:(client.c:2701:ptlrpc_set_wait()) set 000000007e6ae11a going to sleep for 11 seconds 00000100:00100000:0.0:1783071315.926570:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707514240 00000100:00100000:0.0:1783071315.926578:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707514240 00000040:01000000:2.0:1783071315.926626:0:7446:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:0.0:1783071315.926643:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783071315.926660:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f721b947 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7470:x1869685707514240:12345-0@lo:700: 00000100:00100000:1.0:1783071315.927485:0:7471:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000b95721cb pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7471:1869685707514368:0@lo:1000: 00000100:00100000:1.0:1783071315.927539:0:7471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071315.927623:0:7471:0:(client.c:2701:ptlrpc_set_wait()) set 00000000edf477e8 going to sleep for 11 seconds 00000040:01000000:2.0:1783071315.929177:0:7446:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1783071315.929567:0:7446:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1783071315.930278:0:7446:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1783071315.930361:0:7446:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1783071315.930658:0:7446:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783071315.932551:0:7446:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1783071315.933552:0:7446:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1783071315.933619:0:7446:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1783071315.933998:0:7446:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783071315.934135:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707514368 00000100:00100000:0.0:1783071315.934145:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707514368 00000100:00100000:0.0:1783071315.934209:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00080000:10000000:2.0:1783071315.934216:0:7446:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000100:00100000:0.0:1783071315.934217:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006bb66986 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7471:x1869685707514368:12345-0@lo:1000: 00000100:00100000:0.0:1783071315.934419:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006bb66986 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7471:x1869685707514368:12345-0@lo:1000: Request processed in 202us (6880us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071315.934427:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783071315.935892:0:7471:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000b95721cb pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7471:1869685707514368:0@lo:1000: 00000040:01000000:1.0:1783071315.935936:0:7471:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:1.0:1783071315.935976:0:7471:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000b95721cb pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7471:1869685707514496:0@lo:700: 00000100:00100000:1.0:1783071315.936028:0:7471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071315.936071:0:7471:0:(client.c:2701:ptlrpc_set_wait()) set 00000000eea1e13b going to sleep for 11 seconds 00000100:00100000:2.0:1783071315.936160:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707514496 00000100:00100000:2.0:1783071315.936166:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707514496 00000100:00100000:2.0:1783071315.936207:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783071315.936213:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000068dbc3c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7471:x1869685707514496:12345-0@lo:700: 00000100:00100000:2.0:1783071315.936294:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000068dbc3c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7471:x1869685707514496:12345-0@lo:700: Request processed in 81us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071315.936301:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783071315.936421:0:7471:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000b95721cb pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7471:1869685707514496:0@lo:700: 00000100:00100000:0.0:1783071315.936479:0:7471:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000003e6482d5 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7471:1869685707514624:0@lo:900: 00000100:00100000:0.0:1783071315.936509:0:7471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071315.936536:0:7471:0:(client.c:2701:ptlrpc_set_wait()) set 0000000064a0d34a going to sleep for 11 seconds 00000100:00100000:2.0:1783071315.936579:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707514624 00000100:00100000:2.0:1783071315.936584:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707514624 00000100:00100000:2.0:1783071315.936607:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783071315.936612:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000096ccbd9e pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7471:x1869685707514624:12345-0@lo:900: 00000100:00100000:2.0:1783071315.936652:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000096ccbd9e pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7471:x1869685707514624:12345-0@lo:900: Request processed in 40us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071315.936659:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1783071315.936684:0:7471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000003e6482d5 x1869685707514624/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783071331 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071315.936694:0:7471:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000003e6482d5 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7471:1869685707514624:0@lo:900: 00000100:00100000:2.0:1783071315.936795:0:7471:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e1dc44b5 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7471:1869685707514752:0@lo:1000: 00000100:00100000:2.0:1783071315.936836:0:7471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071315.936865:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707514752 00000100:00100000:2.0:1783071315.936869:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707514752 00000100:00100000:2.0:1783071315.936895:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783071315.936901:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d5568d3e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7471:x1869685707514752:12345-0@lo:1000: 00000100:00100000:2.0:1783071315.936967:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d5568d3e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7471:x1869685707514752:12345-0@lo:1000: Request processed in 65us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071315.936974:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783071315.936992:0:7471:0:(client.c:2701:ptlrpc_set_wait()) set 000000008b0b4a9d going to sleep for 11 seconds 00000100:00100000:2.0:1783071315.937004:0:7471:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e1dc44b5 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7471:1869685707514752:0@lo:1000: 00000004:00080000:2.0:1783071315.937045:0:7471:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000006a4d10db with version 0 00000020:00100000:2.0:1783071315.937059:0:7471:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1783071315.937064:0:7471:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000e1dc44b5 x1869685707515008/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783071315.937076:0:7471:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e1dc44b5 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7471:1869685707515008:0@lo:1000: 00000100:00100000:2.0:1783071315.937098:0:7471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071315.937116:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707515008 00000100:00100000:2.0:1783071315.937119:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707515008 00000100:00100000:2.0:1783071315.937138:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783071315.937143:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cfdca438 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7471:x1869685707515008:12345-0@lo:1000: 00000100:00100000:2.0:1783071315.937525:0:7471:0:(client.c:2701:ptlrpc_set_wait()) set 00000000c9cdee9c going to sleep for 11 seconds 00100000:10000000:2.0:1783071315.938844:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1783071315.939015:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1783071315.939155:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1783071315.939684:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1783071315.940686:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 40000000:02000000:1.0:1783071315.942559:0:6524:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00100000:10000000:2.0:1783071315.944496:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1783071315.944842:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1783071315.944996:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1783071315.945169:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1783071315.945352:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1783071315.945529:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1783071315.945679:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1783071315.945835:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1783071315.946016:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1783071315.946988:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1783071315.947135:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1783071315.947798:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1783071315.947935:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1783071315.948095:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1783071315.949055:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00000001:00080000:3.0:1783071315.949704:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:3.0:1783071315.949801:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cfdca438 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7471:x1869685707515008:12345-0@lo:1000: Request processed in 12654us (12699us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1783071315.949819:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00100000:10000000:2.0:1783071315.950038:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00000100:00100000:1.0:1783071315.950123:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f721b947 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7470:x1869685707514240:12345-0@lo:700: Request processed in 23465us (23627us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071315.950144:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00100000:10000000:2.0:1783071315.950233:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00010000:00080000:3.0:1783071315.950383:0:7470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000081cdc0de x1869685707514240/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1783071331 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071315.950399:0:7470:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000081cdc0de pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7470:1869685707514240:0@lo:700: 40000000:02000000:3.0:1783071315.950411:0:7470:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000004:00080000:1.0:1783071315.950441:0:7471:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1783071315.950445:0:7471:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1783071315.950457:0:7471:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e1dc44b5 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7471:1869685707515008:0@lo:1000: 00000100:00100000:1.0:1783071315.950541:0:7471:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000006bac2b66 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7471:1869685707515136:0@lo:1000: 00000100:00100000:1.0:1783071315.950580:0:7471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071315.950610:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707515136 00000100:00100000:1.0:1783071315.950615:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707515136 00000100:00100000:1.0:1783071315.950653:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783071315.950661:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fb89b5ab pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7471:x1869685707515136:12345-0@lo:1000: 00000100:00100000:1.0:1783071315.950737:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fb89b5ab pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7471:x1869685707515136:12345-0@lo:1000: Request processed in 77us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071315.950743:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783071315.950920:0:7471:0:(client.c:2701:ptlrpc_set_wait()) set 000000007637b524 going to sleep for 11 seconds 00000100:00100000:1.0:1783071315.950937:0:7471:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000006bac2b66 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7471:1869685707515136:0@lo:1000: 00000040:00080000:1.0:1783071315.950959:0:7471:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1783071315.950986:0:7471:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000edf477e8 with version 1 00100000:10000000:2.0:1783071315.950998:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1783071315.951229:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1783071315.951484:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00000004:00080000:0.0:1783071315.951661:0:7461:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000987284de version 1 rpc_version 1 00000020:00100000:0.0:1783071315.951684:0:7461:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1783071315.951690:0:7461:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000011981ac7 x1869685707515392/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783071315.951704:0:7461:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000011981ac7 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7461:1869685707515392:0@lo:1000: 00000100:00100000:0.0:1783071315.951759:0:7461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071315.951792:0:7461:0:(client.c:2701:ptlrpc_set_wait()) set 0000000095be2d04 going to sleep for 11 seconds 00100000:10000000:2.0:1783071315.951842:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1783071315.952003:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1783071315.952184:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1783071315.952994:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1783071315.953107:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1783071315.953306:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1783071315.953488:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1783071315.953794:0:7446:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1783071315.958065:0:7471:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1783071315.958151:0:7471:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000100:00100000:1.0:1783071315.958191:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707515392 00000100:00100000:1.0:1783071315.958200:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707515392 00000001:00080000:2.0:1783071315.958912:0:7446:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1783071315.958951:0:7446:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffff9cbcc1c53988 00100000:10000000:2.0:1783071315.958959:0:7446:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1783071315.960660:0:7446:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783071315.960694:0:7446:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.138@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783071315.960714:0:7446:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1783071315.960733:0:7446:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1783071315.963724:0:7446:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783071315.966766:0:7446:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:1.0:1783071315.968514:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783071315.968533:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003e6482d5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7461:x1869685707515392:12345-0@lo:1000: 00000001:00080000:1.0:1783071315.983802:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:2.0:1783071315.984284:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003e6482d5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7461:x1869685707515392:12345-0@lo:1000: Request processed in 15753us (32520us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1783071315.984298:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:1.0:1783071315.985172:0:7461:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1783071315.985179:0:7461:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1783071315.985210:0:7461:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000011981ac7 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7461:1869685707515392:0@lo:1000: 00000040:00080000:2.0:1783071315.994123:0:7470:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783071315.998573:0:7470:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1783071315.998649:0:7470:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1783071315.998653:0:7470:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:2.0:1783071316.226487:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1783071316.998336:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783071316.998345:0:6513:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8f8b3447b000 from 4 10000000:01000000:2.0:1783071316.998350:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783071316.998416:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: 00000000a0753b5b/0x6b58994c2cbdbcc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071316.998428:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: 00000000a0753b5b/0x6b58994c2cbdbcc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071316.998438:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: 00000000a0753b5b/0x6b58994c2cbdbcc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071316.998459:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000065534fbb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707515520:0@lo:101: 00000100:00100000:2.0:1783071316.998531:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071316.998600:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set 0000000035023710 going to sleep for 11 seconds 00000100:00100000:3.0:1783071317.002014:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707515520 00000100:00100000:3.0:1783071317.002040:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707515520 00000100:00100000:3.0:1783071317.002116:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783071317.002127:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d62c21bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+13:6513:x1869685707515520:12345-0@lo:101: 00010000:00010000:3.0:1783071317.002146:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071317.002166:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d2e4442e/0x6b58994c2cbdbcc7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdbcc0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071317.002192:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d2e4442e/0x6b58994c2cbdbcc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdbcc0 expref: 14 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071317.002202:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d2e4442e/0x6b58994c2cbdbcc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbcc0 expref: 14 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071317.002212:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d2e4442e, rc 0) 00000100:00100000:3.0:1783071317.002305:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d62c21bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+14:6513:x1869685707515520:12345-0@lo:101: Request processed in 181us (3773us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071317.002313:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783071317.002389:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000065534fbb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707515520:0@lo:101: 00010000:00010000:2.0:1783071317.002410:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: 00000000a0753b5b/0x6b58994c2cbdbcc0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbcc7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.002421:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: 00000000a0753b5b/0x6b58994c2cbdbcc0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdbcc7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071317.002482:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000065534fbb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707515648:0@lo:256: 00000100:00100000:2.0:1783071317.002523:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071317.002573:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set 0000000035023710 going to sleep for 11 seconds 00000100:00100000:3.0:1783071317.002747:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707515648 00000100:00100000:3.0:1783071317.002752:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707515648 00000100:00100000:3.0:1783071317.002785:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1783071317.002792:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005aec61f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+14:6513:x1869685707515648:12345-0@lo:256: 20000000:01000000:3.0:1783071317.002806:0:6510:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783071317.002822:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783071317.002825:0:6510:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1783071317.003043:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005aec61f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+14:6513:x1869685707515648:12345-0@lo:256: Request processed in 250us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071317.003050:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783071317.003651:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000065534fbb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707515648:0@lo:256: 10000000:01000000:2.0:1783071317.003701:0:6513:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783071317.003709:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: 00000000a0753b5b/0x6b58994c2cbdbcc0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbcc7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.003718:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: 00000000a0753b5b/0x6b58994c2cbdbcc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbcc7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071317.003728:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783071317.003730:0:6513:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8f8b10f7e000 from 21 10000000:01000000:2.0:1783071317.003732:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783071317.003766:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: 00000000a82f37a0/0x6b58994c2cbdbcce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.003773:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: 00000000a82f37a0/0x6b58994c2cbdbcce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.003781:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: 00000000a82f37a0/0x6b58994c2cbdbcce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071317.003806:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000065534fbb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707515776:0@lo:101: 00000100:00100000:2.0:1783071317.003839:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071317.003875:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set 0000000035023710 going to sleep for 11 seconds 00000100:00100000:3.0:1783071317.003956:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707515776 00000100:00100000:3.0:1783071317.003962:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707515776 00000100:00100000:3.0:1783071317.004009:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783071317.004018:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cd367d22 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+14:6513:x1869685707515776:12345-0@lo:101: 00010000:00010000:3.0:1783071317.004029:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071317.004038:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e051f275/0x6b58994c2cbdbcd5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdbcce expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071317.004059:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e051f275/0x6b58994c2cbdbcd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdbcce expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071317.004068:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e051f275/0x6b58994c2cbdbcd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbcce expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071317.004076:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e051f275, rc 0) 00000100:00100000:3.0:1783071317.004112:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cd367d22 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+15:6513:x1869685707515776:12345-0@lo:101: Request processed in 95us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071317.004118:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783071317.006311:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000065534fbb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707515776:0@lo:101: 00010000:00010000:2.0:1783071317.006339:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: 00000000a82f37a0/0x6b58994c2cbdbcce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbcd5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.006351:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: 00000000a82f37a0/0x6b58994c2cbdbcce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdbcd5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071317.006435:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000065534fbb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707515904:0@lo:501: 00000100:00100000:2.0:1783071317.006486:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071317.006526:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set 0000000035023710 going to sleep for 11 seconds 00000100:00100000:3.0:1783071317.006982:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707515904 00000100:00100000:3.0:1783071317.006990:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707515904 00000100:00100000:3.0:1783071317.007042:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783071317.007050:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000043b57b93 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+15:6513:x1869685707515904:12345-0@lo:501: 00000100:00100000:3.0:1783071317.007194:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000043b57b93 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+15:6513:x1869685707515904:12345-0@lo:501: Request processed in 145us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071317.007202:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783071317.007262:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000065534fbb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707515904:0@lo:501: 00000100:00100000:1.0:1783071317.007295:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000006bac2b66 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707516032:0@lo:503: 00000100:00100000:1.0:1783071317.007335:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071317.007385:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set 000000007a519be4 going to sleep for 11 seconds 00000100:00100000:3.0:1783071317.007655:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707516032 00000100:00100000:3.0:1783071317.007661:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707516032 00000100:00100000:3.0:1783071317.007695:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783071317.007702:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ef332430 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+15:6513:x1869685707516032:12345-0@lo:503: 00000100:00100000:3.0:1783071317.007793:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ef332430 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+15:6513:x1869685707516032:12345-0@lo:503: Request processed in 92us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071317.007806:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783071317.007843:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000006bac2b66 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707516032:0@lo:503: 00000100:00100000:2.0:1783071317.009517:0:7540:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000081071638 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:7540:1869685707516160:0@lo:502: 00000100:00100000:2.0:1783071317.009598:0:7540:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071317.009634:0:7540:0:(client.c:2701:ptlrpc_set_wait()) set 000000008b0b4a9d going to sleep for 11 seconds 00000100:00100000:3.0:1783071317.009687:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707516160 00000100:00100000:3.0:1783071317.009694:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707516160 00000100:00100000:3.0:1783071317.009740:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1783071317.009747:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000077f5f393 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+15:7540:x1869685707516160:12345-0@lo:502: 00000100:00100000:3.0:1783071317.010593:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000077f5f393 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+15:7540:x1869685707516160:12345-0@lo:502: Request processed in 846us (994us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071317.010604:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783071317.013543:0:7540:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000081071638 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:7540:1869685707516160:0@lo:502: 00000100:00100000:2.0:1783071317.013627:0:7540:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000081071638 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:7540:1869685707516288:0@lo:502: 00000100:00100000:2.0:1783071317.013699:0:7540:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071317.013735:0:7540:0:(client.c:2701:ptlrpc_set_wait()) set 000000008b0b4a9d going to sleep for 11 seconds 00000100:00100000:3.0:1783071317.013828:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707516288 00000100:00100000:3.0:1783071317.013835:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707516288 00000100:00100000:3.0:1783071317.013887:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783071317.013896:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000063e840bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+15:7540:x1869685707516288:12345-0@lo:502: 00000100:00100000:3.0:1783071317.014019:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000063e840bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+15:7540:x1869685707516288:12345-0@lo:502: Request processed in 124us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071317.014027:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783071317.014297:0:7540:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000081071638 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:7540:1869685707516288:0@lo:502: 00000040:00080000:0.0:1783071317.014320:0:7540:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1783071317.014736:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1783071317.014755:0:6513:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783071317.014764:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: 00000000a82f37a0/0x6b58994c2cbdbcce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbcd5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071317.014774:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: 00000000a82f37a0/0x6b58994c2cbdbcce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbcd5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783071317.014783:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783071317.014786:0:6513:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8f8b10f7e000 from 4 10000000:01000000:3.0:1783071317.014789:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783071317.014815:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: 000000007f6cfa99/0x6b58994c2cbdbcdc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071317.014835:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: 000000007f6cfa99/0x6b58994c2cbdbcdc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071317.014844:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: 000000007f6cfa99/0x6b58994c2cbdbcdc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071317.014857:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000081cdc0de pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707516416:0@lo:101: 00000100:00100000:3.0:1783071317.014892:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071317.014927:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set 000000006dadb5da going to sleep for 11 seconds 00000100:00100000:2.0:1783071317.014981:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707516416 00000100:00100000:2.0:1783071317.014986:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707516416 00000100:00100000:2.0:1783071317.015022:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783071317.015028:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bdb9dfb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+15:6513:x1869685707516416:12345-0@lo:101: 00010000:00010000:2.0:1783071317.015038:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071317.015059:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000393db7b/0x6b58994c2cbdbce3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdbcdc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.015080:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000393db7b/0x6b58994c2cbdbce3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdbcdc expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.015089:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000393db7b/0x6b58994c2cbdbce3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbcdc expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.015098:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000393db7b, rc 0) 00000100:00100000:2.0:1783071317.015149:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bdb9dfb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+16:6513:x1869685707516416:12345-0@lo:101: Request processed in 121us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071317.015156:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783071317.018605:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000081cdc0de pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707516416:0@lo:101: 00010000:00010000:1.0:1783071317.018634:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: 000000007f6cfa99/0x6b58994c2cbdbcdc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbce3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071317.018646:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: 000000007f6cfa99/0x6b58994c2cbdbcdc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdbce3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071317.018714:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000006bac2b66 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707516544:0@lo:256: 00000100:00100000:1.0:1783071317.018776:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071317.018806:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set 000000007a519be4 going to sleep for 11 seconds 00000100:00100000:2.0:1783071317.018889:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707516544 00000100:00100000:2.0:1783071317.018896:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707516544 00000100:00100000:2.0:1783071317.018938:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783071317.018945:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e609ff21 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+16:6513:x1869685707516544:12345-0@lo:256: 20000000:01000000:2.0:1783071317.018965:0:6508:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783071317.018981:0:6508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783071317.018984:0:6508:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1783071317.019068:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e609ff21 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+16:6513:x1869685707516544:12345-0@lo:256: Request processed in 122us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071317.019077:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783071317.020292:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000006bac2b66 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707516544:0@lo:256: 10000000:01000000:1.0:1783071317.020358:0:6513:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783071317.020484:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: 000000007f6cfa99/0x6b58994c2cbdbcdc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbce3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071317.020496:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: 000000007f6cfa99/0x6b58994c2cbdbcdc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbce3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783071317.020505:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1783071317.020508:0:6513:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1783071317.020518:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1783071317.020548:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: 000000005a053e71/0x6b58994c2cbdbcea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071317.020556:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: 000000005a053e71/0x6b58994c2cbdbcea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071317.020563:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: 000000005a053e71/0x6b58994c2cbdbcea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071317.020577:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000006bac2b66 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707516672:0@lo:101: 00000100:00100000:1.0:1783071317.020621:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071317.020685:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set 000000007a519be4 going to sleep for 11 seconds 00000100:00100000:2.0:1783071317.024663:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707516672 00000100:00100000:2.0:1783071317.024680:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707516672 00000100:00100000:2.0:1783071317.024818:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783071317.024829:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ccb7a952 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+16:6513:x1869685707516672:12345-0@lo:101: 00010000:00010000:2.0:1783071317.024846:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071317.024890:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ff060d89/0x6b58994c2cbdbcf1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdbcea expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.024925:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ff060d89/0x6b58994c2cbdbcf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdbcea expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.024935:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ff060d89/0x6b58994c2cbdbcf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbcea expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.024945:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ff060d89, rc 0) 00000100:00100000:2.0:1783071317.025018:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ccb7a952 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+17:6513:x1869685707516672:12345-0@lo:101: Request processed in 192us (4397us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071317.025025:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783071317.025161:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000006bac2b66 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707516672:0@lo:101: 00010000:00010000:1.0:1783071317.025179:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: 000000005a053e71/0x6b58994c2cbdbcea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbcf1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071317.025188:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: 000000005a053e71/0x6b58994c2cbdbcea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdbcf1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071317.025270:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000006bac2b66 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707516800:0@lo:501: 00000100:00100000:1.0:1783071317.025305:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071317.025344:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set 000000007a519be4 going to sleep for 11 seconds 00000100:00100000:2.0:1783071317.025634:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707516800 00000100:00100000:2.0:1783071317.025640:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707516800 00000100:00100000:2.0:1783071317.025674:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783071317.025680:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000045413f1d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+17:6513:x1869685707516800:12345-0@lo:501: 00000100:00100000:2.0:1783071317.025784:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000045413f1d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+17:6513:x1869685707516800:12345-0@lo:501: Request processed in 105us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071317.025791:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783071317.025846:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000006bac2b66 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707516800:0@lo:501: 00000100:00100000:1.0:1783071317.025872:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000006bac2b66 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707516928:0@lo:503: 00000100:00100000:1.0:1783071317.025906:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071317.025929:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set 000000007a519be4 going to sleep for 11 seconds 00000100:00100000:2.0:1783071317.025961:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707516928 00000100:00100000:2.0:1783071317.025965:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707516928 00000100:00100000:2.0:1783071317.025989:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783071317.025993:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000022634a0f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+17:6513:x1869685707516928:12345-0@lo:503: 00000100:00100000:2.0:1783071317.026053:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000022634a0f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+17:6513:x1869685707516928:12345-0@lo:503: Request processed in 60us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071317.026060:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783071317.026115:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000006bac2b66 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707516928:0@lo:503: 00000100:00100000:1.0:1783071317.026515:0:7542:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000006bac2b66 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:7542:1869685707517056:0@lo:502: 00000100:00100000:1.0:1783071317.026546:0:7542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071317.026565:0:7542:0:(client.c:2701:ptlrpc_set_wait()) set 000000005fd39e66 going to sleep for 11 seconds 00000100:00100000:2.0:1783071317.026600:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707517056 00000100:00100000:2.0:1783071317.026603:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707517056 00000100:00100000:2.0:1783071317.026629:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783071317.026639:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d4fdf902 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+17:7542:x1869685707517056:12345-0@lo:502: 00000100:00100000:2.0:1783071317.026703:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d4fdf902 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+17:7542:x1869685707517056:12345-0@lo:502: Request processed in 64us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071317.026709:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783071317.026738:0:7542:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000006bac2b66 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:7542:1869685707517056:0@lo:502: 00000020:01000000:2.0:1783071317.026758:0:7542:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783071317.026769:0:7542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071317.026771:0:7542:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1783071317.026782:0:7542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1783071317.026785:0:7542:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.138@tcp to nid 0x20000c0a8cc8a (192.168.204.138@tcp) 00000020:00000080:2.0:1783071317.026808:0:7542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783071317.026822:0:7542:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (00000000b695bbbe) 00000020:00000080:2.0:1783071317.026842:0:7542:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:2.0:1783071317.026847:0:7542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1783071317.026916:0:7542:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1783071317.026921:0:7542:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:2.0:1783071317.026927:0:7542:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6b58994c2cbdbcff 00010000:00080000:2.0:1783071317.026955:0:7542:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000d74b256e@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.138@tcp at head 00010000:00010000:2.0:1783071317.032825:0:7542:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:2.0:1783071317.037535:0:7542:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783071317.037553:0:7542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1783071317.037595:0:7542:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1783071317.037617:0:7542:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6b58994c2cbdbd06 00000100:00080000:2.0:1783071317.037627:0:7542:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783071317.037632:0:7542:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000d74b256e using connection 192.168.204.138@tcp/0@lo 00000100:00100000:2.0:1783071317.037664:0:7542:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000005d15f8e0 x1869685707517184/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783071317.037723:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000005d15f8e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869685707517184:0@lo:38: 00000100:00100000:3.0:1783071317.037806:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783071317.037863:0:7542:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1783071317.037951:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000743913bc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869685707517312:0@lo:400: 00000100:00100000:2.0:1783071317.037984:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071317.038020:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000000d9869b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707517440:0@lo:400: 00000100:00100000:2.0:1783071317.038044:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071317.038059:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783071317.038064:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000008f31b56b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869685707517568:0@lo:400: 00000100:00100000:2.0:1783071317.038081:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071317.038109:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707517184 00000100:00100000:2.0:1783071317.038117:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707517184 00000100:00100000:2.0:1783071317.038207:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707517440 00000100:00100000:2.0:1783071317.038212:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707517440 00000100:00100000:2.0:1783071317.038246:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783071317.038252:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000008d90e32 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1869685707517184:12345-0@lo:38: 00010000:00080000:2.0:1783071317.038274:0:6522:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 218 last 0 00000020:00000080:2.0:1783071317.038306:0:6522:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6b58994c2cbdbd0d 00000004:00100000:2.0:1783071317.038319:0:6522:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1783071317.038324:0:6522:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000040:01000000:2.0:1783071317.038422:0:7542:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:1.0:1783071317.038712:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707517312 00000100:00100000:1.0:1783071317.038717:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707517312 00000100:00100000:1.0:1783071317.038751:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707517568 00000100:00100000:1.0:1783071317.038802:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707517568 00000100:00100000:1.0:1783071317.038821:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783071317.038826:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000650c3a45 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869685707517312:12345-0@lo:400: 00000100:00100000:1.0:1783071317.038882:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000650c3a45 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869685707517312:12345-0@lo:400: Request processed in 56us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071317.038889:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783071317.038907:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783071317.038913:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ef780056 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869685707517568:12345-0@lo:400: 00000100:00100000:1.0:1783071317.038945:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ef780056 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869685707517568:12345-0@lo:400: Request processed in 33us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071317.038951:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1783071317.038985:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000743913bc x1869685707517312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071317.038997:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000743913bc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869685707517312:0@lo:400: 00010000:00080000:1.0:1783071317.039027:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000008f31b56b x1869685707517568/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071317.039036:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000008f31b56b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869685707517568:0@lo:400: 00000100:00080000:2.0:1783071317.039708:0:7545:0:(client.c:1831:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@0000000003ed67b6 x1869685707517696/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071317.039717:0:7545:0:(client.c:2701:ptlrpc_set_wait()) set 000000005b709f2b going to sleep for 0 seconds 00000020:01000000:1.0:1783071317.039788:0:7542:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783071317.039793:0:7542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783071317.039795:0:7542:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1783071317.039808:0:7542:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783071317.039812:0:7542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783071317.039813:0:7542:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1783071317.039816:0:7542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783071317.039818:0:7542:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1783071317.039838:0:7542:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000a698dd3e pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:7542:1869685707517824:0@lo:502: 00000100:00100000:1.0:1783071317.039886:0:7542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071317.040000:0:7542:0:(client.c:2701:ptlrpc_set_wait()) set 000000006bd80a71 going to sleep for 11 seconds 00000100:00100000:2.0:1783071317.040032:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707517824 00000100:00100000:2.0:1783071317.040037:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707517824 00000100:00100000:2.0:1783071317.040105:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783071317.040112:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004a2cdc02 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+17:7542:x1869685707517824:12345-0@lo:502: 00000100:00100000:2.0:1783071317.040291:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004a2cdc02 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+17:7542:x1869685707517824:12345-0@lo:502: Request processed in 180us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071317.040307:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1783071317.040393:0:7542:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000a698dd3e pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:7542:1869685707517824:0@lo:502: 00000020:01000000:3.0:1783071317.040415:0:7542:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783071317.040419:0:7542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071317.040421:0:7542:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1783071317.040424:0:7542:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1783071317.040651:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1783071317.040672:0:6513:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1783071317.040682:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: 000000005a053e71/0x6b58994c2cbdbcea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbcf1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.040691:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: 000000005a053e71/0x6b58994c2cbdbcea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbcf1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071317.040700:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1783071317.040702:0:6513:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff8f8b06c74d40 from 1 10000000:01000000:2.0:1783071317.040705:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1783071317.040728:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: 000000008e37cf72/0x6b58994c2cbdbd14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.040734:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: 000000008e37cf72/0x6b58994c2cbdbd14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.040741:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: 000000008e37cf72/0x6b58994c2cbdbd14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071317.040754:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000008f31b56b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707517952:0@lo:101: 00000100:00100000:2.0:1783071317.040782:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071317.040813:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set 00000000d38d0bea going to sleep for 11 seconds 00000100:00100000:3.0:1783071317.040858:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707517952 00000100:00100000:3.0:1783071317.040863:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707517952 00000100:00100000:3.0:1783071317.040896:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783071317.040904:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000239d9947 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+17:6513:x1869685707517952:12345-0@lo:101: 00010000:00010000:3.0:1783071317.040913:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071317.040924:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009b5876fa/0x6b58994c2cbdbd1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdbd14 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071317.040945:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009b5876fa/0x6b58994c2cbdbd1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdbd14 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071317.040954:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009b5876fa/0x6b58994c2cbdbd1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbd14 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071317.040969:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009b5876fa, rc 0) 00000100:00100000:3.0:1783071317.041002:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000239d9947 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+18:6513:x1869685707517952:12345-0@lo:101: Request processed in 100us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071317.041009:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783071317.041074:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000008f31b56b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707517952:0@lo:101: 00010000:00010000:2.0:1783071317.041087:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: 000000008e37cf72/0x6b58994c2cbdbd14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbd1b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.041094:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: 000000008e37cf72/0x6b58994c2cbdbd14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdbd1b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071317.041227:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000008f31b56b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707518080:0@lo:501: 00000100:00100000:2.0:1783071317.041253:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071317.041309:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set 00000000d38d0bea going to sleep for 11 seconds 00000100:00100000:3.0:1783071317.041519:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707518080 00000100:00100000:3.0:1783071317.041524:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707518080 00000100:00100000:3.0:1783071317.041591:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1783071317.041598:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007d7263e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+18:6513:x1869685707518080:12345-0@lo:501: 00000100:00100000:3.0:1783071317.041671:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007d7263e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+18:6513:x1869685707518080:12345-0@lo:501: Request processed in 74us (418us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783071317.041678:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783071317.041729:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000008f31b56b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707518080:0@lo:501: 10000000:01000000:2.0:1783071317.041764:0:6513:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1783071317.041770:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: 000000008e37cf72/0x6b58994c2cbdbd14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbd1b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.041778:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: 000000008e37cf72/0x6b58994c2cbdbd14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbd1b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1783071317.056739:0:6522:0:(import.c:65:import_set_state_nolock()) 00000000987139d7 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783071317.056996:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000008d90e32 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1869685707517184:12345-0@lo:38: Request processed in 18741us (19188us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071317.057010:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783071317.057041:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783071317.057050:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000feb54efa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707517440:12345-0@lo:400: 00000100:00100000:2.0:1783071317.057171:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000feb54efa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707517440:12345-0@lo:400: Request processed in 123us (19126us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071317.057179:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783071317.057260:0:3644:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783071317.057269:0:3644:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1783071317.057277:0:3644:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1783071317.057283:0:3644:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1783071317.057286:0:3644:0:(import.c:65:import_set_state_nolock()) 00000000d74b256e lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1783071317.057309:0:3644:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000005b709f2b): req@0000000003ed67b6 x1869685707517696/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071317.057328:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000005d15f8e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869685707517184:0@lo:38: 00000100:00100000:2.0:1783071317.057602:0:7545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071317.057635:0:7545:0:(client.c:2701:ptlrpc_set_wait()) set 000000005b709f2b going to sleep for 11 seconds 00000100:00100000:0.0:1783071317.058180:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000bedd4aaf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707518208:0@lo:41: 00000100:00100000:0.0:1783071317.058229:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071317.058417:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000000d9869b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707517440:0@lo:400: 00000100:00100000:1.0:1783071317.058457:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707517696 00000100:00100000:1.0:1783071317.058463:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707517696 00000100:00100000:1.0:1783071317.058492:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707518208 00000100:00100000:1.0:1783071317.058495:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707518208 00000100:00100000:1.0:1783071317.058507:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783071317.058514:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008f31b56b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:7545:x1869685707517696:12345-0@lo:1000: 00000100:00100000:1.0:1783071317.058606:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008f31b56b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:7545:x1869685707517696:12345-0@lo:1000: Request processed in 92us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071317.058614:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783071317.058629:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783071317.058635:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000037eb47ea pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1869685707518208:12345-0@lo:41: 00000004:00000024:1.0:1783071317.058656:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1783071317.058692:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000037eb47ea pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1869685707518208:12345-0@lo:41: Request processed in 58us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071317.058698:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783071317.058733:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000bedd4aaf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707518208:0@lo:41: 00000100:00100000:0.0:1783071317.059064:0:7545:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000003ed67b6 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7545:1869685707517696:0@lo:1000: 00000040:01000000:0.0:1783071317.059095:0:7545:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1783071317.059143:0:7545:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000008602a06a pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7545:1869685707518336:0@lo:1000: 00000100:00100000:0.0:1783071317.059178:0:7545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071317.059201:0:7545:0:(client.c:2701:ptlrpc_set_wait()) set 00000000fee70ef7 going to sleep for 11 seconds 00000100:00100000:1.0:1783071317.059333:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707518336 00000100:00100000:1.0:1783071317.059338:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707518336 00000100:00100000:1.0:1783071317.059358:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783071317.059396:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000002cbf3a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7545:x1869685707518336:12345-0@lo:1000: 00000100:00100000:1.0:1783071317.059647:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000002cbf3a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7545:x1869685707518336:12345-0@lo:1000: Request processed in 251us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071317.059655:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783071317.059729:0:7545:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000008602a06a pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7545:1869685707518336:0@lo:1000: 00000100:00100000:0.0:1783071317.059767:0:7545:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000008602a06a pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7545:1869685707518464:0@lo:700: 00000100:00100000:0.0:1783071317.059792:0:7545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071317.059817:0:7545:0:(client.c:2701:ptlrpc_set_wait()) set 00000000cec4f4f5 going to sleep for 11 seconds 00000100:00100000:1.0:1783071317.060028:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707518464 00000100:00100000:1.0:1783071317.060032:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707518464 00000100:00100000:1.0:1783071317.060067:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783071317.060073:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007b2b7ba4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7545:x1869685707518464:12345-0@lo:700: 00000100:00100000:1.0:1783071317.060118:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007b2b7ba4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7545:x1869685707518464:12345-0@lo:700: Request processed in 45us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071317.060125:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783071317.060150:0:7545:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000008602a06a pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7545:1869685707518464:0@lo:700: 00000100:00100000:1.0:1783071317.060306:0:7545:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000072548ae0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7545:1869685707518592:0@lo:1000: 00000100:00100000:1.0:1783071317.060332:0:7545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071317.060351:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707518592 00000100:00100000:1.0:1783071317.060355:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707518592 00000100:00100000:1.0:1783071317.060395:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783071317.060401:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000054de5b1a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7545:x1869685707518592:12345-0@lo:1000: 00000100:00100000:1.0:1783071317.060576:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000054de5b1a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7545:x1869685707518592:12345-0@lo:1000: Request processed in 175us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071317.060594:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783071317.060611:0:7545:0:(client.c:2701:ptlrpc_set_wait()) set 00000000a1cb926f going to sleep for 11 seconds 00000100:00100000:1.0:1783071317.060623:0:7545:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000072548ae0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7545:1869685707518592:0@lo:1000: 00000004:00080000:1.0:1783071317.060661:0:7545:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 000000009fcdaad1 with version 0 00000020:00100000:1.0:1783071317.060676:0:7545:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783071317.060682:0:7545:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000072548ae0 x1869685707518848/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783071317.060705:0:7545:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000072548ae0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7545:1869685707518848:0@lo:1000: 00000100:00100000:1.0:1783071317.060729:0:7545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071317.060789:0:7545:0:(client.c:2701:ptlrpc_set_wait()) set 000000006bd80a71 going to sleep for 11 seconds 00000100:00100000:0.0:1783071317.061144:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707518848 00000100:00100000:0.0:1783071317.061149:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707518848 00000100:00100000:0.0:1783071317.061173:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783071317.061178:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c3c583f3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7545:x1869685707518848:12345-0@lo:1000: 00000001:00080000:0.0:1783071317.067350:0:7447:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:0.0:1783071317.067400:0:7447:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1783071317.067761:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c3c583f3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7545:x1869685707518848:12345-0@lo:1000: Request processed in 6579us (7027us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1783071317.067775:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000004:00080000:0.0:1783071317.067946:0:7545:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1783071317.067952:0:7545:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1783071317.067968:0:7545:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000072548ae0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7545:1869685707518848:0@lo:1000: 00000100:00100000:0.0:1783071317.068064:0:7545:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002ddb02d5 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7545:1869685707518976:0@lo:1000: 00000100:00100000:0.0:1783071317.068105:0:7545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071317.068192:0:7545:0:(client.c:2701:ptlrpc_set_wait()) set 00000000fee70ef7 going to sleep for 11 seconds 00000100:00100000:2.0:1783071317.073705:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707518976 00000100:00100000:2.0:1783071317.073723:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707518976 00000100:00100000:2.0:1783071317.073828:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783071317.073840:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000087318771 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7545:x1869685707518976:12345-0@lo:1000: 00000100:00100000:2.0:1783071317.074001:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000087318771 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7545:x1869685707518976:12345-0@lo:1000: Request processed in 162us (5895us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071317.074009:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783071317.075478:0:7545:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002ddb02d5 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7545:1869685707518976:0@lo:1000: 00000040:00080000:3.0:1783071317.075509:0:7545:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1783071317.075556:0:7545:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 000000002aed9451 with version 1 00000004:00080000:3.0:1783071317.075574:0:7543:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000008856b609 version 1 rpc_version 1 00000020:00100000:3.0:1783071317.075608:0:7543:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1783071317.075614:0:7543:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000a6b12510 x1869685707519232/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783071317.075642:0:7543:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000a6b12510 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7543:1869685707519232:0@lo:1000: 00000100:00100000:3.0:1783071317.075699:0:7543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071317.079071:0:7543:0:(client.c:2701:ptlrpc_set_wait()) set 000000002f065949 going to sleep for 11 seconds 00000100:00100000:0.0:1783071317.084116:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707519232 00000100:00100000:0.0:1783071317.084136:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707519232 00000100:00100000:0.0:1783071317.084208:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783071317.084230:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c1ee8eaa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7543:x1869685707519232:12345-0@lo:1000: 00000040:00080000:3.0:1783071317.084443:0:7545:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1783071317.084514:0:7545:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1783071317.084518:0:7545:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:0.0:1783071317.086193:0:7447:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:1.0:1783071317.086649:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c1ee8eaa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7543:x1869685707519232:12345-0@lo:1000: Request processed in 2417us (10945us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1783071317.086662:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:3.0:1783071317.086727:0:7543:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:3.0:1783071317.086732:0:7543:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1783071317.086750:0:7543:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000a6b12510 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7543:1869685707519232:0@lo:1000: 00010000:00010000:3.0:1783071317.253405:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071318.278821:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071319.304511:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783071319.376116:0:7720:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg438-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:1.0:1783071320.303172:0:7772:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783071320.303554:0:7772:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783071320.324601:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071320.898920:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000984591f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707519360:0@lo:41: 00000100:00100000:1.0:1783071320.899000:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071320.899125:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707519360 00000100:00100000:3.0:1783071320.899134:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707519360 00000100:00100000:3.0:1783071320.899200:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783071320.899208:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004314f78b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707519360:12345-0@lo:41: 00000004:00000024:3.0:1783071320.899242:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1783071320.899296:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004314f78b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707519360:12345-0@lo:41: Request processed in 88us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071320.899302:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783071320.899356:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000984591f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707519360:0@lo:41: 00010000:00010000:3.0:1783071321.346613:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071322.370575:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071322.444639:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783071322.444675:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000039c9bb67 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707519488:0@lo:41: 00000100:00100000:2.0:1783071322.444773:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071322.444869:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707519488 00000100:00100000:2.0:1783071322.444878:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707519488 00000100:00100000:2.0:1783071322.444938:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783071322.444946:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000743913bc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707519488:12345-0@lo:41: 00000004:00000024:2.0:1783071322.444991:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1783071322.445038:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000743913bc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707519488:12345-0@lo:41: Request processed in 93us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071322.445046:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783071322.445092:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000039c9bb67 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707519488:0@lo:41: 00000100:00100000:2.0:1783071322.445290:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000039c9bb67 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:feaa1501-b927-4e07-baad-3200e92d7497:3648:1869685707519616:0@lo:400: 00000100:00100000:2.0:1783071322.445323:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071322.445358:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783071322.445472:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707519616 00000100:00100000:0.0:1783071322.445478:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707519616 00000100:00100000:0.0:1783071322.445522:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783071322.445526:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000058b397ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+18:3648:x1869685707519616:12345-0@lo:400: 00000100:00100000:0.0:1783071322.445560:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000058b397ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+18:3648:x1869685707519616:12345-0@lo:400: Request processed in 34us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071322.445566:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1783071322.445636:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000008602a06a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869685707520000:0@lo:400: 00000100:00100000:2.0:1783071322.445669:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071322.445705:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000039c9bb67 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:feaa1501-b927-4e07-baad-3200e92d7497:3648:1869685707519616:0@lo:400: 00000100:00100000:2.0:1783071322.445725:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000984591f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869685707519744:0@lo:400: 00000100:00100000:2.0:1783071322.445760:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071322.445782:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783071322.445787:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002ddb02d5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707519872:0@lo:400: 00000100:00100000:2.0:1783071322.445809:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071322.445836:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707520000 00000100:00100000:2.0:1783071322.445839:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707520000 00000100:00100000:2.0:1783071322.445862:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707519744 00000100:00100000:2.0:1783071322.445865:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707519744 00000100:00100000:2.0:1783071322.445876:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783071322.445881:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000081071638 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869685707520000:12345-0@lo:400: 00000100:00100000:2.0:1783071322.445914:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000081071638 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869685707520000:12345-0@lo:400: Request processed in 33us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071322.445920:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783071322.445930:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783071322.445934:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000065534fbb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1869685707519744:12345-0@lo:400: 00000100:00100000:2.0:1783071322.445956:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000065534fbb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1869685707519744:12345-0@lo:400: Request processed in 22us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071322.445961:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783071322.445973:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707519872 00000100:00100000:2.0:1783071322.445975:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707519872 00000100:00100000:2.0:1783071322.445987:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783071322.445991:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e1dc44b5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707519872:12345-0@lo:400: 00000100:00100000:2.0:1783071322.446015:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e1dc44b5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707519872:12345-0@lo:400: Request processed in 24us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071322.446021:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1783071322.446044:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000008602a06a x1869685707520000/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071322.446067:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000008602a06a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869685707520000:0@lo:400: 00000100:00100000:2.0:1783071322.446086:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002ddb02d5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707519872:0@lo:400: 00010000:00080000:2.0:1783071322.446093:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000984591f4 x1869685707519744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071322.446101:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000984591f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869685707519744:0@lo:400: 00000020:00000004:0.0:1783071322.952281:0:7874:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783071322.952941:0:7874:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783071323.394568:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783071324.150862:0:7922:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdf7abd1d0 20000000:00000080:2.0:1783071324.150887:0:7922:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f8b3c691800 uarg=0000000000000000 20000000:01000000:2.0:1783071324.150942:0:7922:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1783071324.150951:0:7922:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1783071324.150956:0:7922:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1783071324.151072:0:7922:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1783071324.151101:0:7922:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1783071324.159306:0:7922:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783071324.159877:0:7922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1783071324.159923:0:7922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1783071324.159938:0:7922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1783071324.159958:0:7922:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1783071324.159980:0:7922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000006df31ec2/0x6b58994c2cbdbd22 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071324.160005:0:7922:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000ffb5347/0x6b58994c2cbdbba1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbb9a expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071324.160012:0:7922:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f5be14d8/0x6b58994c2cbdbc8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbc88 expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071324.160021:0:7922:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000006df31ec2/0x6b58994c2cbdbd22 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071324.160093:0:7922:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f5be14d8/0x6b58994c2cbdbc8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6b58994c2cbdbc88 expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071324.160110:0:7922:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f5be14d8/0x6b58994c2cbdbc8f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6b58994c2cbdbc88 expref: 17 pid: 6508 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071324.160129:0:7922:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000000e6b341b pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7922:1869685707520128:0@lo:104: 00000100:00100000:2.0:1783071324.160243:0:7922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783071324.160314:0:7922:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000ffb5347/0x6b58994c2cbdbba1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6b58994c2cbdbb9a expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071324.160323:0:7922:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000ffb5347/0x6b58994c2cbdbba1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6b58994c2cbdbb9a expref: 17 pid: 6511 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071324.160331:0:7922:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000edb4fbc4 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7922:1869685707520256:0@lo:104: 00000100:00100000:2.0:1783071324.160352:0:7922:0:(client.c:2701:ptlrpc_set_wait()) set 00000000d844671b going to sleep for 11 seconds 00000100:00100000:0.0:1783071324.161088:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1783071324.161118:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071324.161247:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707520128 00000100:00100000:0.0:1783071324.161257:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707520128 00000100:00100000:3.0:1783071324.161320:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707520256 00000100:00100000:3.0:1783071324.161325:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707520256 00000100:00100000:3.0:1783071324.161352:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783071324.161594:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004876981d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:feaa1501-b927-4e07-baad-3200e92d7497+4:7922:x1869685707520128:12345-0@lo:104: 00010000:00010000:3.0:1783071324.161615:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: 00000000812f5ccb/0x6b58994c2cbdbc88 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbc8f expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071324.161758:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783071324.161764:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004876981d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:feaa1501-b927-4e07-baad-3200e92d7497+4:7922:x1869685707520128:12345-0@lo:104: Request processed in 405us (1523us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071324.161773:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783071324.161852:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783071324.161859:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bedd4aaf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:feaa1501-b927-4e07-baad-3200e92d7497+3:7922:x1869685707520256:12345-0@lo:104: 00010000:00010000:3.0:1783071324.161866:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: 00000000612b690b/0x6b58994c2cbdbb9a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbba1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071324.161901:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1783071324.161906:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bedd4aaf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:feaa1501-b927-4e07-baad-3200e92d7497+3:7922:x1869685707520256:12345-0@lo:104: Request processed in 49us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071324.161912:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1783071324.161932:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783071324.161937:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: 00000000812f5ccb/0x6b58994c2cbdbc88 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbc8f expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071324.161945:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000812f5ccb already unused, calling callback (0000000048d7fc16) 10000000:00010000:3.0:1783071324.161949:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: 00000000812f5ccb/0x6b58994c2cbdbc88 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6b58994c2cbdbc8f expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071324.161958:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: 00000000812f5ccb/0x6b58994c2cbdbc88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6b58994c2cbdbc8f expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783071324.161965:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: 00000000812f5ccb/0x6b58994c2cbdbc88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6b58994c2cbdbc8f expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783071324.161971:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783071324.162014:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: 00000000812f5ccb/0x6b58994c2cbdbc88 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbc8f expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071324.162021:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783071324.162040:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: 00000000812f5ccb/0x6b58994c2cbdbc88 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbc8f expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071324.162046:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: 00000000812f5ccb/0x6b58994c2cbdbc88 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbc8f expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071324.162059:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783071324.162061:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: 00000000612b690b/0x6b58994c2cbdbb9a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbba1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071324.162066:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000612b690b already unused, calling callback (0000000048d7fc16) 10000000:00010000:3.0:1783071324.162068:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: 00000000612b690b/0x6b58994c2cbdbb9a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6b58994c2cbdbba1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071324.162074:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: 00000000612b690b/0x6b58994c2cbdbb9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6b58994c2cbdbba1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783071324.162089:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: 00000000612b690b/0x6b58994c2cbdbb9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6b58994c2cbdbba1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783071324.162094:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783071324.162106:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: 00000000612b690b/0x6b58994c2cbdbb9a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbba1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071324.162111:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783071324.162126:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: 00000000612b690b/0x6b58994c2cbdbb9a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbba1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071324.162142:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: 00000000612b690b/0x6b58994c2cbdbb9a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbba1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071324.162404:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071324.162407:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071324.162408:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071324.162436:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000a6b12510 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:feaa1501-b927-4e07-baad-3200e92d7497:3648:1869685707520384:0@lo:103: 00000100:00100000:3.0:1783071324.162483:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071324.162620:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c4be8f3b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:feaa1501-b927-4e07-baad-3200e92d7497:3645:1869685707520512:0@lo:103: 00000100:00100000:3.0:1783071324.162647:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071324.162693:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707520384 00000100:00100000:3.0:1783071324.162700:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707520384 00010000:00010000:3.0:1783071324.162723:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f5be14d8/0x6b58994c2cbdbc8f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbc88 expref: 18 pid: 6508 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071324.162748:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707520512 00000100:00100000:3.0:1783071324.162751:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707520512 00010000:00010000:3.0:1783071324.162762:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000ffb5347/0x6b58994c2cbdbba1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbb9a expref: 19 pid: 6511 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071324.162774:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783071324.162779:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000006943f05 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:feaa1501-b927-4e07-baad-3200e92d7497+19:3648:x1869685707520384:12345-0@lo:103: 00010000:00010000:3.0:1783071324.162792:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071324.162796:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f5be14d8/0x6b58994c2cbdbc8f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbc88 expref: 19 pid: 6508 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071324.162806:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f5be14d8/0x6b58994c2cbdbc8f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6b58994c2cbdbc88 expref: 19 pid: 6508 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071324.162993:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071324.163031:0:6503:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1783071324.163041:0:6503:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1783071324.163182:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783071324.163189:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000026fd21b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:feaa1501-b927-4e07-baad-3200e92d7497+19:3645:x1869685707520512:12345-0@lo:103: 00010000:00010000:1.0:1783071324.163198:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071324.163202:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000ffb5347/0x6b58994c2cbdbba1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbb9a expref: 19 pid: 6511 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071324.163213:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000ffb5347/0x6b58994c2cbdbba1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6b58994c2cbdbb9a expref: 19 pid: 6511 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071324.163227:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000006df31ec2/0x6b58994c2cbdbd22 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071324.163245:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006df31ec2/0x6b58994c2cbdbd22 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071324.163259:0:6503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006df31ec2/0x6b58994c2cbdbd22 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071324.163266:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006df31ec2/0x6b58994c2cbdbd22 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071324.163274:0:6503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000006df31ec2/0x6b58994c2cbdbd22 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071324.163280:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000006df31ec2/0x6b58994c2cbdbd22 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071324.163285:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006df31ec2 already unused, calling callback (000000006c37b471) 00010000:00010000:1.0:1783071324.163289:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000006df31ec2/0x6b58994c2cbdbd22 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071324.163296:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000006df31ec2/0x6b58994c2cbdbd22 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071324.163303:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000006df31ec2/0x6b58994c2cbdbd22 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071324.163312:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071324.163352:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000026fd21b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:feaa1501-b927-4e07-baad-3200e92d7497+19:3645:x1869685707520512:12345-0@lo:103: Request processed in 164us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071324.163358:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1783071324.163681:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783071324.163717:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000006943f05 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:feaa1501-b927-4e07-baad-3200e92d7497+18:3648:x1869685707520384:12345-0@lo:103: Request processed in 937us (1234us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071324.163726:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783071324.163769:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c4be8f3b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:feaa1501-b927-4e07-baad-3200e92d7497:3645:1869685707520512:0@lo:103: 00000100:00100000:3.0:1783071324.163799:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000a6b12510 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:feaa1501-b927-4e07-baad-3200e92d7497:3648:1869685707520384:0@lo:103: 00010000:00010000:2.0:1783071324.164226:0:7922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f5be14d8/0x6b58994c2cbdbc8f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6b58994c2cbdbc88 expref: 17 pid: 6508 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071324.164242:0:7922:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000000e6b341b pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7922:1869685707520128:0@lo:104: 00010000:00010000:0.0:1783071324.164349:0:7922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000ffb5347/0x6b58994c2cbdbba1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6b58994c2cbdbb9a expref: 16 pid: 6511 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071324.164360:0:7922:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000edb4fbc4 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7922:1869685707520256:0@lo:104: 00010000:00010000:0.0:1783071324.164511:0:7922:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000006df31ec2/0x6b58994c2cbdbd22 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071324.164647:0:7922:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000006df31ec2/0x6b58994c2cbdbd22 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071324.164654:0:7922:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000006df31ec2/0x6b58994c2cbdbd22 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071324.164659:0:7922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006df31ec2/0x6b58994c2cbdbd22 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071324.419737:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071325.447717:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1783071325.571629:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783071325.571638:0:6513:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8f8b3447b000 from 1 10000000:01000000:3.0:1783071325.571643:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783071325.571689:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: 000000005b46b776/0x6b58994c2cbdbd29 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071325.571703:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: 000000005b46b776/0x6b58994c2cbdbd29 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071325.571712:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: 000000005b46b776/0x6b58994c2cbdbd29 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071325.571736:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000a6b12510 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707520640:0@lo:101: 00000100:00100000:3.0:1783071325.571807:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071325.571859:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set 00000000efb79c29 going to sleep for 11 seconds 00000100:00100000:2.0:1783071325.572098:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707520640 00000100:00100000:2.0:1783071325.572106:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707520640 00000100:00100000:2.0:1783071325.572174:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1783071325.572183:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a5d480f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+16:6513:x1869685707520640:12345-0@lo:101: 00010000:00010000:2.0:1783071325.572198:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071325.572284:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e21f7e0f/0x6b58994c2cbdbd30 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdbd29 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071325.572322:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e21f7e0f/0x6b58994c2cbdbd30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdbd29 expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071325.572332:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e21f7e0f/0x6b58994c2cbdbd30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbd29 expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071325.572341:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e21f7e0f, rc 0) 00000100:00100000:2.0:1783071325.572429:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a5d480f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+17:6513:x1869685707520640:12345-0@lo:101: Request processed in 247us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071325.572437:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783071325.574154:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000a6b12510 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707520640:0@lo:101: 00010000:00010000:1.0:1783071325.574194:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: 000000005b46b776/0x6b58994c2cbdbd29 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbd30 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071325.574205:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: 000000005b46b776/0x6b58994c2cbdbd29 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdbd30 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071325.574622:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000cb776a9e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707520768:0@lo:501: 00000100:00100000:1.0:1783071325.575333:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071325.575410:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set 00000000287856a2 going to sleep for 11 seconds 00000100:00100000:3.0:1783071325.576127:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707520768 00000100:00100000:3.0:1783071325.576134:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707520768 00000100:00100000:3.0:1783071325.578863:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1783071325.578887:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e8e3e515 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+17:6513:x1869685707520768:12345-0@lo:501: 00000100:00100000:3.0:1783071325.579081:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e8e3e515 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+17:6513:x1869685707520768:12345-0@lo:501: Request processed in 206us (3751us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071325.579108:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783071325.579806:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000cb776a9e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707520768:0@lo:501: 00000100:00100000:1.0:1783071325.579871:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000cb776a9e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707520896:0@lo:503: 00000100:00100000:1.0:1783071325.579933:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071325.579972:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set 00000000287856a2 going to sleep for 11 seconds 00000100:00100000:2.0:1783071325.583610:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707520896 00000100:00100000:2.0:1783071325.583626:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707520896 00000100:00100000:2.0:1783071325.583691:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1783071325.583701:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000034eb5d17 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+17:6513:x1869685707520896:12345-0@lo:503: 00000100:00100000:2.0:1783071325.583851:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000034eb5d17 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+17:6513:x1869685707520896:12345-0@lo:503: Request processed in 151us (3918us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071325.583859:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783071325.583986:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000cb776a9e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707520896:0@lo:503: 00000100:00100000:3.0:1783071325.584756:0:7981:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c4be8f3b pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:7981:1869685707521024:0@lo:502: 00000100:00100000:3.0:1783071325.584811:0:7981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071325.584848:0:7981:0:(client.c:2701:ptlrpc_set_wait()) set 00000000777f30cc going to sleep for 11 seconds 00000100:00100000:1.0:1783071325.584901:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707521024 00000100:00100000:1.0:1783071325.584906:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707521024 00000100:00100000:1.0:1783071325.584950:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783071325.584956:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bc35edc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+17:7981:x1869685707521024:12345-0@lo:502: 00000100:00100000:1.0:1783071325.585074:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bc35edc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+17:7981:x1869685707521024:12345-0@lo:502: Request processed in 118us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071325.585081:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1783071325.585275:0:7981:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c4be8f3b pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:7981:1869685707521024:0@lo:502: 00000020:01000000:3.0:1783071325.585298:0:7981:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783071325.585306:0:7981:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071325.585309:0:7981:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1783071325.585314:0:7981:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f8b3447b000 00000020:00000080:3.0:1783071325.585317:0:7981:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783071325.585355:0:7981:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3b4da300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:7981:1869685707521152:0@lo:502: 00000100:00100000:3.0:1783071325.585418:0:7981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071325.585439:0:7981:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b186cb780 going to sleep for 11 seconds 00000100:00100000:1.0:1783071325.585552:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707521152 00000100:00100000:1.0:1783071325.585556:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707521152 00000100:00100000:1.0:1783071325.585588:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783071325.585595:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07695450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+17:7981:x1869685707521152:12345-0@lo:502: 00000100:00100000:1.0:1783071325.585666:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07695450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+17:7981:x1869685707521152:12345-0@lo:502: Request processed in 72us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071325.585678:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783071325.585753:0:7981:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3b4da300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:7981:1869685707521152:0@lo:502: 00000020:01000000:3.0:1783071325.585771:0:7981:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783071325.585775:0:7981:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071325.585777:0:7981:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1783071325.585779:0:7981:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1783071325.585924:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1783071325.585996:0:6513:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783071325.586008:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8200/0x6b58994c2cbdbd29 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbd30 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071325.586021:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8200/0x6b58994c2cbdbd29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbd30 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783071325.586031:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783071325.586034:0:6513:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8f8b10f7e000 from 1 10000000:01000000:1.0:1783071325.586036:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783071325.586073:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9a00/0x6b58994c2cbdbd37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071325.586081:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9a00/0x6b58994c2cbdbd37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071325.586089:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9a00/0x6b58994c2cbdbd37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071325.586099:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b0ab60380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707521280:0@lo:101: 00000100:00100000:1.0:1783071325.586120:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071325.586144:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b06962f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783071325.586320:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707521280 00000100:00100000:2.0:1783071325.586326:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707521280 00000100:00100000:2.0:1783071325.586348:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783071325.586355:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07697c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+17:6513:x1869685707521280:12345-0@lo:101: 00010000:00010000:2.0:1783071325.586386:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071325.586399:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b10967400/0x6b58994c2cbdbd3e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdbd37 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071325.586421:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b10967400/0x6b58994c2cbdbd3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdbd37 expref: 18 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071325.586443:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b10967400/0x6b58994c2cbdbd3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbd37 expref: 18 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071325.586452:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b10967400, rc 0) 00000100:00100000:2.0:1783071325.586484:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07697c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+18:6513:x1869685707521280:12345-0@lo:101: Request processed in 130us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071325.586490:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1783071325.586623:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b0ab60380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707521280:0@lo:101: 00010000:00010000:1.0:1783071325.586636:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9a00/0x6b58994c2cbdbd37 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbd3e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071325.586644:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9a00/0x6b58994c2cbdbd37 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdbd3e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071325.586694:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b0ab60380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707521408:0@lo:501: 00000100:00100000:1.0:1783071325.586722:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071325.586748:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b06962f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783071325.586759:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707521408 00000100:00100000:1.0:1783071325.586763:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707521408 00000100:00100000:1.0:1783071325.586789:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1783071325.586796:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07696050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+18:6513:x1869685707521408:12345-0@lo:501: 00000100:00100000:1.0:1783071325.586897:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07696050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+18:6513:x1869685707521408:12345-0@lo:501: Request processed in 101us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071325.586903:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1783071325.587179:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b0ab60380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707521408:0@lo:501: 00000100:00100000:1.0:1783071325.587210:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b0ab60380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707521536:0@lo:503: 00000100:00100000:1.0:1783071325.587247:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071325.587262:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b06962f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783071325.587274:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707521536 00000100:00100000:1.0:1783071325.587277:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707521536 00000100:00100000:1.0:1783071325.587294:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783071325.587300:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07695c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+18:6513:x1869685707521536:12345-0@lo:503: 00000100:00100000:1.0:1783071325.587609:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07695c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+18:6513:x1869685707521536:12345-0@lo:503: Request processed in 307us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071325.587615:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1783071325.587672:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b0ab60380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707521536:0@lo:503: 00000100:00100000:2.0:1783071325.588699:0:7982:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b08871880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:7982:1869685707521664:0@lo:502: 00000100:00100000:2.0:1783071325.588760:0:7982:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071325.588953:0:7982:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b06dbc240 going to sleep for 11 seconds 00000100:00100000:3.0:1783071325.589101:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707521664 00000100:00100000:3.0:1783071325.589108:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707521664 00000100:00100000:3.0:1783071325.589245:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783071325.589254:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07696450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+18:7982:x1869685707521664:12345-0@lo:502: 00000100:00100000:3.0:1783071325.589402:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07696450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+18:7982:x1869685707521664:12345-0@lo:502: Request processed in 148us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071325.589409:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1783071325.589499:0:7982:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b08871880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:7982:1869685707521664:0@lo:502: 00000020:01000000:1.0:1783071325.589526:0:7982:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783071325.589540:0:7982:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783071325.589543:0:7982:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1783071325.589551:0:7982:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f8b10f7e000 00000020:00000080:1.0:1783071325.589554:0:7982:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1783071325.589581:0:7982:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b0ab63480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:7982:1869685707521792:0@lo:502: 00000100:00100000:1.0:1783071325.589623:0:7982:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071325.589806:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707521792 00000100:00100000:2.0:1783071325.589811:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707521792 00000100:00100000:2.0:1783071325.589835:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783071325.589841:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07697050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+18:7982:x1869685707521792:12345-0@lo:502: 00000100:00100000:2.0:1783071325.589909:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07697050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+18:7982:x1869685707521792:12345-0@lo:502: Request processed in 68us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071325.589915:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783071325.590459:0:7982:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b1edea480 going to sleep for 11 seconds 00000100:00100000:2.0:1783071325.590475:0:7982:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b0ab63480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:7982:1869685707521792:0@lo:502: 00000020:01000000:2.0:1783071325.590496:0:7982:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783071325.590502:0:7982:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071325.590504:0:7982:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1783071325.590508:0:7982:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1783071325.590714:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1783071325.590734:0:6513:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783071325.590743:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9a00/0x6b58994c2cbdbd37 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbd3e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071325.590754:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9a00/0x6b58994c2cbdbd37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbd3e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071326.018800:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b078d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707521920:0@lo:41: 00000100:00100000:3.0:1783071326.018899:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071326.019022:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707521920 00000100:00100000:2.0:1783071326.019031:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707521920 00000100:00100000:2.0:1783071326.019100:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783071326.019117:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3b4da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707521920:12345-0@lo:41: 00000004:00000024:2.0:1783071326.019175:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:2.0:1783071326.019754:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3b4da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707521920:12345-0@lo:41: Request processed in 636us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071326.019762:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783071326.019935:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b078d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707521920:0@lo:41: 00010000:00010000:2.0:1783071326.467622:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071327.492244:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071327.554946:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b078d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707522048:0@lo:41: 00000100:00100000:1.0:1783071327.555036:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071327.555233:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707522048 00000100:00100000:0.0:1783071327.555244:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707522048 00000100:00100000:0.0:1783071327.555324:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783071327.555333:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707522048:12345-0@lo:41: 00000004:00000024:0.0:1783071327.555399:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1783071327.555543:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3b4daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:feaa1501-b927-4e07-baad-3200e92d7497:3648:1869685707522176:0@lo:400: 00000100:00100000:2.0:1783071327.555583:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071327.555620:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783071327.555627:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3b4d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869685707522560:0@lo:400: 00000100:00100000:2.0:1783071327.555653:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071327.555680:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3b4d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869685707522304:0@lo:400: 00000100:00100000:2.0:1783071327.555701:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071327.555719:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783071327.555725:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3b4da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707522432:0@lo:400: 00000100:00100000:2.0:1783071327.555746:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071327.555770:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707522560 00000100:00100000:2.0:1783071327.555775:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707522560 00000100:00100000:2.0:1783071327.555803:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707522304 00000100:00100000:2.0:1783071327.555806:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707522304 00000100:00100000:2.0:1783071327.555818:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783071327.555824:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b08870700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869685707522560:12345-0@lo:400: 00000100:00100000:1.0:1783071327.555888:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707522176 00000100:00100000:1.0:1783071327.555892:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707522176 00000100:00100000:1.0:1783071327.555926:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1783071327.555934:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07694450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+18:3648:x1869685707522176:12345-0@lo:400: 00000100:00100000:0.0:1783071327.556088:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707522048:12345-0@lo:41: Request processed in 755us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071327.556163:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783071327.556182:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707522432 00000100:00100000:0.0:1783071327.556185:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707522432 00000100:00100000:0.0:1783071327.556199:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783071327.556203:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b08873480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707522432:12345-0@lo:400: 00000100:00100000:2.0:1783071327.556236:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b08870700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869685707522560:12345-0@lo:400: Request processed in 411us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071327.556242:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783071327.556270:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783071327.556316:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b08873480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707522432:12345-0@lo:400: Request processed in 111us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071327.556322:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783071327.556399:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b08873b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1869685707522304:12345-0@lo:400: 00000100:00100000:2.0:1783071327.556441:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b08873b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1869685707522304:12345-0@lo:400: Request processed in 45us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071327.557294:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07694450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+18:3648:x1869685707522176:12345-0@lo:400: Request processed in 1360us (1708us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071327.557303:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1783071327.557443:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3b4da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707522432:0@lo:400: 00010000:00080000:0.0:1783071327.557458:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f8b3b4d8a80 x1869685707522304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071327.557707:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3b4d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869685707522304:0@lo:400: 00000100:00100000:0.0:1783071327.557784:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b078d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707522048:0@lo:41: 00000100:00100000:2.0:1783071327.558133:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1783071327.558184:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f8b3b4d8700 x1869685707522560/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071327.558195:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3b4d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869685707522560:0@lo:400: 00000100:00100000:2.0:1783071327.558206:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3b4daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:feaa1501-b927-4e07-baad-3200e92d7497:3648:1869685707522176:0@lo:400: 00010000:00010000:2.0:1783071328.514524:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071329.540282:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071330.564588:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071331.138582:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3b4db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707522688:0@lo:41: 00000100:00100000:2.0:1783071331.138704:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071331.138897:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707522688 00000100:00100000:1.0:1783071331.138911:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707522688 00000100:00100000:1.0:1783071331.139012:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783071331.139031:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b08873100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707522688:12345-0@lo:41: 00000004:00000024:1.0:1783071331.139118:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:1.0:1783071331.139198:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b08873100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707522688:12345-0@lo:41: Request processed in 174us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071331.139206:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783071331.139420:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3b4db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707522688:0@lo:41: 00010000:00010000:3.0:1783071331.605717:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071332.610786:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071332.674691:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783071332.674716:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b078d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707522816:0@lo:41: 00000100:00100000:0.0:1783071332.674784:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071332.674838:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707522816 00000100:00100000:0.0:1783071332.674846:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707522816 00000100:00100000:0.0:1783071332.674898:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783071332.674908:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b078d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707522816:12345-0@lo:41: 00000004:00000024:0.0:1783071332.674957:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1783071332.675009:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b078d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707522816:12345-0@lo:41: Request processed in 101us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071332.675016:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783071332.675466:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b078d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707522816:0@lo:41: 00000100:00100000:0.0:1783071332.676115:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3b4db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:feaa1501-b927-4e07-baad-3200e92d7497:3646:1869685707522944:0@lo:400: 00000100:00100000:0.0:1783071332.676159:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071332.676202:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707522944 00000100:00100000:0.0:1783071332.676207:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707522944 00000100:00100000:0.0:1783071332.676238:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1783071332.676245:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07694050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+18:3646:x1869685707522944:12345-0@lo:400: 00000100:00100000:0.0:1783071332.676286:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07694050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+18:3646:x1869685707522944:12345-0@lo:400: Request processed in 41us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071332.676294:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1783071332.676345:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3b4db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:feaa1501-b927-4e07-baad-3200e92d7497:3646:1869685707522944:0@lo:400: 00000100:00100000:3.0:1783071332.676490:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3b4d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707523200:0@lo:400: 00000100:00100000:3.0:1783071332.676521:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071332.676540:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783071332.676545:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3b4d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869685707523072:0@lo:400: 00000100:00100000:3.0:1783071332.676569:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071332.676613:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707523200 00000100:00100000:3.0:1783071332.676618:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707523200 00000100:00100000:3.0:1783071332.676639:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783071332.676645:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3b4dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707523200:12345-0@lo:400: 00000100:00100000:3.0:1783071332.676682:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3b4dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707523200:12345-0@lo:400: Request processed in 37us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071332.676689:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783071332.676711:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707523072 00000100:00100000:3.0:1783071332.676715:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707523072 00000100:00100000:3.0:1783071332.676739:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783071332.676745:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3b4d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869685707523072:12345-0@lo:400: 00000100:00100000:3.0:1783071332.676777:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3b4d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869685707523072:12345-0@lo:400: Request processed in 31us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071332.676783:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1783071332.676811:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f8b3b4d8e00 x1869685707523072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071332.676833:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3b4d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869685707523072:0@lo:400: 00000100:00100000:3.0:1783071332.676845:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3b4d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707523200:0@lo:400: 00000100:00100000:3.0:1783071332.676868:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3b4db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869685707523328:0@lo:400: 00000100:00100000:3.0:1783071332.676892:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071332.676935:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707523328 00000100:00100000:3.0:1783071332.676939:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707523328 00000100:00100000:3.0:1783071332.676961:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783071332.676966:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3b4d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1869685707523328:12345-0@lo:400: 00000100:00100000:3.0:1783071332.677000:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3b4d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1869685707523328:12345-0@lo:400: Request processed in 33us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071332.677006:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1783071332.678329:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f8b3b4db800 x1869685707523328/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071332.678344:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3b4db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869685707523328:0@lo:400: 00000020:01000004:1.0:1783071332.712091:0:8423:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:1.0:1783071332.712095:0:8423:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1783071332.712097:0:8423:0:(obd_mount.c:920:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1783071332.712233:0:8423:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8f8b069b2000 00000020:01000004:1.0:1783071332.712252:0:8423:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1783071332.712265:0:8423:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1783071332.712280:0:8423:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8f8b078e3380) 00000020:00000080:1.0:1783071332.712302:0:8423:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1783071332.764029:0:8423:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1783071332.764085:0:8423:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:2.0:1783071332.784907:0:8423:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1783071332.785146:0:8423:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1783071332.785158:0:8423:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1783071332.785169:0:8423:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x6b58994c2cbdbd4c 00000020:01000004:2.0:1783071332.785176:0:8423:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1783071332.785198:0:8423:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.204.138@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1783071332.785201:0:8423:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.138@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1783071332.785207:0:8423:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1783071332.785212:0:8423:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1783071332.785223:0:8423:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8f8b34570000) 00000020:00000080:2.0:1783071332.785235:0:8423:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:2.0:1783071332.786629:0:8423:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783071332.786794:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1783071332.786800:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1783071332.788295:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1783071332.788305:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1783071332.790765:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1783071332.790775:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1783071332.792566:0:8423:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783071332.792729:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1783071332.792735:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1783071332.793447:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1783071332.793454:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1783071332.832183:0:8423:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783071332.833154:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1783071332.833161:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1783071332.837054:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1783071332.837069:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1783071332.843441:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1783071332.843457:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1783071332.847036:0:8423:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783071332.847225:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1783071332.847232:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1783071332.848301:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1783071332.848310:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1783071332.911312:0:8423:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783071332.911627:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1783071332.911634:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1783071332.913948:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1783071332.913963:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1783071332.914462:0:8423:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1783071332.914492:0:8423:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1783071332.914500:0:8423:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.138@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1783071332.937957:0:8423:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.138@tcp ctxt 0 is initialized 00000020:01000004:3.0:1783071332.938003:0:8423:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.138@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1783071332.938007:0:8423:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1783071332.938009:0:8423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783071332.938010:0:8423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783071332.938011:0:8423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783071332.938012:0:8423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783071332.938013:0:8423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783071332.938014:0:8423:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783071332.938016:0:8423:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783071332.938017:0:8423:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783071332.938018:0:8423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783071332.938019:0:8423:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783071332.938022:0:8423:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1783071332.938024:0:8423:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783071332.938025:0:8423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783071332.938027:0:8423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783071332.938028:0:8423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783071332.938029:0:8423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783071332.938030:0:8423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783071332.938031:0:8423:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783071332.938032:0:8423:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783071332.938033:0:8423:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783071332.938033:0:8423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783071332.938034:0:8423:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783071332.938059:0:8423:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1783071332.938076:0:8423:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3b4db800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:8423:1869685707523456:0@lo:253: 00000100:00100000:3.0:1783071332.938156:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071332.938284:0:8423:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b180279c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783071332.938562:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707523456 00000100:00100000:0.0:1783071332.938570:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707523456 00000100:00100000:1.0:1783071332.938748:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783071332.938759:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07696850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+18:8423:x1869685707523456:12345-0@lo:253: 20000000:01000000:1.0:1783071332.938791:0:6510:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1783071332.938796:0:6510:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1783071332.938801:0:6510:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1783071332.938804:0:6510:0:(mgs_llog.c:3853:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1783071332.939503:0:6510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783071332.939612:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1783071332.939624:0:6510:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1783071332.939637:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1783071332.939641:0:6510:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1783071332.939648:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1783071332.939656:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1783071332.939736:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1783071332.939759:0:6510:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.204.138@tcp 20000000:01000000:1.0:1783071332.939761:0:6510:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.204.138@tcp (null) (null) (null) 00000040:00080000:1.0:1783071332.939777:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1783071332.939782:0:6510:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1783071332.939795:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1783071332.939801:0:6510:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.138@tcp (null) (null) 00000040:00080000:1.0:1783071332.939814:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1783071332.939818:0:6510:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1783071332.939826:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1783071332.939834:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1783071332.939877:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:1.0:1783071332.939883:0:6510:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.204.138@tcp 20000000:01000000:1.0:1783071332.939885:0:6510:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.204.138@tcp (null) (null) (null) 00000040:00080000:1.0:1783071332.939891:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:1.0:1783071332.939894:0:6510:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1783071332.939901:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:1.0:1783071332.939903:0:6510:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.204.138@tcp (null) (null) 00000040:00080000:1.0:1783071332.939909:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:1.0:1783071332.939912:0:6510:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1783071332.939938:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:1.0:1783071332.939960:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:1.0:1783071332.940320:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:1.0:1783071332.940332:0:6510:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.204.138@tcp 20000000:01000000:1.0:1783071332.940333:0:6510:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.204.138@tcp (null) (null) (null) 00000040:00080000:1.0:1783071332.940346:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:1.0:1783071332.940351:0:6510:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1783071332.940379:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:1.0:1783071332.940386:0:6510:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.138@tcp (null) (null) 00000040:00080000:1.0:1783071332.940402:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:1.0:1783071332.940408:0:6510:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1783071332.940442:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:1.0:1783071332.940460:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:1.0:1783071332.940472:0:6510:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1783071332.940475:0:6510:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1783071332.940479:0:6510:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1783071332.940523:0:6510:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1783071332.940526:0:6510:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1783071332.941040:0:8442:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 27 marker 18 1->4: lustre sys.timeout 20000000:01000000:3.0:1783071332.941064:0:8442:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 29 marker 18 2->4: lustre sys.timeout 00000040:00080000:3.0:1783071332.941078:0:8442:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1783071332.941278:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:1.0:1783071332.941296:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:1.0:1783071332.941311:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:1.0:1783071332.941319:0:6510:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1783071332.941321:0:6510:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1783071332.941657:0:8443:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:3.0:1783071332.941678:0:8443:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:3.0:1783071332.941694:0:8443:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:1.0:1783071332.941837:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:1.0:1783071332.941856:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:1.0:1783071332.941871:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:1.0:1783071332.941879:0:6510:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1783071332.941881:0:6510:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1783071332.942242:0:8444:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:1.0:1783071332.942262:0:8444:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:1.0:1783071332.942280:0:8444:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1783071332.942647:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1783071332.942667:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1783071332.942693:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1783071332.942703:0:6510:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1783071332.942705:0:6510:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1783071332.943135:0:8445:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1783071332.943307:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1783071332.943327:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1783071332.943342:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 10000000:01000000:3.0:1783071332.943357:0:6510:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1783071332.943503:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f8b014b9600/0x6b58994c2cbdbd5a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071332.943522:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8b01546a00/0x6b58994c2cbdbc26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbc1f expref: 18 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071332.943529:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8b3c460800/0x6b58994c2cbdbc9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbc96 expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071332.943536:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8b014b9200/0x6b58994c2cbdbcd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbcce expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071332.943542:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8b10966600/0x6b58994c2cbdbcf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbcea expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071332.943549:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8b014b8a00/0x6b58994c2cbdbd1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbd14 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071332.943556:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f8b014b9600/0x6b58994c2cbdbd5a lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071332.943598:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8b014b8a00/0x6b58994c2cbdbd1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6b58994c2cbdbd14 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071332.943612:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8b014b8a00/0x6b58994c2cbdbd1b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6b58994c2cbdbd14 expref: 18 pid: 6511 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071332.943633:0:6510:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3b4d8e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1869685707523584:0@lo:104: 00000100:00100000:3.0:1783071332.943702:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783071332.943806:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8b10966600/0x6b58994c2cbdbcf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6b58994c2cbdbcea expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071332.943814:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8b10966600/0x6b58994c2cbdbcf1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6b58994c2cbdbcea expref: 18 pid: 6511 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071332.943823:0:6510:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3b4daa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1869685707523712:0@lo:104: 00000100:00100000:3.0:1783071332.943844:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783071332.944230:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8b014b9200/0x6b58994c2cbdbcd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6b58994c2cbdbcce expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071332.944238:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8b014b9200/0x6b58994c2cbdbcd5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6b58994c2cbdbcce expref: 18 pid: 6510 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071332.944248:0:6510:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3b4d8a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1869685707523840:0@lo:104: 00000100:00100000:3.0:1783071332.944272:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071332.944295:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707523584 00000100:00100000:2.0:1783071332.944302:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707523584 00000100:00100000:2.0:1783071332.944339:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707523712 00000100:00100000:2.0:1783071332.944342:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707523712 00000100:00100000:2.0:1783071332.944356:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783071332.944395:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3b4db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:feaa1501-b927-4e07-baad-3200e92d7497+4:6510:x1869685707523584:12345-0@lo:104: 00010000:00010000:2.0:1783071332.944408:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8f8b10967c00/0x6b58994c2cbdbd14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbd1b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071332.944464:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783071332.944470:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3b4db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:feaa1501-b927-4e07-baad-3200e92d7497+4:6510:x1869685707523584:12345-0@lo:104: Request processed in 106us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071332.944477:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783071332.944493:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783071332.944499:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3b4d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:feaa1501-b927-4e07-baad-3200e92d7497+3:6510:x1869685707523712:12345-0@lo:104: 00010000:00010000:2.0:1783071332.944506:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9e00/0x6b58994c2cbdbcea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbcf1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071332.944533:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783071332.944538:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3b4d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:feaa1501-b927-4e07-baad-3200e92d7497+3:6510:x1869685707523712:12345-0@lo:104: Request processed in 40us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071332.944544:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:2.0:1783071332.944561:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783071332.944574:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8b10967c00/0x6b58994c2cbdbd14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbd1b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071332.944581:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b10967c00 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:2.0:1783071332.944584:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8b10967c00/0x6b58994c2cbdbd14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x6b58994c2cbdbd1b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071332.944593:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8b10967c00/0x6b58994c2cbdbd14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x6b58994c2cbdbd1b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783071332.944600:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8b10967c00/0x6b58994c2cbdbd14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x6b58994c2cbdbd1b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071332.944605:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783071332.944633:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8f8b10967c00/0x6b58994c2cbdbd14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbd1b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071332.944639:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783071332.944656:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8b10967c00/0x6b58994c2cbdbd14 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbd1b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071332.944663:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8b10967c00/0x6b58994c2cbdbd14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbd1b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071332.944675:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783071332.944678:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9e00/0x6b58994c2cbdbcea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbcf1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071332.944684:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b421d9e00 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:2.0:1783071332.944687:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9e00/0x6b58994c2cbdbcea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x6b58994c2cbdbcf1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071332.944703:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9e00/0x6b58994c2cbdbcea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x6b58994c2cbdbcf1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783071332.944710:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9e00/0x6b58994c2cbdbcea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x6b58994c2cbdbcf1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071332.944714:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783071332.944745:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9e00/0x6b58994c2cbdbcea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbcf1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071332.944751:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783071332.944767:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9e00/0x6b58994c2cbdbcea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbcf1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071332.944773:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9e00/0x6b58994c2cbdbcea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbcf1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071332.944783:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071332.944785:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071332.944786:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071332.944806:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b08871880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:feaa1501-b927-4e07-baad-3200e92d7497:3646:1869685707523968:0@lo:103: 00000100:00100000:2.0:1783071332.944844:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071332.944880:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:feaa1501-b927-4e07-baad-3200e92d7497:3647:1869685707524096:0@lo:103: 00000100:00100000:2.0:1783071332.944902:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071332.944946:0:7923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707523968 00000100:00100000:2.0:1783071332.944950:0:7923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707523968 00010000:00010000:2.0:1783071332.944968:0:7923:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8b014b8a00/0x6b58994c2cbdbd1b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbd14 expref: 19 pid: 6511 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071332.944997:0:7923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707524096 00000100:00100000:2.0:1783071332.945001:0:7923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707524096 00010000:00010000:2.0:1783071332.945012:0:7923:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8b10966600/0x6b58994c2cbdbcf1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbcea expref: 20 pid: 6511 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071332.945035:0:7923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783071332.945042:0:7923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01766680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:feaa1501-b927-4e07-baad-3200e92d7497+20:3646:x1869685707523968:12345-0@lo:103: 00010000:00010000:2.0:1783071332.945052:0:7923:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071332.945057:0:7923:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8b014b8a00/0x6b58994c2cbdbd1b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbd14 expref: 20 pid: 6511 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071332.945067:0:7923:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8b014b8a00/0x6b58994c2cbdbd1b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6b58994c2cbdbd14 expref: 20 pid: 6511 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071332.945084:0:7923:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071332.945113:0:7923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01766680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:feaa1501-b927-4e07-baad-3200e92d7497+20:3646:x1869685707523968:12345-0@lo:103: Request processed in 72us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071332.945120:0:7923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783071332.945132:0:7923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783071332.945138:0:7923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01767480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:feaa1501-b927-4e07-baad-3200e92d7497+19:3647:x1869685707524096:12345-0@lo:103: 00010000:00010000:2.0:1783071332.945145:0:7923:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071332.945149:0:7923:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8b10966600/0x6b58994c2cbdbcf1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbcea expref: 19 pid: 6511 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071332.945156:0:7923:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8b10966600/0x6b58994c2cbdbcf1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6b58994c2cbdbcea expref: 19 pid: 6511 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071332.945165:0:7923:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071332.945194:0:7923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01767480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:feaa1501-b927-4e07-baad-3200e92d7497+19:3647:x1869685707524096:12345-0@lo:103: Request processed in 56us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071332.945199:0:7923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783071332.945238:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:feaa1501-b927-4e07-baad-3200e92d7497:3647:1869685707524096:0@lo:103: 00000100:00100000:2.0:1783071332.945264:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b08871880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:feaa1501-b927-4e07-baad-3200e92d7497:3646:1869685707523968:0@lo:103: 00010000:00010000:0.0:1783071332.945766:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071332.946086:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8b3c460800/0x6b58994c2cbdbc9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6b58994c2cbdbc96 expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071332.946098:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8b3c460800/0x6b58994c2cbdbc9d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6b58994c2cbdbc96 expref: 18 pid: 6510 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071332.946108:0:6510:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0178c000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1869685707524224:0@lo:104: 00000100:00100000:3.0:1783071332.946143:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783071332.946221:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8b01546a00/0x6b58994c2cbdbc26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6b58994c2cbdbc1f expref: 18 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071332.946239:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8b01546a00/0x6b58994c2cbdbc26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6b58994c2cbdbc1f expref: 18 pid: 6508 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071332.946248:0:6510:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0178d180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1869685707524352:0@lo:104: 00000100:00100000:3.0:1783071332.946279:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071332.946334:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707523840 00000100:00100000:2.0:1783071332.946341:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707523840 00000100:00100000:2.0:1783071332.946395:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707524224 00000100:00100000:2.0:1783071332.946398:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707524224 00000100:00100000:2.0:1783071332.946411:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783071332.946418:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3b4da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:feaa1501-b927-4e07-baad-3200e92d7497+4:6510:x1869685707523840:12345-0@lo:104: 00010000:00010000:2.0:1783071332.946428:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8f8b01546200/0x6b58994c2cbdbcce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbcd5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071332.946473:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783071332.946479:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3b4da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:feaa1501-b927-4e07-baad-3200e92d7497+4:6510:x1869685707523840:12345-0@lo:104: Request processed in 62us (2206us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071332.946485:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783071332.946498:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783071332.946503:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0178ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:feaa1501-b927-4e07-baad-3200e92d7497+3:6510:x1869685707524224:12345-0@lo:104: 00010000:00010000:2.0:1783071332.946509:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9000/0x6b58994c2cbdbc96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbc9d expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071332.946537:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783071332.946543:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0178ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:feaa1501-b927-4e07-baad-3200e92d7497+3:6510:x1869685707524224:12345-0@lo:104: Request processed in 40us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071332.946548:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1783071332.946568:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783071332.946573:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8b01546200/0x6b58994c2cbdbcce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbcd5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071332.946580:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b01546200 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:2.0:1783071332.946584:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8b01546200/0x6b58994c2cbdbcce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6b58994c2cbdbcd5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071332.946592:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8b01546200/0x6b58994c2cbdbcce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6b58994c2cbdbcd5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783071332.946598:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8b01546200/0x6b58994c2cbdbcce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6b58994c2cbdbcd5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071332.946603:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783071332.946625:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8f8b01546200/0x6b58994c2cbdbcce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbcd5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071332.946632:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783071332.946644:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8b01546200/0x6b58994c2cbdbcce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbcd5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071332.946651:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8b01546200/0x6b58994c2cbdbcce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbcd5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071332.946662:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783071332.946665:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9000/0x6b58994c2cbdbc96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbc9d expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071332.946671:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b421d9000 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:2.0:1783071332.946673:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9000/0x6b58994c2cbdbc96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6b58994c2cbdbc9d expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071332.946686:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9000/0x6b58994c2cbdbc96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6b58994c2cbdbc9d expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783071332.946692:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9000/0x6b58994c2cbdbc96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6b58994c2cbdbc9d expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071332.946699:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783071332.946712:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9000/0x6b58994c2cbdbc96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbc9d expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071332.946717:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783071332.946728:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9000/0x6b58994c2cbdbc96 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbc9d expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071332.946735:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9000/0x6b58994c2cbdbc96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbc9d expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071332.946753:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071332.946755:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071332.946756:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071332.946768:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:feaa1501-b927-4e07-baad-3200e92d7497:3648:1869685707524480:0@lo:103: 00000100:00100000:2.0:1783071332.946793:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071332.946822:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:feaa1501-b927-4e07-baad-3200e92d7497:3645:1869685707524608:0@lo:103: 00000100:00100000:2.0:1783071332.946845:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071332.946872:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707524480 00000100:00100000:2.0:1783071332.946875:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707524480 00010000:00010000:2.0:1783071332.946890:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8b014b9200/0x6b58994c2cbdbcd5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbcce expref: 19 pid: 6510 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071332.946930:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707524608 00000100:00100000:2.0:1783071332.946934:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707524608 00010000:00010000:2.0:1783071332.946945:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8b3c460800/0x6b58994c2cbdbc9d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbc96 expref: 20 pid: 6510 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071332.946960:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783071332.946965:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01764a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:feaa1501-b927-4e07-baad-3200e92d7497+20:3648:x1869685707524480:12345-0@lo:103: 00010000:00010000:2.0:1783071332.946985:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071332.946991:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8b014b9200/0x6b58994c2cbdbcd5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbcce expref: 20 pid: 6510 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071332.947000:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8b014b9200/0x6b58994c2cbdbcd5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6b58994c2cbdbcce expref: 20 pid: 6510 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071332.947015:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071332.947043:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01764a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:feaa1501-b927-4e07-baad-3200e92d7497+20:3648:x1869685707524480:12345-0@lo:103: Request processed in 78us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071332.947050:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783071332.947062:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783071332.947068:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01765180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:feaa1501-b927-4e07-baad-3200e92d7497+19:3645:x1869685707524608:12345-0@lo:103: 00010000:00010000:2.0:1783071332.947075:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071332.947080:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8b3c460800/0x6b58994c2cbdbc9d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbc96 expref: 19 pid: 6510 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071332.947088:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8b3c460800/0x6b58994c2cbdbc9d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6b58994c2cbdbc96 expref: 19 pid: 6510 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071332.947097:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071332.947129:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01765180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:feaa1501-b927-4e07-baad-3200e92d7497+19:3645:x1869685707524608:12345-0@lo:103: Request processed in 61us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071332.947136:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783071332.947180:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:feaa1501-b927-4e07-baad-3200e92d7497:3645:1869685707524608:0@lo:103: 00000100:00100000:2.0:1783071332.947202:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:feaa1501-b927-4e07-baad-3200e92d7497:3648:1869685707524480:0@lo:103: 00010000:00010000:0.0:1783071332.947449:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071332.947645:0:6510:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b0729b540 going to sleep for 11 seconds 00010000:00010000:3.0:1783071332.947660:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b014b8a00/0x6b58994c2cbdbd1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6b58994c2cbdbd14 expref: 18 pid: 6511 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071332.947671:0:6510:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3b4d8e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1869685707523584:0@lo:104: 00010000:00010000:3.0:1783071332.947681:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b10966600/0x6b58994c2cbdbcf1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6b58994c2cbdbcea expref: 17 pid: 6511 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071332.947689:0:6510:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3b4daa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1869685707523712:0@lo:104: 00010000:00010000:3.0:1783071332.947696:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b014b9200/0x6b58994c2cbdbcd5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6b58994c2cbdbcce expref: 16 pid: 6510 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071332.947703:0:6510:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3b4d8a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1869685707523840:0@lo:104: 00010000:00010000:3.0:1783071332.947711:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b3c460800/0x6b58994c2cbdbc9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6b58994c2cbdbc96 expref: 15 pid: 6510 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071332.947719:0:6510:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0178c000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1869685707524224:0@lo:104: 00000100:00100000:2.0:1783071332.948064:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707524352 00000100:00100000:2.0:1783071332.948071:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707524352 00000100:00100000:2.0:1783071332.948100:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783071332.948107:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0178e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:feaa1501-b927-4e07-baad-3200e92d7497+3:6510:x1869685707524352:12345-0@lo:104: 00010000:00010000:2.0:1783071332.948117:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8f8b00030c00/0x6b58994c2cbdbc1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbc26 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071332.948178:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783071332.948185:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0178e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:feaa1501-b927-4e07-baad-3200e92d7497+3:6510:x1869685707524352:12345-0@lo:104: Request processed in 78us (1904us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071332.948191:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1783071332.948238:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783071332.948244:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8b00030c00/0x6b58994c2cbdbc1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbc26 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071332.948251:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b00030c00 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:0.0:1783071332.948272:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8b00030c00/0x6b58994c2cbdbc1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6b58994c2cbdbc26 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071332.948280:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8b00030c00/0x6b58994c2cbdbc1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6b58994c2cbdbc26 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783071332.948287:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8b00030c00/0x6b58994c2cbdbc1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6b58994c2cbdbc26 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783071332.948293:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783071332.948327:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8f8b00030c00/0x6b58994c2cbdbc1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbc26 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071332.948334:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783071332.948345:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8b00030c00/0x6b58994c2cbdbc1f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbc26 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071332.948352:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8b00030c00/0x6b58994c2cbdbc1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbc26 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071332.948393:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071332.948395:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071332.948397:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071332.948531:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783071332.948543:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b078d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:feaa1501-b927-4e07-baad-3200e92d7497:3645:1869685707524736:0@lo:103: 00000100:00100000:2.0:1783071332.948580:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071332.948609:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707524736 00000100:00100000:2.0:1783071332.948613:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707524736 00010000:00010000:2.0:1783071332.948628:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8b01546a00/0x6b58994c2cbdbc26 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbc1f expref: 15 pid: 6508 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071332.948647:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783071332.948653:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab8f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:feaa1501-b927-4e07-baad-3200e92d7497+15:3645:x1869685707524736:12345-0@lo:103: 00010000:00010000:2.0:1783071332.948663:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071332.948674:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8b01546a00/0x6b58994c2cbdbc26 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbc1f expref: 15 pid: 6508 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071332.948684:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8b01546a00/0x6b58994c2cbdbc26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6b58994c2cbdbc1f expref: 15 pid: 6508 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071332.948698:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f8b014b9600/0x6b58994c2cbdbd5a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071332.948705:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b014b9600/0x6b58994c2cbdbd5a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071332.948719:0:6502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f8b014b9600/0x6b58994c2cbdbd5a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071332.948726:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f8b014b9600/0x6b58994c2cbdbd5a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071332.948733:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f8b014b9600/0x6b58994c2cbdbd5a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071332.950351:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f8b014b9600/0x6b58994c2cbdbd5a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071332.950360:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b014b9600 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:2.0:1783071332.950386:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f8b014b9600/0x6b58994c2cbdbd5a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071332.950397:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f8b014b9600/0x6b58994c2cbdbd5a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071332.950411:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f8b014b9600/0x6b58994c2cbdbd5a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071332.950442:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071332.950524:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab8f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:feaa1501-b927-4e07-baad-3200e92d7497+15:3645:x1869685707524736:12345-0@lo:103: Request processed in 1868us (1940us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071332.950534:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783071332.950677:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b078d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:feaa1501-b927-4e07-baad-3200e92d7497:3645:1869685707524736:0@lo:103: 00010000:00010000:2.0:1783071332.951618:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b01546a00/0x6b58994c2cbdbc26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6b58994c2cbdbc1f expref: 14 pid: 6508 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071332.951632:0:6510:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0178d180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1869685707524352:0@lo:104: 00010000:00010000:2.0:1783071332.951662:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f8b014b9600/0x6b58994c2cbdbd5a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071332.951672:0:6510:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f8b014b9600/0x6b58994c2cbdbd5a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071332.951679:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f8b014b9600/0x6b58994c2cbdbd5a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071332.951686:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b014b9600/0x6b58994c2cbdbd5a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783071332.951701:0:6510:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1783071332.956543:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07696850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+13:8423:x1869685707523456:12345-0@lo:253: Request processed in 17777us (18377us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071332.956558:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783071332.956571:0:8423:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3b4db800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:8423:1869685707523456:0@lo:253: 10000000:01000000:2.0:1783071332.956590:0:8423:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1783071332.956594:0:8423:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783071332.956596:0:8423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783071332.956598:0:8423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783071332.956599:0:8423:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1783071332.956600:0:8423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783071332.956602:0:8423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783071332.956613:0:8423:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783071332.956615:0:8423:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1783071332.956616:0:8423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783071332.956618:0:8423:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1783071332.956637:0:8423:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8f8b069b2000 from lustre-OST0000 10000000:01000000:2.0:1783071332.956668:0:8423:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1783071332.956672:0:8423:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1783071332.956680:0:8423:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8f8b06c74d40 local copy 10000000:01000000:2.0:1783071332.956685:0:8423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1783071332.956723:0:8423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b10967a00/0x6b58994c2cbdbd61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071332.956735:0:8423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.138@tcp lock: ffff8f8b10967a00/0x6b58994c2cbdbd61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071332.956745:0:8423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8b10967a00/0x6b58994c2cbdbd61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071332.956764:0:8423:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01766680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:8423:1869685707524864:0@lo:101: 00000100:00100000:2.0:1783071332.956804:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071332.956843:0:8423:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b2fd6c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783071332.956898:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707524864 00000100:00100000:0.0:1783071332.956904:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707524864 00000100:00100000:0.0:1783071332.956960:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1783071332.956970:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07695050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+13:8423:x1869685707524864:12345-0@lo:101: 00010000:00010000:0.0:1783071332.956982:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071332.956995:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b3c460400/0x6b58994c2cbdbd68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdbd61 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071332.957027:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b3c460400/0x6b58994c2cbdbd68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdbd61 expref: 14 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071332.957038:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b3c460400/0x6b58994c2cbdbd68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbd61 expref: 14 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071332.957047:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b3c460400, rc 0) 00000100:00100000:0.0:1783071332.957088:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07695050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+14:8423:x1869685707524864:12345-0@lo:101: Request processed in 119us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071332.957094:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1783071332.957156:0:8423:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01766680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:8423:1869685707524864:0@lo:101: 00010000:00010000:2.0:1783071332.957168:0:8423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8b10967a00/0x6b58994c2cbdbd61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x6b58994c2cbdbd68 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071332.957176:0:8423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8b10967a00/0x6b58994c2cbdbd61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x6b58994c2cbdbd68 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071332.957256:0:8423:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01766680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:8423:1869685707524992:0@lo:501: 00000100:00100000:2.0:1783071332.957282:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071332.957306:0:8423:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b2fd6c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071332.957354:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707524992 00000100:00100000:3.0:1783071332.957359:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707524992 00000100:00100000:3.0:1783071332.957417:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1783071332.957424:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+14:8423:x1869685707524992:12345-0@lo:501: 00000100:00100000:3.0:1783071332.957488:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+14:8423:x1869685707524992:12345-0@lo:501: Request processed in 64us (204us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783071332.957499:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1783071332.957566:0:8423:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01766680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:8423:1869685707524992:0@lo:501: 10000000:01000000:2.0:1783071332.957577:0:8423:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.138@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1783071332.957593:0:8423:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.138@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1783071332.957599:0:8423:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b10967a00/0x6b58994c2cbdbd61 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x6b58994c2cbdbd68 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071332.957607:0:8423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b10967a00/0x6b58994c2cbdbd61 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x6b58994c2cbdbd68 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071332.957614:0:8423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.138@tcp lock: ffff8f8b10967a00/0x6b58994c2cbdbd61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x6b58994c2cbdbd68 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071332.957626:0:8423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1783071332.957646:0:8423:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f8b069b2000 10000000:01000000:2.0:1783071332.957651:0:8423:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1783071332.957655:0:8423:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1783071332.957657:0:8423:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783071332.957661:0:8423:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1783071332.957663:0:8423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1783071332.957675:0:8423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b10967000/0x6b58994c2cbdbd6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071332.957682:0:8423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8b10967000/0x6b58994c2cbdbd6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071332.957691:0:8423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8b10967000/0x6b58994c2cbdbd6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071332.957701:0:8423:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01766680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:8423:1869685707525120:0@lo:101: 00000100:00100000:2.0:1783071332.957724:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071332.957758:0:8423:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b2fd6cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1783071332.957799:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707525120 00000100:00100000:3.0:1783071332.957803:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707525120 00000100:00100000:3.0:1783071332.957821:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1783071332.957827:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+14:8423:x1869685707525120:12345-0@lo:101: 00010000:00010000:3.0:1783071332.957835:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071332.957843:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b014b9400/0x6b58994c2cbdbd76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdbd6f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071332.957858:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b014b9400/0x6b58994c2cbdbd76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdbd6f expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071332.957865:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b014b9400/0x6b58994c2cbdbd76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbd6f expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071332.957871:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b014b9400, rc 0) 00000100:00100000:3.0:1783071332.957906:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+15:8423:x1869685707525120:12345-0@lo:101: Request processed in 79us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071332.957912:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00010000:0.0:1783071332.957987:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783071332.957993:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8b10967a00/0x6b58994c2cbdbd61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x6b58994c2cbdbd68 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071332.958000:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b10967a00 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:0.0:1783071332.958004:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8b10967a00/0x6b58994c2cbdbd61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x6b58994c2cbdbd68 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071332.958013:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8b10967a00/0x6b58994c2cbdbd61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x6b58994c2cbdbd68 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783071332.958020:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8b10967a00/0x6b58994c2cbdbd61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x6b58994c2cbdbd68 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783071332.958025:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783071332.958044:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8f8b10967a00/0x6b58994c2cbdbd61 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x6b58994c2cbdbd68 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071332.958050:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783071332.958081:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8b10967a00/0x6b58994c2cbdbd61 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x6b58994c2cbdbd68 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071332.958088:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8b10967a00/0x6b58994c2cbdbd61 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x6b58994c2cbdbd68 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071332.958099:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071332.958101:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071332.958102:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071332.958139:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b078d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:feaa1501-b927-4e07-baad-3200e92d7497:3647:1869685707525248:0@lo:103: 00000100:00100000:3.0:1783071332.958168:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071332.958251:0:8423:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01766680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:8423:1869685707525120:0@lo:101: 00010000:00010000:2.0:1783071332.958262:0:8423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8b10967000/0x6b58994c2cbdbd6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbd76 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071332.958270:0:8423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8b10967000/0x6b58994c2cbdbd6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdbd76 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071332.958326:0:8423:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01766680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:8423:1869685707525376:0@lo:501: 00000100:00100000:2.0:1783071332.958350:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071332.958393:0:8423:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b2fd6cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1783071332.958445:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707525376 00000100:00100000:3.0:1783071332.958450:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707525376 00000100:00100000:3.0:1783071332.958481:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1783071332.958489:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+15:8423:x1869685707525376:12345-0@lo:501: 00000100:00100000:3.0:1783071332.958575:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+15:8423:x1869685707525376:12345-0@lo:501: Request processed in 87us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071332.958592:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1783071332.958655:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707525248 00000100:00100000:0.0:1783071332.958660:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707525248 00000100:00100000:0.0:1783071332.958695:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783071332.958702:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0178fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:feaa1501-b927-4e07-baad-3200e92d7497+15:3647:x1869685707525248:12345-0@lo:103: 00010000:00010000:0.0:1783071332.958711:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071332.958723:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b3c460400/0x6b58994c2cbdbd68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6b58994c2cbdbd61 expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071332.958732:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071332.958758:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0178fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:feaa1501-b927-4e07-baad-3200e92d7497+14:3647:x1869685707525248:12345-0@lo:103: Request processed in 58us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071332.958765:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783071332.958816:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b078d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:feaa1501-b927-4e07-baad-3200e92d7497:3647:1869685707525248:0@lo:103: 00000100:00100000:2.0:1783071332.958876:0:8423:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01766680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:8423:1869685707525376:0@lo:501: 00000100:00100000:2.0:1783071332.958901:0:8423:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01766680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:8423:1869685707525504:0@lo:503: 00000100:00100000:2.0:1783071332.958951:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071332.958980:0:8423:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b2fd6cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1783071332.959018:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707525504 00000100:00100000:3.0:1783071332.959022:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707525504 00000100:00100000:3.0:1783071332.959049:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1783071332.959055:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+14:8423:x1869685707525504:12345-0@lo:503: 00000100:00100000:3.0:1783071332.959138:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+14:8423:x1869685707525504:12345-0@lo:503: Request processed in 83us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071332.959145:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1783071332.959210:0:8423:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01766680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:8423:1869685707525504:0@lo:503: 00000040:00080000:0.0:1783071332.959544:0:8423:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783071332.959603:0:8423:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b078d8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:8423:1869685707525632:0@lo:502: 00000100:00100000:0.0:1783071332.959640:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071332.959806:0:8423:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b06c483c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071332.965998:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707525632 00000100:00100000:3.0:1783071332.966015:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707525632 00000100:00100000:3.0:1783071332.966074:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1783071332.966085:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+14:8423:x1869685707525632:12345-0@lo:502: 00000100:00100000:3.0:1783071332.966270:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+14:8423:x1869685707525632:12345-0@lo:502: Request processed in 187us (6628us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071332.966278:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1783071332.966358:0:8423:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b078d8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:8423:1869685707525632:0@lo:502: 00000040:00080000:3.0:1783071332.966668:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1783071332.966701:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1783071332.966715:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1783071332.966727:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1783071332.966747:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1783071332.966762:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1783071332.966795:0:8423:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0178d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:8423:1869685707525760:0@lo:502: 00000100:00100000:3.0:1783071332.966844:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071332.966877:0:8423:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b0729b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071332.966900:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707525760 00000100:00100000:3.0:1783071332.966904:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707525760 00000100:00100000:3.0:1783071332.966944:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1783071332.966950:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+14:8423:x1869685707525760:12345-0@lo:502: 00000100:00100000:3.0:1783071332.967562:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+14:8423:x1869685707525760:12345-0@lo:502: Request processed in 609us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071332.967570:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1783071332.967622:0:8423:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0178d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:8423:1869685707525760:0@lo:502: 00000040:00080000:3.0:1783071332.967673:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1783071332.967683:0:8423:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1783071332.969443:0:8446:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783071332.969454:0:8446:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1783071332.969478:0:8446:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783071332.969481:0:8446:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1783071332.969487:0:8446:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783071332.969513:0:8446:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8f8a017dcd40) 00000020:00000080:1.0:1783071332.969539:0:8446:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:1.0:1783071332.969546:0:8446:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1783071332.969614:0:8446:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f8b069b2000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1783071332.969622:0:8446:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1783071332.969633:0:8446:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x6b58994c2cbdbd84 00010000:00010000:1.0:1783071332.976540:0:8446:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:1.0:1783071332.977529:0:8446:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1783071332.980983:0:8446:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1783071332.981410:0:8446:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1783071332.986741:0:8446:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1783071332.986959:0:8446:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1783071332.993727:0:8446:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1783071332.996567:0:8446:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1783071332.996579:0:8446:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783071332.996585:0:8446:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071332.996588:0:8446:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1783071332.996591:0:8446:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783071332.996595:0:8446:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071332.996597:0:8446:0:(obd_config.c:1561:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783071332.996600:0:8446:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783071332.996602:0:8446:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1783071332.996622:0:8446:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783071332.996625:0:8446:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071332.996627:0:8446:0:(obd_config.c:1561:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:3.0:1783071332.996630:0:8446:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1783071332.998544:0:8423:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1783071332.998586:0:8423:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1783071332.998602:0:8423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b10967000/0x6b58994c2cbdbd6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbd76 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071332.998616:0:8423:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8b10967000/0x6b58994c2cbdbd6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbd76 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783071332.998625:0:8423:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8f8b069b2000 from 1 10000000:01000000:1.0:1783071332.998628:0:8423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783071332.998667:0:8423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9c00/0x6b58994c2cbdbd8b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071332.998675:0:8423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9c00/0x6b58994c2cbdbd8b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071332.998685:0:8423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9c00/0x6b58994c2cbdbd8b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071332.998707:0:8423:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b0ab60e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:8423:1869685707525888:0@lo:101: 00000100:00100000:1.0:1783071332.998774:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071332.998826:0:8423:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b04ec2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783071333.001277:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707525888 00000100:00100000:0.0:1783071333.001291:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707525888 00000100:00100000:0.0:1783071333.001349:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1783071333.001388:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+14:8423:x1869685707525888:12345-0@lo:101: 00010000:00010000:0.0:1783071333.001406:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071333.001424:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b3c460400/0x6b58994c2cbdbd92 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdbd8b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071333.001453:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b3c460400/0x6b58994c2cbdbd92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdbd8b expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071333.001465:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b3c460400/0x6b58994c2cbdbd92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbd8b expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071333.001474:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b3c460400, rc 0) 00000100:00100000:0.0:1783071333.001555:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+15:8423:x1869685707525888:12345-0@lo:101: Request processed in 190us (2781us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071333.001563:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1783071333.001666:0:8423:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b0ab60e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:8423:1869685707525888:0@lo:101: 00010000:00010000:2.0:1783071333.001683:0:8423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9c00/0x6b58994c2cbdbd8b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbd92 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071333.001692:0:8423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9c00/0x6b58994c2cbdbd8b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdbd92 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071333.001807:0:8423:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01767480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:8423:1869685707526016:0@lo:501: 00000100:00100000:2.0:1783071333.001842:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071333.001880:0:8423:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b2fd6cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1783071333.001958:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707526016 00000100:00100000:1.0:1783071333.001963:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707526016 00000100:00100000:1.0:1783071333.001998:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1783071333.002006:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+15:8423:x1869685707526016:12345-0@lo:501: 00000100:00100000:1.0:1783071333.002100:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+15:8423:x1869685707526016:12345-0@lo:501: Request processed in 95us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071333.002107:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1783071333.002220:0:8423:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01767480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:8423:1869685707526016:0@lo:501: 00000100:00100000:2.0:1783071333.002246:0:8423:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01767480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:8423:1869685707526144:0@lo:503: 00000100:00100000:2.0:1783071333.002288:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071333.002310:0:8423:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b2fd6cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1783071333.002355:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707526144 00000100:00100000:0.0:1783071333.002360:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707526144 00000100:00100000:0.0:1783071333.002406:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1783071333.002413:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+15:8423:x1869685707526144:12345-0@lo:503: 00000100:00100000:0.0:1783071333.002489:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+15:8423:x1869685707526144:12345-0@lo:503: Request processed in 76us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071333.002495:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1783071333.002581:0:8423:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01767480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:8423:1869685707526144:0@lo:503: 00000040:00080000:2.0:1783071333.002798:0:8423:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783071333.002870:0:8423:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01767480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:8423:1869685707526272:0@lo:502: 00000100:00100000:2.0:1783071333.002904:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071333.002937:0:8423:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b2fd6cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1783071333.002983:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707526272 00000100:00100000:0.0:1783071333.003002:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707526272 00000100:00100000:0.0:1783071333.003031:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1783071333.003038:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+15:8423:x1869685707526272:12345-0@lo:502: 00000100:00100000:0.0:1783071333.003115:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+15:8423:x1869685707526272:12345-0@lo:502: Request processed in 77us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071333.003131:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1783071333.003258:0:8423:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01767480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:8423:1869685707526272:0@lo:502: 00000040:00080000:2.0:1783071333.003476:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1783071333.003501:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1783071333.003521:0:8423:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01767480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:8423:1869685707526400:0@lo:502: 00000100:00100000:2.0:1783071333.003555:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071333.003567:0:8423:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b2fd6cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1783071333.003634:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707526400 00000100:00100000:0.0:1783071333.003638:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707526400 00000100:00100000:0.0:1783071333.004981:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1783071333.004995:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+15:8423:x1869685707526400:12345-0@lo:502: 00000100:00100000:0.0:1783071333.005128:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+15:8423:x1869685707526400:12345-0@lo:502: Request processed in 137us (1572us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071333.005135:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1783071333.006402:0:8423:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01767480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:8423:1869685707526400:0@lo:502: 00000040:00080000:2.0:1783071333.006489:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1783071333.006502:0:8423:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1783071333.007242:0:8450:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783071333.007252:0:8450:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783071333.007254:0:8450:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1783071333.007262:0:8450:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f8b069b2000 00000020:00000080:0.0:1783071333.007264:0:8450:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783071333.007275:0:8450:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783071333.007278:0:8450:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783071333.007280:0:8450:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1783071333.007282:0:8450:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1783071333.007551:0:8423:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1783071333.007580:0:8423:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783071333.007636:0:8423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9c00/0x6b58994c2cbdbd8b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbd92 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071333.007648:0:8423:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9c00/0x6b58994c2cbdbd8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbd92 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783071333.007713:0:8423:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1783071333.007717:0:8423:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f8b069b2000 10000000:01000000:3.0:1783071333.007720:0:8423:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f8b069b2000 10000000:01000000:3.0:1783071333.007725:0:8423:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783071333.007730:0:8423:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8f8b069b2000 from 1 10000000:01000000:3.0:1783071333.007733:0:8423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783071333.007779:0:8423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b014b9200/0x6b58994c2cbdbd99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071333.007788:0:8423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8b014b9200/0x6b58994c2cbdbd99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071333.007798:0:8423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8b014b9200/0x6b58994c2cbdbd99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071333.007819:0:8423:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0178d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:8423:1869685707526528:0@lo:101: 00000100:00100000:3.0:1783071333.007884:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071333.007931:0:8423:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b0729ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1783071333.008138:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707526528 00000100:00100000:0.0:1783071333.008145:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707526528 00000100:00100000:0.0:1783071333.008198:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1783071333.008208:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+15:8423:x1869685707526528:12345-0@lo:101: 00010000:00010000:0.0:1783071333.008222:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071333.008234:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b3c460c00/0x6b58994c2cbdbda0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdbd99 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071333.008257:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b3c460c00/0x6b58994c2cbdbda0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdbd99 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071333.008269:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b3c460c00/0x6b58994c2cbdbda0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbd99 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071333.008286:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b3c460c00, rc 0) 00000100:00100000:0.0:1783071333.008336:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+16:8423:x1869685707526528:12345-0@lo:101: Request processed in 128us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071333.008343:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1783071333.008786:0:8423:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0178d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:8423:1869685707526528:0@lo:101: 00010000:00010000:3.0:1783071333.008800:0:8423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8b014b9200/0x6b58994c2cbdbd99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbda0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071333.008809:0:8423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8b014b9200/0x6b58994c2cbdbd99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdbda0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071333.008888:0:8423:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0178d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:8423:1869685707526656:0@lo:501: 00000100:00100000:3.0:1783071333.009184:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071333.009222:0:8423:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b0729ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1783071333.009458:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707526656 00000100:00100000:1.0:1783071333.009464:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707526656 00000100:00100000:1.0:1783071333.009501:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1783071333.009509:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+16:8423:x1869685707526656:12345-0@lo:501: 00000100:00100000:1.0:1783071333.009619:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+16:8423:x1869685707526656:12345-0@lo:501: Request processed in 111us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071333.009627:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1783071333.009827:0:8423:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0178d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:8423:1869685707526656:0@lo:501: 00000100:00100000:3.0:1783071333.009859:0:8423:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0178d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:8423:1869685707526784:0@lo:503: 00000100:00100000:3.0:1783071333.009898:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071333.009926:0:8423:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b0729ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1783071333.010149:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707526784 00000100:00100000:1.0:1783071333.010154:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707526784 00000100:00100000:1.0:1783071333.010186:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1783071333.010194:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+16:8423:x1869685707526784:12345-0@lo:503: 00000100:00100000:1.0:1783071333.010277:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+16:8423:x1869685707526784:12345-0@lo:503: Request processed in 83us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071333.010284:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1783071333.010408:0:8423:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0178d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:8423:1869685707526784:0@lo:503: 00000040:00080000:3.0:1783071333.010649:0:8423:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783071333.010712:0:8423:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0178d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:8423:1869685707526912:0@lo:502: 00000100:00100000:3.0:1783071333.010745:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071333.010769:0:8423:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b0729ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1783071333.010826:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707526912 00000100:00100000:0.0:1783071333.010831:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707526912 00000100:00100000:0.0:1783071333.010854:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1783071333.010860:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+16:8423:x1869685707526912:12345-0@lo:502: 00000100:00100000:0.0:1783071333.010954:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+16:8423:x1869685707526912:12345-0@lo:502: Request processed in 93us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071333.010960:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1783071333.011123:0:8423:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0178d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:8423:1869685707526912:0@lo:502: 00000040:00080000:3.0:1783071333.011302:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1783071333.011328:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1783071333.011343:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1783071333.011356:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1783071333.011487:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1783071333.011503:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1783071333.011518:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1783071333.011531:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1783071333.011543:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1783071333.011572:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1783071333.011585:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1783071333.011596:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1783071333.011608:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1783071333.011620:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1783071333.011631:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1783071333.011644:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1783071333.011658:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1783071333.011670:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1783071333.011694:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1783071333.011706:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1783071333.011718:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1783071333.011730:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1783071333.011745:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1783071333.011759:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1783071333.011771:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1783071333.011795:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1783071333.011809:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1783071333.011822:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1783071333.011834:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1783071333.011846:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:3.0:1783071333.011858:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:3.0:1783071333.011871:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:3.0:1783071333.011883:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1783071333.011893:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1783071333.011906:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1783071333.011935:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1783071333.011950:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:3.0:1783071333.011978:0:8423:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0178d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:8423:1869685707527040:0@lo:502: 00000100:00100000:3.0:1783071333.014249:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071333.014345:0:8423:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b0729ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1783071333.017246:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707527040 00000100:00100000:0.0:1783071333.017271:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707527040 00000100:00100000:0.0:1783071333.017335:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1783071333.017344:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+16:8423:x1869685707527040:12345-0@lo:502: 00000100:00100000:0.0:1783071333.017546:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+16:8423:x1869685707527040:12345-0@lo:502: Request processed in 202us (3303us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071333.017553:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1783071333.017748:0:8423:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0178d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:8423:1869685707527040:0@lo:502: 00000040:00080000:3.0:1783071333.017830:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1783071333.017844:0:8423:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1783071333.018609:0:8451:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1783071333.018626:0:8451:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8f8a017d99c0) 00000020:00000080:1.0:1783071333.018648:0:8451:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1783071333.018825:0:8451:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f8b069b2000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1783071333.018830:0:8451:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f8b069b2000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1783071333.018832:0:8451:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8f8b069b2000 3 00010000:00080000:1.0:1783071333.018871:0:8451:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f8a01e4c800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.138@tcp at head 00010000:00010000:1.0:1783071333.020940:0:8451:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:1.0:1783071333.022649:0:8451:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1783071333.022705:0:8451:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783071333.022719:0:8451:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x6b58994c2cbdbdae 00000100:00080000:1.0:1783071333.022729:0:8451:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783071333.022736:0:8451:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8f8a01e4c800 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:1.0:1783071333.022770:0:8451:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8b0ab61c00 x1869685707527168/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783071333.022799:0:8451:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1783071333.022946:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b0ab61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1869685707527168:0@lo:38: 00000100:00100000:0.0:1783071333.023035:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071333.023164:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707527168 00000100:00100000:0.0:1783071333.023172:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707527168 00000100:00100000:0.0:1783071333.023206:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783071333.023214:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b078da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1869685707527168:12345-0@lo:38: 00010000:00080000:0.0:1783071333.023238:0:6516:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 234 last 0 00000020:00000080:0.0:1783071333.023285:0:6516:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x6b58994c2cbdbdb5 00000004:00100000:0.0:1783071333.023301:0:6516:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783071333.023338:0:6516:0:(import.c:65:import_set_state_nolock()) ffff8f8a0177b800 : changing import state from RECOVER to FULL 00000020:01000004:2.0:1783071333.023416:0:8451:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000100:00100000:0.0:1783071333.023423:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b078da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1869685707527168:12345-0@lo:38: Request processed in 205us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071333.023432:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:00000080:2.0:1783071333.023435:0:8451:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8f8b34573380) 00000020:00000080:2.0:1783071333.023454:0:8451:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00010000:00080000:0.0:1783071333.023476:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f8b0ab61c00 x1869685707527168/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783071343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071333.023486:0:3644:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783071333.023492:0:3644:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1783071333.023499:0:3644:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1783071333.023503:0:3644:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1783071333.023505:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8f8a01e4c800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783071333.023511:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b0ab61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1869685707527168:0@lo:38: 00000020:01000004:2.0:1783071333.023651:0:8451:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f8b069b2000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1783071333.023655:0:8451:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f8b069b2000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1783071333.023658:0:8451:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8f8b069b2000 3 00010000:00080000:2.0:1783071333.023684:0:8451:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f8a01e3f000@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.138@tcp at head 00010000:00010000:2.0:1783071333.027843:0:8451:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:2.0:1783071333.029847:0:8451:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1783071333.029981:0:8451:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1783071333.029995:0:8451:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x6b58994c2cbdbdc3 00000100:00080000:2.0:1783071333.030012:0:8451:0:(import.c:512:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783071333.030019:0:8451:0:(import.c:626:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8f8a01e3f000 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:2.0:1783071333.030056:0:8451:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8a01767480 x1869685707527296/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783071333.030090:0:8451:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1783071333.030487:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1869685707527296:0@lo:38: 00000100:00100000:1.0:1783071333.030566:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071333.030666:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707527296 00000100:00100000:3.0:1783071333.030675:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707527296 00000100:00100000:3.0:1783071333.030719:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783071333.030729:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1869685707527296:12345-0@lo:38: 00010000:00080000:3.0:1783071333.030768:0:6517:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 234 last 0 00000020:00000080:3.0:1783071333.030817:0:6517:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x6b58994c2cbdbdca 00000004:00100000:3.0:1783071333.030837:0:6517:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783071333.030873:0:6517:0:(import.c:65:import_set_state_nolock()) ffff8f8b3c6e8800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783071333.030937:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1869685707527296:12345-0@lo:38: Request processed in 208us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071333.030946:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1783071333.031118:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f8a01767480 x1869685707527296/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783071343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071333.031128:0:3644:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783071333.031137:0:3644:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1783071333.031144:0:3644:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1783071333.031148:0:3644:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1783071333.031150:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8f8a01e3f000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783071333.031156:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1869685707527296:0@lo:38: 00000040:00080000:1.0:1783071333.031446:0:8451:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:2.0:1783071333.031707:0:8423:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1783071333.031740:0:8423:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783071333.031767:0:8423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b014b9200/0x6b58994c2cbdbd99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbda0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071333.031778:0:8423:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8b014b9200/0x6b58994c2cbdbd99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbda0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783071333.031825:0:8423:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1783071333.031828:0:8423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783071333.031829:0:8423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783071333.031830:0:8423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783071333.031831:0:8423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783071333.031833:0:8423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783071333.031835:0:8423:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783071333.031837:0:8423:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783071333.031838:0:8423:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783071333.031840:0:8423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783071333.031841:0:8423:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783071333.031846:0:8423:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1783071333.031848:0:8423:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783071333.031850:0:8423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783071333.031851:0:8423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783071333.031852:0:8423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783071333.031853:0:8423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783071333.031854:0:8423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783071333.031855:0:8423:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783071333.031856:0:8423:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783071333.031857:0:8423:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783071333.031858:0:8423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783071333.031865:0:8423:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783071333.032757:0:8423:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1783071333.032776:0:8423:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01764a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:8423:1869685707527424:0@lo:253: 00000100:00100000:2.0:1783071333.032845:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071333.033096:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707527424 00000100:00100000:1.0:1783071333.033104:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707527424 00000100:00100000:2.0:1783071333.033119:0:8423:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b2fd6c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783071333.033161:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1783071333.033171:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+16:8423:x1869685707527424:12345-0@lo:253: 20000000:01000000:1.0:1783071333.033197:0:6508:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1783071333.033211:0:6508:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1783071333.040716:0:6508:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783071333.040731:0:6508:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1783071333.040738:0:6533:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783071333.040745:0:6533:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783071333.040765:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f8b3c460e00/0x6b58994c2cbdbdd1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071333.040784:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8b014b9e00/0x6b58994c2cbdbcc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbcc0 expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071333.040793:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8b01546000/0x6b58994c2cbdbce3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbcdc expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071333.040801:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f8b3c460e00/0x6b58994c2cbdbdd1 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071333.040835:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8b01546000/0x6b58994c2cbdbce3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6b58994c2cbdbcdc expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071333.040859:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8b01546000/0x6b58994c2cbdbce3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6b58994c2cbdbcdc expref: 16 pid: 6510 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071333.040950:0:6533:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b078d9180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1869685707527552:0@lo:104: 00000100:00100000:0.0:1783071333.041066:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783071333.041152:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8b014b9e00/0x6b58994c2cbdbcc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6b58994c2cbdbcc0 expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071333.041162:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8b014b9e00/0x6b58994c2cbdbcc7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6b58994c2cbdbcc0 expref: 16 pid: 6508 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071333.041163:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+16:8423:x1869685707527424:12345-0@lo:253: Request processed in 7991us (8315us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071333.041183:0:6533:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b078dbb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1869685707527680:0@lo:104: 00000100:00100000:1.0:1783071333.041187:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1783071333.041208:0:6533:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b06423180 going to sleep for 11 seconds 00000100:00100000:2.0:1783071333.041252:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1783071333.041270:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071333.041301:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707527552 00000100:00100000:2.0:1783071333.041308:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707527552 00000100:00100000:1.0:1783071333.041319:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707527680 00000100:00100000:1.0:1783071333.041326:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707527680 00000100:00100000:2.0:1783071333.041343:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783071333.041352:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b34e43450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:feaa1501-b927-4e07-baad-3200e92d7497+4:6533:x1869685707527552:12345-0@lo:104: 00000100:00100000:3.0:1783071333.041386:0:8423:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01764a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:8423:1869685707527424:0@lo:253: 10000000:01000000:3.0:1783071333.041400:0:8423:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1783071333.041404:0:8423:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783071333.041406:0:8423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783071333.041407:0:8423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783071333.041408:0:8423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783071333.041410:0:8423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783071333.041411:0:8423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783071333.041413:0:8423:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783071333.041415:0:8423:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783071333.041417:0:8423:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783071333.041419:0:8423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783071333.041421:0:8423:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:2.0:1783071333.041425:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8600/0x6b58994c2cbdbcdc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbce3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000000:3.0:1783071333.041436:0:8423:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1783071333.041576:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783071333.041583:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b34e43450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:feaa1501-b927-4e07-baad-3200e92d7497+4:6533:x1869685707527552:12345-0@lo:104: Request processed in 232us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071333.041629:0:6533:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b078d9180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1869685707527552:0@lo:104: 00000100:00100000:2.0:1783071333.041761:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783071333.041799:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783071333.041808:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01765180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:feaa1501-b927-4e07-baad-3200e92d7497+3:6533:x1869685707527680:12345-0@lo:104: 00010000:00010000:2.0:1783071333.041817:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8f8b01546600/0x6b58994c2cbdbcc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbcc7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071333.044546:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783071333.044563:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01765180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:feaa1501-b927-4e07-baad-3200e92d7497+3:6533:x1869685707527680:12345-0@lo:104: Request processed in 2752us (3288us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071333.044575:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1783071333.044616:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783071333.044624:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8600/0x6b58994c2cbdbcdc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbce3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071333.044643:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b014b8600 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:2.0:1783071333.044648:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8600/0x6b58994c2cbdbcdc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6b58994c2cbdbce3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071333.044659:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8600/0x6b58994c2cbdbcdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6b58994c2cbdbce3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783071333.044667:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8600/0x6b58994c2cbdbcdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6b58994c2cbdbce3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071333.044673:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783071333.044719:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8600/0x6b58994c2cbdbcdc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbce3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071333.044725:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783071333.044744:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8600/0x6b58994c2cbdbcdc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbce3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071333.044752:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8600/0x6b58994c2cbdbcdc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbce3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071333.044764:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783071333.044767:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8b01546600/0x6b58994c2cbdbcc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbcc7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071333.044773:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b01546600 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:2.0:1783071333.044776:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8b01546600/0x6b58994c2cbdbcc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6b58994c2cbdbcc7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071333.044792:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8b01546600/0x6b58994c2cbdbcc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6b58994c2cbdbcc7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783071333.044810:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8b01546600/0x6b58994c2cbdbcc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6b58994c2cbdbcc7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071333.044815:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783071333.044828:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8f8b01546600/0x6b58994c2cbdbcc0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbcc7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071333.044833:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783071333.044848:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8b01546600/0x6b58994c2cbdbcc0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbcc7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071333.044853:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8b01546600/0x6b58994c2cbdbcc0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbcc7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071333.044865:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071333.044867:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071333.044878:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071333.044897:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:feaa1501-b927-4e07-baad-3200e92d7497:3648:1869685707527808:0@lo:103: 00000100:00100000:2.0:1783071333.044964:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071333.045032:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:feaa1501-b927-4e07-baad-3200e92d7497:3645:1869685707527936:0@lo:103: 00000100:00100000:2.0:1783071333.045057:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071333.045098:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707527808 00000100:00100000:2.0:1783071333.045105:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707527808 00000100:00100000:1.0:1783071333.045112:0:6533:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b078dbb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1869685707527680:0@lo:104: 00010000:00010000:2.0:1783071333.045133:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8b01546000/0x6b58994c2cbdbce3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbcdc expref: 16 pid: 6510 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071333.045138:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f8b3c460e00/0x6b58994c2cbdbdd1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071333.045175:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707527936 00000100:00100000:2.0:1783071333.045179:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707527936 00000100:00100000:1.0:1783071333.045186:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00010000:00010000:2.0:1783071333.045194:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8b014b9e00/0x6b58994c2cbdbcc7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbcc0 expref: 17 pid: 6508 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071333.045200:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01766300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:feaa1501-b927-4e07-baad-3200e92d7497+17:3648:x1869685707527808:12345-0@lo:103: 00010000:00010000:1.0:1783071333.045217:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1783071333.045222:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1783071333.045227:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8b01546000/0x6b58994c2cbdbce3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbcdc expref: 17 pid: 6510 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071333.045232:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01767b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:feaa1501-b927-4e07-baad-3200e92d7497+17:3645:x1869685707527936:12345-0@lo:103: 00010000:00010000:2.0:1783071333.045248:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071333.045248:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8b01546000/0x6b58994c2cbdbce3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6b58994c2cbdbcdc expref: 17 pid: 6510 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071333.045256:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8b014b9e00/0x6b58994c2cbdbcc7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbcc0 expref: 17 pid: 6508 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071333.045269:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b01546000/0x6b58994c2cbdbce3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6b58994c2cbdbcdc expref: 17 pid: 6510 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071333.045271:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8b014b9e00/0x6b58994c2cbdbcc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6b58994c2cbdbcc0 expref: 17 pid: 6508 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071333.045296:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b014b9e00/0x6b58994c2cbdbcc7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6b58994c2cbdbcc0 expref: 16 pid: 6508 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071333.045300:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f8b3c460e00/0x6b58994c2cbdbdd1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071333.045311:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b3c460e00/0x6b58994c2cbdbdd1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071333.045357:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071333.046220:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071333.046284:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01767b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:feaa1501-b927-4e07-baad-3200e92d7497+15:3645:x1869685707527936:12345-0@lo:103: Request processed in 1052us (1223us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071333.046293:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783071333.046411:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:feaa1501-b927-4e07-baad-3200e92d7497:3645:1869685707527936:0@lo:103: 00080000:10000000:3.0:1783071333.048579:0:8423:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1783071333.048785:0:8423:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1783071333.049115:0:8423:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1783071333.049293:0:8423:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1783071333.049795:0:8423:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 20000000:01000000:1.0:1783071333.050082:0:6501:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009337254s 00010000:00010000:1.0:1783071333.050093:0:6501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f8b3c460e00/0x6b58994c2cbdbdd1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071333.050111:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f8b3c460e00/0x6b58994c2cbdbdd1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071333.050120:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f8b3c460e00/0x6b58994c2cbdbdd1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071333.050128:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f8b3c460e00/0x6b58994c2cbdbdd1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071333.050135:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b3c460e00 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:1.0:1783071333.050139:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f8b3c460e00/0x6b58994c2cbdbdd1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071333.050147:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f8b3c460e00/0x6b58994c2cbdbdd1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071333.050179:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f8b3c460e00/0x6b58994c2cbdbdd1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071333.050192:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071333.050278:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01766300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:feaa1501-b927-4e07-baad-3200e92d7497+14:3648:x1869685707527808:12345-0@lo:103: Request processed in 5080us (5310us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071333.050288:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:0.0:1783071333.050445:0:6533:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f8b3c460e00/0x6b58994c2cbdbdd1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071333.050455:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f8b3c460e00/0x6b58994c2cbdbdd1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071333.050462:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b3c460e00/0x6b58994c2cbdbdd1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071333.050566:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:feaa1501-b927-4e07-baad-3200e92d7497:3648:1869685707527808:0@lo:103: 00080000:10000000:3.0:1783071333.050628:0:8423:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:2.0:1783071333.051842:0:8423:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1783071333.064686:0:8423:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1783071333.064696:0:8423:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1783071333.064735:0:8423:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783071333.064783:0:8423:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.138@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783071333.064801:0:8423:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1783071333.064832:0:8423:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1783071333.065703:0:8423:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783071333.065895:0:8423:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1783071333.634697:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1783071333.884705:0:8507:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783071333.885092:0:8507:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783071334.658452:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071335.686054:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071336.262300:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707528064:0@lo:41: 00000100:00100000:3.0:1783071336.262390:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071336.262585:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707528064 00000100:00100000:2.0:1783071336.262594:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707528064 00000100:00100000:2.0:1783071336.262643:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783071336.262652:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0178d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707528064:12345-0@lo:41: 00000004:00000024:2.0:1783071336.262689:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:2.0:1783071336.269721:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0178d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707528064:12345-0@lo:41: Request processed in 7061us (7322us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071336.269736:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783071336.270629:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707528064:0@lo:41: 00010000:00010000:0.0:1783071336.712616:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071337.742955:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071337.807240:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0178ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707528192:0@lo:41: 00000100:00100000:3.0:1783071337.807310:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071337.808184:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707528192 00000100:00100000:1.0:1783071337.808193:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707528192 00000100:00100000:1.0:1783071337.808255:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783071337.808272:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0178c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707528192:12345-0@lo:41: 00000004:00000024:1.0:1783071337.808315:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1783071337.808398:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0178c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707528192:12345-0@lo:41: Request processed in 127us (1087us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071337.808406:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783071337.808503:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0178ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707528192:0@lo:41: 00000100:00100000:0.0:1783071338.306830:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b078daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869685707528704:0@lo:400: 00000100:00100000:0.0:1783071338.306916:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071338.306976:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1783071338.306986:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b078d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:feaa1501-b927-4e07-baad-3200e92d7497:3647:1869685707528320:0@lo:400: 00000100:00100000:0.0:1783071338.307021:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071338.307208:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b078dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707528832:0@lo:400: 00000100:00100000:0.0:1783071338.307238:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071338.307302:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707528320 00000100:00100000:1.0:1783071338.307311:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707528320 00000100:00100000:1.0:1783071338.307352:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1783071338.307358:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+14:3647:x1869685707528320:12345-0@lo:400: 00000100:00100000:1.0:1783071338.307415:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+14:3647:x1869685707528320:12345-0@lo:400: Request processed in 57us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071338.307420:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1783071338.307510:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b078d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:feaa1501-b927-4e07-baad-3200e92d7497:3647:1869685707528320:0@lo:400: 00000100:00100000:0.0:1783071338.307532:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b078db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869685707528448:0@lo:400: 00000100:00100000:0.0:1783071338.307550:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071338.307569:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b078d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1869685707528960:0@lo:400: 00000100:00100000:0.0:1783071338.307598:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071338.307613:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1783071338.307617:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b078db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707528576:0@lo:400: 00000100:00100000:0.0:1783071338.307631:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071338.307659:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707528704 00000100:00100000:1.0:1783071338.307662:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707528704 00000100:00100000:1.0:1783071338.307680:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707528448 00000100:00100000:1.0:1783071338.307681:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707528448 00000100:00100000:1.0:1783071338.307693:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707528960 00000100:00100000:1.0:1783071338.307694:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707528960 00000100:00100000:1.0:1783071338.307718:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783071338.307726:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b078d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869685707528704:12345-0@lo:400: 00000100:00100000:1.0:1783071338.307768:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b078d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869685707528704:12345-0@lo:400: Request processed in 42us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071338.307774:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783071338.307787:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783071338.307793:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b078d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1869685707528448:12345-0@lo:400: 00000100:00100000:1.0:1783071338.307832:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b078d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1869685707528448:12345-0@lo:400: Request processed in 40us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071338.307838:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783071338.307860:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783071338.307871:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b2fcb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1869685707528960:12345-0@lo:400: 00000100:00100000:1.0:1783071338.307911:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b2fcb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1869685707528960:12345-0@lo:400: Request processed in 45us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071338.307917:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783071338.308756:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b078d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1869685707529088:0@lo:400: 00000100:00100000:0.0:1783071338.308799:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1783071338.308846:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8b078db800 x1869685707528448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071338.308859:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b078db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869685707528448:0@lo:400: 00010000:00080000:0.0:1783071338.308870:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8b078d9180 x1869685707528960/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071338.308878:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b078d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1869685707528960:0@lo:400: 00000100:00100000:0.0:1783071338.308922:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707529088 00000100:00100000:0.0:1783071338.308929:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707529088 00000100:00100000:0.0:1783071338.308962:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783071338.308970:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b2fcb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1869685707529088:12345-0@lo:400: 00000100:00100000:0.0:1783071338.309016:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b2fcb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1869685707529088:12345-0@lo:400: Request processed in 47us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071338.309341:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1783071338.309397:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783071338.309401:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1783071338.309425:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8b078d9500 x1869685707529088/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071338.309435:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b078d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1869685707529088:0@lo:400: 00010000:00080000:0.0:1783071338.309465:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8b078daa00 x1869685707528704/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071338.309475:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b078daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869685707528704:0@lo:400: 00000100:00100000:2.0:1783071338.309773:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707528832 00000100:00100000:2.0:1783071338.309779:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707528832 00000100:00100000:2.0:1783071338.309809:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707528576 00000100:00100000:2.0:1783071338.309823:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707528576 00000100:00100000:2.0:1783071338.309840:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783071338.309847:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b078d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707528832:12345-0@lo:400: 00000100:00100000:2.0:1783071338.309949:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b078d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707528832:12345-0@lo:400: Request processed in 102us (2709us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071338.309956:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783071338.309970:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783071338.309976:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b2fcb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707528576:12345-0@lo:400: 00000100:00100000:2.0:1783071338.310011:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b2fcb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707528576:12345-0@lo:400: Request processed in 36us (2378us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071338.310016:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783071338.310162:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b078db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707528576:0@lo:400: 00000100:00100000:0.0:1783071338.311551:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b078dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707528832:0@lo:400: 00000001:02000400:2.0:1783071338.340879:0:8797:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg438-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1783071338.756689:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783071339.445855:0:8849:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783071339.446181:0:8849:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783071339.788046:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071340.806114:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1783071341.378557:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783071341.378569:0:6513:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8f8b3447b000 from 30 10000000:01000000:1.0:1783071341.378588:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783071341.378657:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9e00/0x6b58994c2cbdbdd8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071341.378673:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9e00/0x6b58994c2cbdbdd8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071341.378687:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9e00/0x6b58994c2cbdbdd8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071341.378720:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b0ab62a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707529216:0@lo:101: 00000100:00100000:0.0:1783071341.378838:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707529344:0@lo:41: 00000100:00100000:1.0:1783071341.379423:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071341.379439:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071341.379489:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b1805a240 going to sleep for 11 seconds 00000100:00100000:2.0:1783071341.379541:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707529216 00000100:00100000:2.0:1783071341.379568:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707529216 00000100:00100000:2.0:1783071341.379637:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1783071341.379648:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+14:6513:x1869685707529216:12345-0@lo:101: 00010000:00010000:2.0:1783071341.379668:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071341.379689:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b10967600/0x6b58994c2cbdbddf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdbdd8 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071341.379724:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b10967600/0x6b58994c2cbdbddf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdbdd8 expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071341.379737:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b10967600/0x6b58994c2cbdbddf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbdd8 expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071341.379749:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b10967600, rc 0) 00000100:00100000:2.0:1783071341.379809:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+15:6513:x1869685707529216:12345-0@lo:101: Request processed in 163us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071341.379816:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1783071341.380256:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707529344 00000100:00100000:3.0:1783071341.380263:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707529344 00000100:00100000:3.0:1783071341.380344:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783071341.380354:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b2fcb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707529344:12345-0@lo:41: 00000004:00000024:3.0:1783071341.380416:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:3.0:1783071341.380480:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b2fcb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707529344:12345-0@lo:41: Request processed in 127us (1042us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071341.380486:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783071341.380585:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707529344:0@lo:41: 00000100:00100000:1.0:1783071341.381218:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b0ab62a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707529216:0@lo:101: 00010000:00010000:1.0:1783071341.381245:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9e00/0x6b58994c2cbdbdd8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbddf expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071341.381258:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9e00/0x6b58994c2cbdbdd8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdbddf expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071341.381353:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b0ab62a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707529472:0@lo:501: 00000100:00100000:1.0:1783071341.381450:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071341.381493:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b1805a240 going to sleep for 11 seconds 00000100:00100000:0.0:1783071341.381653:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707529472 00000100:00100000:0.0:1783071341.381662:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707529472 00000100:00100000:0.0:1783071341.381711:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1783071341.381719:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+15:6513:x1869685707529472:12345-0@lo:501: 00000100:00100000:0.0:1783071341.381910:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+15:6513:x1869685707529472:12345-0@lo:501: Request processed in 191us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071341.381926:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1783071341.382179:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b0ab62a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707529472:0@lo:501: 00000100:00100000:1.0:1783071341.382217:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b0ab62a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707529600:0@lo:503: 00000100:00100000:1.0:1783071341.382267:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071341.382292:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b1805a240 going to sleep for 11 seconds 00000100:00100000:0.0:1783071341.382346:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707529600 00000100:00100000:0.0:1783071341.382351:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707529600 00000100:00100000:0.0:1783071341.382405:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1783071341.382413:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+15:6513:x1869685707529600:12345-0@lo:503: 00000100:00100000:0.0:1783071341.382508:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+15:6513:x1869685707529600:12345-0@lo:503: Request processed in 88us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071341.382515:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1783071341.383253:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b0ab62a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707529600:0@lo:503: 00000100:00100000:1.0:1783071341.383884:0:8901:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b0ab62a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:8901:1869685707529728:0@lo:502: 00000100:00100000:1.0:1783071341.383958:0:8901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071341.383998:0:8901:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b1805a780 going to sleep for 11 seconds 00000100:00100000:2.0:1783071341.387694:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707529728 00000100:00100000:2.0:1783071341.387723:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707529728 00000100:00100000:2.0:1783071341.387831:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1783071341.387845:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+15:8901:x1869685707529728:12345-0@lo:502: 00000100:00100000:2.0:1783071341.388121:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+15:8901:x1869685707529728:12345-0@lo:502: Request processed in 278us (4162us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071341.388129:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1783071341.390765:0:8901:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b0ab62a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:8901:1869685707529728:0@lo:502: 00000100:00100000:1.0:1783071341.390905:0:8901:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b0ab62a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:8901:1869685707529856:0@lo:502: 00000100:00100000:1.0:1783071341.391003:0:8901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071341.391066:0:8901:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b115af480 going to sleep for 11 seconds 00000100:00100000:2.0:1783071341.391433:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707529856 00000100:00100000:2.0:1783071341.391443:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707529856 00000100:00100000:2.0:1783071341.391527:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1783071341.391539:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+15:8901:x1869685707529856:12345-0@lo:502: 00000100:00100000:2.0:1783071341.391729:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+15:8901:x1869685707529856:12345-0@lo:502: Request processed in 191us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071341.391745:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1783071341.394633:0:8901:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b0ab62a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:8901:1869685707529856:0@lo:502: 00000040:00080000:3.0:1783071341.394708:0:8901:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1783071341.395345:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1783071341.395420:0:6513:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783071341.395437:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9e00/0x6b58994c2cbdbdd8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbddf expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071341.395452:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9e00/0x6b58994c2cbdbdd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbddf expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071341.395466:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783071341.395469:0:6513:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8f8b3447b000 from 5 10000000:01000000:2.0:1783071341.395473:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783071341.395543:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b10967200/0x6b58994c2cbdbde6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071341.395552:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8b10967200/0x6b58994c2cbdbde6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071341.395796:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8b10967200/0x6b58994c2cbdbde6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071341.395827:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01766a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707529984:0@lo:101: 00000100:00100000:2.0:1783071341.395997:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071341.396130:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b2fc82b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783071341.396841:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707529984 00000100:00100000:0.0:1783071341.396856:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707529984 00000100:00100000:0.0:1783071341.397114:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1783071341.397128:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+15:6513:x1869685707529984:12345-0@lo:101: 00010000:00010000:0.0:1783071341.397156:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071341.397183:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b3c461000/0x6b58994c2cbdbded lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdbde6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071341.397219:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b3c461000/0x6b58994c2cbdbded lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdbde6 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071341.397232:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b3c461000/0x6b58994c2cbdbded lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbde6 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071341.397244:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b3c461000, rc 0) 00000100:00100000:0.0:1783071341.397330:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+16:6513:x1869685707529984:12345-0@lo:101: Request processed in 205us (1333us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071341.397337:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1783071341.397482:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01766a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707529984:0@lo:101: 00010000:00010000:1.0:1783071341.397519:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8b10967200/0x6b58994c2cbdbde6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbded expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071341.397530:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8b10967200/0x6b58994c2cbdbde6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdbded expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071341.397645:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b0ab61500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707530112:0@lo:256: 00000100:00100000:1.0:1783071341.397696:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071341.398338:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b115af300 going to sleep for 11 seconds 00000100:00100000:2.0:1783071341.398494:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707530112 00000100:00100000:2.0:1783071341.398614:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707530112 00000100:00100000:2.0:1783071341.398708:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1783071341.398717:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+16:6513:x1869685707530112:12345-0@lo:256: 20000000:01000000:2.0:1783071341.398741:0:6511:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783071341.398784:0:6511:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783071341.398787:0:6511:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1783071341.399452:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+16:6513:x1869685707530112:12345-0@lo:256: Request processed in 731us (1752us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071341.399463:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1783071341.400056:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b0ab61500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707530112:0@lo:256: 10000000:01000000:1.0:1783071341.400229:0:6513:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783071341.400244:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b10967200/0x6b58994c2cbdbde6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbded expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071341.400256:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8b10967200/0x6b58994c2cbdbde6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbded expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783071341.400267:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1783071341.400272:0:6513:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:1.0:1783071341.400275:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1783071341.400320:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b421d8600/0x6b58994c2cbdbdf4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071341.400330:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8b421d8600/0x6b58994c2cbdbdf4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071341.400340:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8b421d8600/0x6b58994c2cbdbdf4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071341.400435:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b0ab61500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707530240:0@lo:101: 00000100:00100000:1.0:1783071341.400496:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071341.400731:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b115af300 going to sleep for 11 seconds 00000100:00100000:0.0:1783071341.400815:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707530240 00000100:00100000:0.0:1783071341.400824:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707530240 00000100:00100000:0.0:1783071341.401219:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1783071341.401232:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+16:6513:x1869685707530240:12345-0@lo:101: 00010000:00010000:0.0:1783071341.401252:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071341.401270:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b3c461a00/0x6b58994c2cbdbdfb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdbdf4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071341.401304:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b3c461a00/0x6b58994c2cbdbdfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdbdf4 expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071341.401315:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b3c461a00/0x6b58994c2cbdbdfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbdf4 expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071341.401326:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b3c461a00, rc 0) 00000100:00100000:0.0:1783071341.401428:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+17:6513:x1869685707530240:12345-0@lo:101: Request processed in 199us (931us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071341.401434:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1783071341.401543:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b0ab61500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707530240:0@lo:101: 00010000:00010000:1.0:1783071341.401560:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8b421d8600/0x6b58994c2cbdbdf4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbdfb expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071341.401581:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8b421d8600/0x6b58994c2cbdbdf4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdbdfb expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071341.401698:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b0ab61500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707530368:0@lo:501: 00000100:00100000:1.0:1783071341.401732:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071341.409323:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707530368 00000100:00100000:2.0:1783071341.409343:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707530368 00000100:00100000:2.0:1783071341.409435:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1783071341.409449:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+17:6513:x1869685707530368:12345-0@lo:501: 00000100:00100000:2.0:1783071341.409813:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+17:6513:x1869685707530368:12345-0@lo:501: Request processed in 366us (8079us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071341.409823:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1783071341.412574:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b115af300 going to sleep for 11 seconds 00000100:00100000:1.0:1783071341.412880:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b0ab61500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707530368:0@lo:501: 00000100:00100000:1.0:1783071341.412991:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b0ab61500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707530496:0@lo:503: 00000100:00100000:1.0:1783071341.415263:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071341.415338:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b115af300 going to sleep for 11 seconds 00000100:00100000:2.0:1783071341.415483:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707530496 00000100:00100000:2.0:1783071341.415495:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707530496 00000100:00100000:2.0:1783071341.415773:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1783071341.415788:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+17:6513:x1869685707530496:12345-0@lo:503: 00000100:00100000:2.0:1783071341.416720:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+17:6513:x1869685707530496:12345-0@lo:503: Request processed in 929us (1457us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071341.416734:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1783071341.417856:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b0ab61500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707530496:0@lo:503: 00000100:00100000:0.0:1783071341.423040:0:8902:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b2fcb3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:8902:1869685707530624:0@lo:502: 00000100:00100000:0.0:1783071341.423258:0:8902:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071341.424116:0:8902:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b34471300 going to sleep for 11 seconds 00000100:00100000:1.0:1783071341.424792:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707530624 00000100:00100000:1.0:1783071341.424806:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707530624 00000100:00100000:1.0:1783071341.424911:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1783071341.424924:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+17:8902:x1869685707530624:12345-0@lo:502: 00000100:00100000:1.0:1783071341.425222:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+17:8902:x1869685707530624:12345-0@lo:502: Request processed in 300us (1964us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071341.425232:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1783071341.425306:0:8902:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b2fcb3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:8902:1869685707530624:0@lo:502: 00000020:01000000:0.0:1783071341.425354:0:8902:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783071341.425398:0:8902:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1783071341.425408:0:8902:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783071341.425411:0:8902:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1783071341.425417:0:8902:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1783071341.425422:0:8902:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.138@tcp to nid 0x20000c0a8cc8a (192.168.204.138@tcp) 00000020:01000000:0.0:1783071341.425456:0:8902:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1783071341.425459:0:8902:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783071341.425491:0:8902:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8f8b34e619c0) 00000020:00000080:0.0:1783071341.425527:0:8902:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:0.0:1783071341.425535:0:8902:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1783071341.425744:0:8902:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1783071341.425763:0:8902:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:0.0:1783071341.425774:0:8902:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x6b58994c2cbdbe09 00010000:00080000:0.0:1783071341.425815:0:8902:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f8a01779000@lustre-OST0000-osc-MDT0001: add connection 192.168.204.138@tcp at head 00010000:00010000:0.0:1783071341.427054:0:8902:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1783071341.442014:0:8902:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1783071341.442052:0:8902:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1783071341.442615:0:8902:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783071341.443352:0:8902:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783071341.443483:0:8902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1783071341.443599:0:8902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1783071341.444280:0:8903:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783071341.444288:0:8903:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1783071341.445272:0:8902:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1783071341.445287:0:8902:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1783071341.445349:0:8902:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1783071341.445466:0:8902:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x6b58994c2cbdbe10 00000100:00080000:2.0:1783071341.445481:0:8902:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783071341.445489:0:8902:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8f8a01779000 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:2.0:1783071341.445542:0:8902:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8a01764380 x1869685707530752/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783071341.445627:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1869685707530752:0@lo:8: 00000100:00100000:1.0:1783071341.445747:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071341.445894:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707530752 00000100:00100000:3.0:1783071341.445905:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707530752 00000100:00100000:3.0:1783071341.445963:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783071341.445972:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1869685707530752:12345-0@lo:8: 00010000:00080000:3.0:1783071341.446007:0:8429:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 243 last 0 00000020:00000080:3.0:1783071341.446043:0:8429:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x6b58994c2cbdbe17 00002000:00100000:3.0:1783071341.446082:0:8429:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8f8b3c6ef800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1783071341.446087:0:8429:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:3.0:1783071341.446092:0:8429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1783071341.446179:0:8429:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1783071341.446485:0:8429:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1783071341.446524:0:8429:0:(import.c:65:import_set_state_nolock()) ffff8f8b3c6ec000 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1783071341.446965:0:8902:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1783071341.447142:0:8902:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783071341.447150:0:8902:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071341.447152:0:8902:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1783071341.447156:0:8902:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783071341.447161:0:8902:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071341.447163:0:8902:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783071341.447167:0:8902:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783071341.447169:0:8902:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1783071341.447211:0:8902:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01765500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:8902:1869685707530880:0@lo:502: 00000100:00100000:2.0:1783071341.447290:0:8902:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071341.447337:0:8902:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b2fc82f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783071341.447535:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b2fcb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1869685707531392:0@lo:400: 00000100:00100000:0.0:1783071341.447576:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071341.447603:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1783071341.447609:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b2fcb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869685707531008:0@lo:400: 00000100:00100000:0.0:1783071341.447652:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071341.447671:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b2fcb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1869685707531520:0@lo:400: 00000100:00100000:0.0:1783071341.447692:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071341.447720:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b2fcb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869685707531136:0@lo:400: 00000100:00100000:0.0:1783071341.447749:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071341.447775:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783071341.447780:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b2fcb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707531264:0@lo:400: 00000100:00100000:0.0:1783071341.447809:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071341.447992:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707531392 00000100:00100000:0.0:1783071341.448002:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707531392 00000100:00100000:0.0:1783071341.448058:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707531008 00000100:00100000:0.0:1783071341.448061:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707531008 00000100:00100000:0.0:1783071341.448075:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707531520 00000100:00100000:0.0:1783071341.448078:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707531520 00000100:00100000:0.0:1783071341.448104:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707531136 00000100:00100000:0.0:1783071341.448107:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707531136 00000100:00100000:0.0:1783071341.448127:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783071341.448137:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b2fcb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869685707531392:12345-0@lo:400: 00000100:00100000:0.0:1783071341.448208:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b2fcb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869685707531392:12345-0@lo:400: Request processed in 72us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071341.448216:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783071341.448240:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783071341.448247:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b2fcb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869685707531008:12345-0@lo:400: 00000100:00100000:0.0:1783071341.448275:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b2fcb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869685707531008:12345-0@lo:400: Request processed in 28us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071341.448288:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783071341.448300:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783071341.448307:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b2fcb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869685707531520:12345-0@lo:400: 00000100:00100000:0.0:1783071341.448338:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b2fcb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869685707531520:12345-0@lo:400: Request processed in 33us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071341.448345:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783071341.448357:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783071341.448394:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b2fcb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1869685707531136:12345-0@lo:400: 00000100:00100000:0.0:1783071341.448426:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b2fcb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1869685707531136:12345-0@lo:400: Request processed in 63us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071341.448432:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783071341.448464:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707531264 00000100:00100000:0.0:1783071341.448468:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707531264 00000100:00100000:0.0:1783071341.448500:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783071341.448507:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b2fcb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707531264:12345-0@lo:400: 00000100:00100000:0.0:1783071341.448546:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b2fcb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707531264:12345-0@lo:400: Request processed in 40us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071341.448563:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1783071341.448585:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783071341.448586:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b2fcb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707531264:0@lo:400: 00000100:00080000:0.0:1783071341.448591:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1783071341.448610:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8b2fcb2680 x1869685707531136/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1783071341.448623:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8b2fcb3100 x1869685707531008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071341.448635:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b2fcb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869685707531008:0@lo:400: 00010000:00080000:0.0:1783071341.448649:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8b2fcb0a80 x1869685707531520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071341.448658:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b2fcb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1869685707531520:0@lo:400: 00010000:00080000:0.0:1783071341.448671:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8b2fcb0000 x1869685707531392/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071341.448679:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b2fcb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1869685707531392:0@lo:400: 00000100:00100000:3.0:1783071341.448989:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1869685707530752:12345-0@lo:8: Request processed in 3014us (3240us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071341.449008:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783071341.449041:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707530880 00000100:00100000:3.0:1783071341.449046:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707530880 00000100:00100000:3.0:1783071341.449087:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1783071341.449094:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+17:8902:x1869685707530880:12345-0@lo:502: 00000100:00100000:3.0:1783071341.449252:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+17:8902:x1869685707530880:12345-0@lo:502: Request processed in 158us (1963us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071341.449260:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1783071341.449318:0:8902:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01765500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:8902:1869685707530880:0@lo:502: 00000100:00100000:2.0:1783071341.449402:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b2fcb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869685707531136:0@lo:400: 00000020:01000000:3.0:1783071341.449408:0:8902:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783071341.449418:0:8902:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071341.449421:0:8902:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:3.0:1783071341.449428:0:8902:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:3.0:1783071341.449513:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:3.0:1783071341.449540:0:6513:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1783071341.449553:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b421d8600/0x6b58994c2cbdbdf4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbdfb expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071341.449565:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8b421d8600/0x6b58994c2cbdbdf4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbdfb expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783071341.449577:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783071341.449580:0:6513:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8f8b10f7e000 from 30 10000000:01000000:3.0:1783071341.449583:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783071341.449618:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8c00/0x6b58994c2cbdbe1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071341.449627:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8c00/0x6b58994c2cbdbe1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071341.449644:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8c00/0x6b58994c2cbdbe1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071341.449667:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0178ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707531648:0@lo:101: 00000100:00100000:3.0:1783071341.449711:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071341.449752:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b06c449c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783071341.450010:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707531648 00000100:00100000:0.0:1783071341.450017:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707531648 00000100:00100000:0.0:1783071341.450056:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1783071341.450064:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+17:6513:x1869685707531648:12345-0@lo:101: 00010000:00010000:0.0:1783071341.450076:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071341.450094:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b3c460000/0x6b58994c2cbdbe25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdbe1e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071341.450124:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b3c460000/0x6b58994c2cbdbe25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdbe1e expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071341.450137:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b3c460000/0x6b58994c2cbdbe25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbe1e expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071341.450160:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b3c460000, rc 0) 00000100:00100000:0.0:1783071341.450199:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+18:6513:x1869685707531648:12345-0@lo:101: Request processed in 136us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071341.450205:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1783071341.450243:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0178ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707531648:0@lo:101: 00010000:00010000:0.0:1783071341.450256:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8c00/0x6b58994c2cbdbe1e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbe25 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071341.450267:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8c00/0x6b58994c2cbdbe1e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdbe25 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071341.450330:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b2fcb0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707531776:0@lo:501: 00000100:00100000:0.0:1783071341.450357:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071341.450395:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b34471e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783071341.450407:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707531776 00000100:00100000:0.0:1783071341.450410:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707531776 00000100:00100000:0.0:1783071341.450427:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1783071341.450432:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+18:6513:x1869685707531776:12345-0@lo:501: 00000100:00100000:0.0:1783071341.450567:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+18:6513:x1869685707531776:12345-0@lo:501: Request processed in 133us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071341.450573:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1783071341.450601:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b2fcb0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707531776:0@lo:501: 00000100:00100000:0.0:1783071341.450627:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b2fcb0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707531904:0@lo:503: 00000100:00100000:0.0:1783071341.450666:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071341.450680:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b34471e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783071341.450695:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707531904 00000100:00100000:0.0:1783071341.450698:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707531904 00000100:00100000:0.0:1783071341.450713:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1783071341.450718:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0d1cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+18:6513:x1869685707531904:12345-0@lo:503: 00000100:00100000:0.0:1783071341.450803:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0d1cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+18:6513:x1869685707531904:12345-0@lo:503: Request processed in 85us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071341.450810:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:1.0:1783071341.451035:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a01764380 x1869685707530752/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783071351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071341.451049:0:3644:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783071341.451058:0:3644:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1783071341.451069:0:3644:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1783071341.451083:0:3644:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1783071341.451088:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8f8a01779000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1783071341.451102:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1783071341.451109:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1869685707530752:0@lo:8: 00000004:00080000:1.0:1783071341.451139:0:8903:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1783071341.451240:0:8903:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 243239875006ns, next at 0ns, rc = 0 00080000:00080000:1.0:1783071341.451248:0:8903:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1783071341.451307:0:8904:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b0ab61880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8904:1869685707532032:0@lo:700: 00000100:00100000:1.0:1783071341.451342:0:8904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071341.451376:0:8904:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b06dbce40 going to sleep for 11 seconds 00000100:00100000:3.0:1783071341.452139:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707532032 00000100:00100000:3.0:1783071341.452148:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707532032 00000100:00100000:3.0:1783071341.452212:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783071341.452221:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8904:x1869685707532032:12345-0@lo:700: 00000100:00100000:3.0:1783071341.452267:0:8438:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0178d500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8438:1869685707532160:0@lo:700: 00000100:00100000:3.0:1783071341.452319:0:8438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071341.452346:0:8438:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b06c44cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071341.452404:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707532160 00000100:00100000:3.0:1783071341.452408:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707532160 00000100:00100000:3.0:1783071341.452438:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783071341.452445:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0178df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8438:x1869685707532160:12345-0@lo:700: 00000100:00100000:0.0:1783071341.452651:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b2fcb0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707531904:0@lo:503: 00000100:00080000:1.0:1783071341.453007:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783071341.453498:0:8905:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b0ab62300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:8905:1869685707532288:0@lo:502: 00000100:00100000:1.0:1783071341.453567:0:8905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071341.454093:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707532288 00000100:00100000:2.0:1783071341.454102:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707532288 00000100:00100000:2.0:1783071341.454207:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1783071341.454218:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b13f99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+18:8905:x1869685707532288:12345-0@lo:502: 00000100:00100000:2.0:1783071341.454396:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b13f99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+18:8905:x1869685707532288:12345-0@lo:502: Request processed in 180us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071341.454406:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1783071341.454494:0:8905:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b06dbcf00 going to sleep for 11 seconds 00000100:00100000:1.0:1783071341.454518:0:8905:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b0ab62300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:8905:1869685707532288:0@lo:502: 00000100:00100000:1.0:1783071341.454575:0:8905:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b0ab62300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:8905:1869685707532416:0@lo:502: 00000100:00100000:1.0:1783071341.454612:0:8905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1783071341.455451:0:7447:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:1.0:1783071341.455670:0:8905:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b1805a240 going to sleep for 11 seconds 00000100:00100000:0.0:1783071341.455743:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707532416 00000100:00100000:0.0:1783071341.455752:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707532416 00000100:00100000:0.0:1783071341.455825:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1783071341.455843:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b02bf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+18:8905:x1869685707532416:12345-0@lo:502: 00000100:00100000:0.0:1783071341.456142:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b02bf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+18:8905:x1869685707532416:12345-0@lo:502: Request processed in 306us (1525us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071341.456150:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1783071341.456184:0:8905:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b0ab62300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:8905:1869685707532416:0@lo:502: 00000040:00080000:1.0:1783071341.456225:0:8905:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1783071341.456735:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1783071341.456772:0:6513:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783071341.456787:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8c00/0x6b58994c2cbdbe1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbe25 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071341.456800:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8c00/0x6b58994c2cbdbe1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbe25 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783071341.456812:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783071341.456815:0:6513:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8f8b10f7e000 from 5 10000000:01000000:0.0:1783071341.456819:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783071341.457056:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461400/0x6b58994c2cbdbe2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071341.457076:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461400/0x6b58994c2cbdbe2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071341.457086:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461400/0x6b58994c2cbdbe2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071341.457107:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b2fcb0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707532544:0@lo:101: 00000100:00100000:0.0:1783071341.457160:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071341.458516:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707532544 00000100:00100000:2.0:1783071341.458533:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707532544 00000100:00100000:2.0:1783071341.458607:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1783071341.458619:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b06199c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+18:6513:x1869685707532544:12345-0@lo:101: 00010000:00010000:2.0:1783071341.458650:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071341.458680:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b10966800/0x6b58994c2cbdbe33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdbe2c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071341.458717:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b10966800/0x6b58994c2cbdbe33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdbe2c expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071341.458730:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b10966800/0x6b58994c2cbdbe33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbe2c expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071341.458740:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b10966800, rc 0) 00000100:00100000:2.0:1783071341.458817:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b06199c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+19:6513:x1869685707532544:12345-0@lo:101: Request processed in 200us (1656us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071341.458825:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1783071341.459210:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b03fef6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783071341.459243:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b2fcb0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707532544:0@lo:101: 00010000:00010000:0.0:1783071341.459265:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461400/0x6b58994c2cbdbe2c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbe33 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071341.459276:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461400/0x6b58994c2cbdbe2c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdbe33 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071341.459350:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b2fcb0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707532672:0@lo:256: 00000100:00100000:0.0:1783071341.459414:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071341.459436:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b03fef6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783071341.459455:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707532672 00000100:00100000:0.0:1783071341.459460:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707532672 00000100:00100000:0.0:1783071341.459495:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1783071341.459502:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b06198c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+19:6513:x1869685707532672:12345-0@lo:256: 20000000:01000000:0.0:1783071341.459523:0:6510:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783071341.459545:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783071341.459548:0:6510:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1783071341.459629:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b06198c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+19:6513:x1869685707532672:12345-0@lo:256: Request processed in 127us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071341.459643:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1783071341.459678:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b2fcb0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707532672:0@lo:256: 10000000:01000000:0.0:1783071341.459725:0:6513:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783071341.459733:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461400/0x6b58994c2cbdbe2c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbe33 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071341.459743:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461400/0x6b58994c2cbdbe2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbe33 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783071341.459766:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1783071341.459770:0:6513:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1783071341.459773:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1783071341.459799:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460200/0x6b58994c2cbdbe3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071341.459808:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460200/0x6b58994c2cbdbe3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071341.459818:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460200/0x6b58994c2cbdbe3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071341.459842:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b2fcb0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707532800:0@lo:101: 00000100:00100000:0.0:1783071341.459867:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071341.459891:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b03fef6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783071341.459906:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707532800 00000100:00100000:0.0:1783071341.459909:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707532800 00000100:00100000:0.0:1783071341.460065:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1783071341.460072:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18686850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+19:6513:x1869685707532800:12345-0@lo:101: 00010000:00010000:0.0:1783071341.460089:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071341.460105:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b3c461800/0x6b58994c2cbdbe41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdbe3a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071341.460126:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b3c461800/0x6b58994c2cbdbe41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdbe3a expref: 20 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071341.460136:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b3c461800/0x6b58994c2cbdbe41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbe3a expref: 20 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071341.460144:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b3c461800, rc 0) 40000000:02000000:1.0:1783071341.460162:0:6524:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:0.0:1783071341.460174:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18686850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+20:6513:x1869685707532800:12345-0@lo:101: Request processed in 103us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071341.460180:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1783071341.460210:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b2fcb0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707532800:0@lo:101: 00010000:00010000:0.0:1783071341.460220:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460200/0x6b58994c2cbdbe3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbe41 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071341.460229:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460200/0x6b58994c2cbdbe3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdbe41 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071341.460291:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b2fcb0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707532928:0@lo:501: 00000100:00100000:0.0:1783071341.460315:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071341.460327:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b03fef6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783071341.460338:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707532928 00000100:00100000:0.0:1783071341.460341:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707532928 00000100:00100000:0.0:1783071341.460356:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1783071341.460379:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18684050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+20:6513:x1869685707532928:12345-0@lo:501: 00000100:00100000:0.0:1783071341.460519:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18684050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+20:6513:x1869685707532928:12345-0@lo:501: Request processed in 156us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071341.460526:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1783071341.460551:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b2fcb0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707532928:0@lo:501: 00000100:00100000:0.0:1783071341.460579:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b2fcb0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707533056:0@lo:503: 00000100:00100000:0.0:1783071341.460621:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071341.460652:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b03fef6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783071341.460666:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707533056 00000100:00100000:0.0:1783071341.460669:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707533056 00000100:00100000:0.0:1783071341.460688:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1783071341.460693:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18684450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+20:6513:x1869685707533056:12345-0@lo:503: 00000100:00100000:0.0:1783071341.460791:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18684450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+20:6513:x1869685707533056:12345-0@lo:503: Request processed in 97us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071341.460798:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1783071341.462272:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b2fcb0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707533056:0@lo:503: 00000100:00100000:2.0:1783071341.463109:0:8906:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01765f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:8906:1869685707533184:0@lo:502: 00000100:00100000:2.0:1783071341.463208:0:8906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071341.463263:0:8906:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b2fc82480 going to sleep for 11 seconds 00000100:00100000:0.0:1783071341.463331:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707533184 00000100:00100000:0.0:1783071341.463426:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707533184 00000100:00100000:0.0:1783071341.463663:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1783071341.463676:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18687050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+20:8906:x1869685707533184:12345-0@lo:502: 00000100:00100000:0.0:1783071341.464046:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18687050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+20:8906:x1869685707533184:12345-0@lo:502: Request processed in 209us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071341.464055:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1783071341.464155:0:8906:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01765f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:8906:1869685707533184:0@lo:502: 00000020:01000000:2.0:1783071341.464193:0:8906:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783071341.464203:0:8906:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1783071341.464212:0:8906:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071341.464215:0:8906:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1783071341.464222:0:8906:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1783071341.464226:0:8906:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.138@tcp to nid 0x20000c0a8cc8a (192.168.204.138@tcp) 00000020:01000000:2.0:1783071341.464269:0:8906:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1783071341.464273:0:8906:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783071341.464299:0:8906:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8f8b3c6c8000) 00000020:00000080:2.0:1783071341.464330:0:8906:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:2.0:1783071341.464343:0:8906:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1783071341.464474:0:8906:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1783071341.464481:0:8906:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:2.0:1783071341.464490:0:8906:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6b58994c2cbdbe4f 00010000:00080000:2.0:1783071341.464528:0:8906:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f8a01779800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.138@tcp at head 00010000:00010000:2.0:1783071341.464844:0:8906:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000100:00100000:1.0:1783071341.466834:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0178df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8438:x1869685707532160:12345-0@lo:700: Request processed in 14378us (14504us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071341.466851:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1783071341.466869:0:8438:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a0178d500 x1869685707532160/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1783071357 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071341.466894:0:8438:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0178d500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8438:1869685707532160:0@lo:700: 40000000:02000000:3.0:1783071341.467018:0:8438:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000001:00100000:1.0:1783071341.489680:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1783071341.489929:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8904:x1869685707532032:12345-0@lo:700: Request processed in 37699us (38576us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071341.489948:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1783071341.490080:0:8904:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8b0ab61880 x1869685707532032/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1783071357 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071341.490109:0:8904:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b0ab61880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8904:1869685707532032:0@lo:700: 00000040:01000000:2.0:1783071341.490465:0:8906:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1783071341.490648:0:8906:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1783071341.492345:0:8906:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783071341.492828:0:8906:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783071341.493160:0:8906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1783071341.493259:0:8906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1783071341.494352:0:8908:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783071341.494361:0:8908:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1783071341.495633:0:8906:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783071341.495649:0:8906:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1783071341.495699:0:8906:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1783071341.495731:0:8906:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6b58994c2cbdbe56 00000100:00080000:2.0:1783071341.495745:0:8906:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783071341.495765:0:8906:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8f8a01779800 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:2.0:1783071341.495812:0:8906:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8a01765f80 x1869685707533312/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783071341.496095:0:8906:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1783071341.496162:0:8906:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783071341.496166:0:8906:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071341.496168:0:8906:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1783071341.496171:0:8906:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783071341.496177:0:8906:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071341.496178:0:8906:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783071341.496181:0:8906:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783071341.496182:0:8906:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1783071341.496217:0:8906:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01766d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:8906:1869685707533440:0@lo:502: 00000100:00100000:2.0:1783071341.496326:0:8906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071341.496416:0:8906:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b2fc82780 going to sleep for 11 seconds 00000100:00100000:0.0:1783071341.496493:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869685707533312:0@lo:8: 00000100:00100000:0.0:1783071341.496537:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071341.496608:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707533312 00000100:00100000:0.0:1783071341.496623:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707533312 00000100:00100000:0.0:1783071341.496672:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783071341.496681:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b2fcb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3644:x1869685707533312:12345-0@lo:8: 00010000:00080000:0.0:1783071341.496714:0:8432:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 243 last 0 00000020:00000080:0.0:1783071341.496747:0:8432:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6b58994c2cbdbe5d 00002000:00100000:0.0:1783071341.496772:0:8432:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8f8b3e74f800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1783071341.496777:0:8432:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1783071341.496781:0:8432:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1783071341.496898:0:8432:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1783071341.496930:0:8432:0:(import.c:65:import_set_state_nolock()) ffff8f8b3e74d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783071341.496989:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b2fcb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1869685707533312:12345-0@lo:8: Request processed in 307us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071341.496996:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1783071341.497038:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a01765f80 x1869685707533312/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783071351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071341.497050:0:3644:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783071341.497060:0:3644:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1783071341.497068:0:3644:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1783071341.497074:0:3644:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1783071341.497076:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8f8a01779800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1783071341.497088:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1783071341.497093:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869685707533312:0@lo:8: 00000004:00080000:0.0:1783071341.498807:0:8908:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1783071341.498933:0:8908:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 243287568673ns, next at 0ns, rc = 0 00080000:00080000:0.0:1783071341.498944:0:8908:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1783071341.500130:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707533440 00000100:00100000:3.0:1783071341.500148:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707533440 00000100:00100000:3.0:1783071341.500269:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1783071341.500282:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18686450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+20:8906:x1869685707533440:12345-0@lo:502: 00000100:00100000:3.0:1783071341.500717:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18686450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+20:8906:x1869685707533440:12345-0@lo:502: Request processed in 437us (4390us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071341.500728:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1783071341.500870:0:8906:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01766d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:8906:1869685707533440:0@lo:502: 00000020:01000000:2.0:1783071341.500917:0:8906:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783071341.500927:0:8906:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071341.500929:0:8906:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:2.0:1783071341.500935:0:8906:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1783071341.501033:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1783071341.501057:0:6513:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1783071341.501072:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460200/0x6b58994c2cbdbe3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbe41 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071341.501083:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460200/0x6b58994c2cbdbe3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbe41 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071341.501094:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1783071341.501098:0:6513:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff8f8b06c74d40 from 1 10000000:01000000:2.0:1783071341.501101:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1783071341.501142:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b10966000/0x6b58994c2cbdbe64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071341.501152:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8b10966000/0x6b58994c2cbdbe64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071341.501162:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8b10966000/0x6b58994c2cbdbe64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071341.501186:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01766d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707533568:0@lo:101: 00000100:00100000:2.0:1783071341.501234:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071341.501275:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b2fc82780 going to sleep for 11 seconds 00000100:00100000:2.0:1783071341.501294:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707533568 00000100:00100000:2.0:1783071341.501308:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707533568 00000100:00100000:2.0:1783071341.501344:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1783071341.501352:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18685c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+20:6513:x1869685707533568:12345-0@lo:101: 00010000:00010000:2.0:1783071341.501384:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071341.501399:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b10966600/0x6b58994c2cbdbe6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdbe64 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071341.501426:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b10966600/0x6b58994c2cbdbe6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdbe64 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071341.501438:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b10966600/0x6b58994c2cbdbe6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbe64 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071341.501450:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b10966600, rc 0) 00000100:00100000:2.0:1783071341.501482:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18685c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+21:6513:x1869685707533568:12345-0@lo:101: Request processed in 131us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071341.501488:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1783071341.501520:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01766d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707533568:0@lo:101: 00010000:00010000:2.0:1783071341.501533:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8b10966000/0x6b58994c2cbdbe64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbe6b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071341.501542:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8b10966000/0x6b58994c2cbdbe64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdbe6b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071341.501600:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01766d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707533696:0@lo:501: 00000100:00100000:2.0:1783071341.501625:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071341.501637:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b2fc82780 going to sleep for 11 seconds 00000100:00100000:2.0:1783071341.501648:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707533696 00000100:00100000:2.0:1783071341.501651:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707533696 00000100:00100000:2.0:1783071341.501676:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1783071341.501682:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18686050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+21:6513:x1869685707533696:12345-0@lo:501: 00000100:00100000:2.0:1783071341.501773:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18686050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+21:6513:x1869685707533696:12345-0@lo:501: Request processed in 90us (147us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783071341.501780:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1783071341.501810:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01766d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707533696:0@lo:501: 10000000:01000000:2.0:1783071341.501829:0:6513:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1783071341.501836:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b10966000/0x6b58994c2cbdbe64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbe6b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071341.501843:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8b10966000/0x6b58994c2cbdbe64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbe6b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783071341.513234:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:1.0:1783071341.513583:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000004:00080000:2.0:1783071341.513662:0:8909:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1783071341.513737:0:8909:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01765c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8909:1869685707533952:0@lo:7: 00000100:00100000:2.0:1783071341.513849:0:8909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071341.513894:0:8909:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b2fc82780 going to sleep for 11 seconds 00000100:00100000:1.0:1783071341.513982:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01766d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707533824:0@lo:13: 00000100:00100000:1.0:1783071341.514102:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071341.514254:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707533824 00000100:00100000:2.0:1783071341.514263:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707533824 00000100:00100000:2.0:1783071341.514416:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783071341.514429:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1869685707533824:12345-0@lo:13: 00002000:00000024:2.0:1783071341.514478:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:2.0:1783071341.514551:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1869685707533824:12345-0@lo:13: Request processed in 125us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071341.514561:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783071341.514565:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707533952 00000100:00100000:3.0:1783071341.514570:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707533952 00000100:00100000:3.0:1783071341.514621:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783071341.514629:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8909:x1869685707533952:12345-0@lo:7: 00000100:00080000:1.0:1783071341.514872:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783071341.514911:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a01766d80 x1869685707533824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071357 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071341.514936:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01766d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707533824:0@lo:13: 00000001:00100000:0.0:1783071341.515560:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000004:00080000:2.0:1783071341.515561:0:8904:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1783071341.515585:0:8904:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01764e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8904:1869685707534208:0@lo:7: 00000100:00100000:0.0:1783071341.515594:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783071341.515611:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01767800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707534080:0@lo:13: 00000100:00100000:2.0:1783071341.515664:0:8904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071341.515671:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071341.515735:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707534080 00000100:00100000:0.0:1783071341.515741:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707534080 00000100:00100000:0.0:1783071341.515797:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783071341.515806:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b2fcb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707534080:12345-0@lo:13: 00000100:00100000:2.0:1783071341.515846:0:8431:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1783071341.515854:0:8431:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1783071341.515871:0:8904:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b2fc82e40 going to sleep for 11 seconds 00002000:00000024:0.0:1783071341.516443:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:0.0:1783071341.516525:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b2fcb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707534080:12345-0@lo:13: Request processed in 719us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071341.516535:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1783071341.516721:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a01767800 x1869685707534080/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071357 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071341.516743:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01767800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707534080:0@lo:13: 00000100:00100000:2.0:1783071341.519028:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707534208 00000100:00100000:2.0:1783071341.519041:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707534208 00000100:00100000:0.0:1783071341.519280:0:8910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783071341.519292:0:8910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8904:x1869685707534208:12345-0@lo:7: 00002000:00080000:2.0:1783071341.524269:0:8429:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1783071341.524282:0:8429:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1783071341.525068:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8909:x1869685707533952:12345-0@lo:7: Request processed in 9798us (10578us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071341.525085:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1783071341.525247:0:8909:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a01765c00 x1869685707533952/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783071357 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071341.525269:0:8909:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01765c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8909:1869685707533952:0@lo:7: 00000004:00080000:2.0:1783071341.525290:0:8909:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1783071341.525346:0:8909:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01765c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8909:1869685707534336:0@lo:5: 00000100:00100000:2.0:1783071341.526102:0:8909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071341.526473:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707534336 00000100:00100000:1.0:1783071341.526484:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707534336 00000100:00100000:2.0:1783071341.526731:0:8909:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b2fc82780 going to sleep for 11 seconds 00000100:00100000:1.0:1783071341.527764:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783071341.527784:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8909:x1869685707534336:12345-0@lo:5: 00002000:00080000:1.0:1783071341.527831:0:8431:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1783071341.527838:0:8431:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00002000:00080000:0.0:1783071341.531184:0:8910:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1783071341.531197:0:8910:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1783071341.531442:0:8910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8904:x1869685707534208:12345-0@lo:7: Request processed in 12146us (15772us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071341.531456:0:8910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1783071341.531616:0:8904:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a01764e00 x1869685707534208/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783071357 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071341.531634:0:8904:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01764e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8904:1869685707534208:0@lo:7: 00000004:00080000:3.0:1783071341.531654:0:8904:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:3.0:1783071341.531711:0:8904:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0178d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8904:1869685707534464:0@lo:5: 00000100:00100000:3.0:1783071341.531766:0:8904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071341.531855:0:8904:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b06c44780 going to sleep for 11 seconds 00000100:00100000:0.0:1783071341.531895:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707534464 00000100:00100000:0.0:1783071341.531903:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707534464 00000100:00100000:0.0:1783071341.531986:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783071341.532007:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0178ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8904:x1869685707534464:12345-0@lo:5: 00002000:00080000:0.0:1783071341.532045:0:8429:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:0.0:1783071341.532084:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0178ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8904:x1869685707534464:12345-0@lo:5: Request processed in 79us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071341.532090:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1783071341.532803:0:8904:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a0178d500 x1869685707534464/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783071357 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071341.532819:0:8904:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0178d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8904:1869685707534464:0@lo:5: 00000004:00080000:2.0:1783071341.533034:0:8904:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:2.0:1783071341.533080:0:8904:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01765f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8904:1869685707534592:0@lo:5: 00000100:00100000:2.0:1783071341.533227:0:8904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071341.533258:0:8904:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b2fc82900 going to sleep for 11 seconds 00000100:00100000:0.0:1783071341.533611:0:8910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707534592 00000100:00100000:0.0:1783071341.533619:0:8910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707534592 00000100:00100000:0.0:1783071341.533673:0:8910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783071341.533681:0:8910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8904:x1869685707534592:12345-0@lo:5: 00002000:00080000:0.0:1783071341.533728:0:8910:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1783071341.537388:0:8910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:8904:x1869685707534592:12345-0@lo:5: Request processed in 3680us (4134us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1783071341.537405:0:8910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1783071341.537822:0:8904:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a01765f80 x1869685707534592/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783071357 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071341.538252:0:8904:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01765f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8904:1869685707534592:0@lo:5: 00000004:00080000:3.0:1783071341.538279:0:8904:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:3.0:1783071341.538353:0:8904:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0178dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8904:1869685707534720:0@lo:900: 00000100:00100000:1.0:1783071341.543397:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8909:x1869685707534336:12345-0@lo:5: Request processed in 15604us (17282us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1783071341.543416:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1783071341.544596:0:8909:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a01765c00 x1869685707534336/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783071357 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071341.544622:0:8909:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01765c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8909:1869685707534336:0@lo:5: 00000004:00080000:1.0:1783071341.544651:0:8909:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1783071341.544714:0:8909:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b0ab62300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8909:1869685707534848:0@lo:700: 00000100:00100000:1.0:1783071341.544806:0:8909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071341.545615:0:8909:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b1805a780 going to sleep for 11 seconds 00000100:00100000:3.0:1783071341.546305:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707534848 00000100:00100000:3.0:1783071341.546319:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707534848 00000100:00100000:3.0:1783071341.547598:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783071341.547615:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:8909:x1869685707534848:12345-0@lo:700: 00000100:00100000:3.0:1783071341.548666:0:8904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071341.548744:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707534720 00000100:00100000:3.0:1783071341.548771:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707534720 00000100:00100000:3.0:1783071341.549675:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783071341.549694:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0178c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8904:x1869685707534720:12345-0@lo:900: 00000100:00100000:3.0:1783071341.549797:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0178c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8904:x1869685707534720:12345-0@lo:900: Request processed in 110us (1139us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071341.556827:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783071341.556896:0:8904:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b06c44480 going to sleep for 11 seconds 00010000:00080000:3.0:1783071341.556951:0:8904:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a0178dc00 x1869685707534720/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783071357 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071341.556970:0:8904:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0178dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8904:1869685707534720:0@lo:900: 00000001:00080000:0.0:1783071341.571103:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00080000:0.0:1783071341.571120:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:0.0:1783071341.571360:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8909:x1869685707534848:12345-0@lo:700: Request processed in 23744us (26548us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071341.571408:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1783071341.572108:0:8909:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8b0ab62300 x1869685707534848/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1783071357 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071341.572126:0:8909:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1783071341.572154:0:8909:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b0ab62300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8909:1869685707534848:0@lo:700: 00000004:02000040:1.0:1783071341.578152:0:8909:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:1.0:1783071341.587544:0:8909:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b0ab62300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8909:1869685707534976:0@lo:5: 00000100:00100000:1.0:1783071341.587649:0:8909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071341.587720:0:8909:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b1805a780 going to sleep for 11 seconds 00000100:00100000:0.0:1783071341.588318:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707534976 00000100:00100000:0.0:1783071341.588330:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707534976 00000100:00100000:0.0:1783071341.588408:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783071341.588419:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8909:x1869685707534976:12345-0@lo:5: 00002000:00080000:0.0:1783071341.595923:0:8429:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1783071341.595953:0:8429:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:0.0:1783071341.600801:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8909:x1869685707534976:12345-0@lo:5: Request processed in 12372us (13141us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1783071341.600820:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1783071341.602690:0:8909:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8b0ab62300 x1869685707534976/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783071357 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071341.603208:0:8909:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b0ab62300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8909:1869685707534976:0@lo:5: 00000004:00080000:1.0:1783071341.603233:0:8909:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:0.0:1783071341.833092:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783071342.575808:0:8959:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783071342.576062:0:8959:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783071342.852155:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071342.915244:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0178dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707535104:0@lo:41: 00000100:00100000:0.0:1783071342.915359:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071342.917512:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707535104 00000100:00100000:0.0:1783071342.917530:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707535104 00000100:00100000:0.0:1783071342.917605:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783071342.917618:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b2fcb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707535104:12345-0@lo:41: 00000004:00000024:0.0:1783071342.917837:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1783071342.917956:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b2fcb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707535104:12345-0@lo:41: Request processed in 340us (2598us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071342.917965:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783071342.918892:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0178dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707535104:0@lo:41: 00000020:00000004:0.0:1783071343.577329:0:9008:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783071343.577343:0:9008:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:3.0:1783071343.874761:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071344.901931:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071345.923410:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071346.498986:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b2fcb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707535232:0@lo:41: 00000100:00100000:3.0:1783071346.499195:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0178f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:feaa1501-b927-4e07-baad-3200e92d7497:3648:1869685707535360:0@lo:400: 00000100:00100000:2.0:1783071346.499255:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0178f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707535616:0@lo:400: 00000100:00100000:3.0:1783071346.500248:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071346.500336:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0178e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869685707535744:0@lo:400: 00000100:00100000:1.0:1783071346.500433:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707535360 00000100:00100000:1.0:1783071346.500444:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707535360 00000100:00100000:3.0:1783071346.500479:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071346.500519:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1783071346.500542:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18687c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+21:3648:x1869685707535360:12345-0@lo:400: 00000100:00100000:3.0:1783071346.500621:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0178ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707536256:0@lo:400: 00000100:00100000:3.0:1783071346.501467:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071346.501552:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0178f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:feaa1501-b927-4e07-baad-3200e92d7497:3648:1869685707535360:0@lo:400: 00000100:00100000:3.0:1783071346.501607:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707535744 00000100:00100000:3.0:1783071346.501630:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707535744 00000100:00100000:3.0:1783071346.501691:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783071346.501699:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0178e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869685707535744:12345-0@lo:400: 00000100:00100000:3.0:1783071346.501758:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0178e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869685707535744:12345-0@lo:400: Request processed in 59us (1278us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071346.501766:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1783071346.503159:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a0178e680 x1869685707535744/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071346.503187:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0178e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869685707535744:0@lo:400: 00000100:00100000:1.0:1783071346.506328:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18687c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+21:3648:x1869685707535360:12345-0@lo:400: Request processed in 5780us (6066us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071346.506355:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1783071346.506887:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071346.506948:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0178d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1869685707536128:0@lo:400: 00000100:00100000:2.0:1783071346.506997:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071346.507048:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707536128 00000100:00100000:2.0:1783071346.507077:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707536128 00000100:00100000:1.0:1783071346.507086:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707535616 00000100:00100000:1.0:1783071346.507092:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707535616 00000100:00100000:1.0:1783071346.507147:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783071346.507159:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01765500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707535616:12345-0@lo:400: 00000100:00100000:3.0:1783071346.507184:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783071346.507198:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01766a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869685707536128:12345-0@lo:400: 00000100:00100000:1.0:1783071346.507272:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01765500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707535616:12345-0@lo:400: Request processed in 115us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071346.507276:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01766a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869685707536128:12345-0@lo:400: Request processed in 81us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071346.507285:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783071346.507290:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1783071346.507313:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783071346.509860:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0178f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707535616:0@lo:400: 00010000:00080000:1.0:1783071346.509918:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a0178d500 x1869685707536128/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071346.509936:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0178d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1869685707536128:0@lo:400: 00000100:00100000:1.0:1783071346.510849:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0178ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869685707535488:0@lo:400: 00000100:00100000:1.0:1783071346.510943:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071346.510990:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0178dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1869685707536000:0@lo:400: 00000100:00100000:3.0:1783071346.511474:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707535488 00000100:00100000:3.0:1783071346.511486:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707535488 00000100:00100000:3.0:1783071346.511562:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783071346.511573:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869685707535488:12345-0@lo:400: 00000100:00100000:3.0:1783071346.511651:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869685707535488:12345-0@lo:400: Request processed in 79us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071346.511670:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783071346.512141:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1783071346.512201:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a0178ce00 x1869685707535488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071346.512217:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0178ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869685707535488:0@lo:400: 00000100:00100000:1.0:1783071346.512236:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1783071346.512245:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0178f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707535872:0@lo:400: 00000100:00100000:1.0:1783071346.512275:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071346.512296:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0178ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707536384:0@lo:400: 00000100:00100000:1.0:1783071346.512352:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071346.512407:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707536256 00000100:00100000:1.0:1783071346.512412:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707536256 00000100:00100000:2.0:1783071346.512433:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707536000 00000100:00100000:2.0:1783071346.512440:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707536000 00000100:00100000:1.0:1783071346.512457:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707536384 00000100:00100000:1.0:1783071346.512461:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707536384 00000100:00100000:2.0:1783071346.512485:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783071346.512497:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783071346.512512:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0178d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707536256:12345-0@lo:400: 00000100:00100000:1.0:1783071346.512558:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0178d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707536256:12345-0@lo:400: Request processed in 47us (11095us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071346.512565:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783071346.512581:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783071346.512588:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869685707536000:12345-0@lo:400: 00000100:00100000:1.0:1783071346.512590:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c79ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1869685707536384:12345-0@lo:400: 00000100:00100000:1.0:1783071346.512623:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c79ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1869685707536384:12345-0@lo:400: Request processed in 36us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071346.512629:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1783071346.512652:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a0178ca80 x1869685707536384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071346.512674:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0178ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707536384:0@lo:400: 00000100:00100000:2.0:1783071346.512837:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869685707536000:12345-0@lo:400: Request processed in 344us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071346.512845:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1783071346.512891:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a0178dc00 x1869685707536000/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071346.512903:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0178dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1869685707536000:0@lo:400: 00010000:00080000:3.0:1783071346.513025:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a0178ea00 x1869685707536256/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071346.513036:0:3648:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1783071346.513049:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0178ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707536256:0@lo:400: 00000100:00100000:0.0:1783071346.513424:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071346.513459:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707535872 00000100:00100000:0.0:1783071346.513464:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707535872 00000100:00100000:0.0:1783071346.513492:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707535232 00000100:00100000:0.0:1783071346.513495:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707535232 00000100:00100000:0.0:1783071346.513509:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783071346.513516:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707535872:12345-0@lo:400: 00000100:00100000:0.0:1783071346.513571:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707535872:12345-0@lo:400: Request processed in 55us (1295us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071346.513585:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783071346.513601:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783071346.513607:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b2fcb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707535232:12345-0@lo:41: 00000004:00000024:0.0:1783071346.513637:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1783071346.513688:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b2fcb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707535232:12345-0@lo:41: Request processed in 81us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071346.513695:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783071346.513730:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b2fcb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707535232:0@lo:41: 00000100:00080000:1.0:1783071346.514986:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783071346.515503:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783071346.515880:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0178f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707535872:0@lo:400: 00010000:00010000:2.0:1783071346.946499:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071347.011785:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0178f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707536640:0@lo:13: 00000100:00100000:2.0:1783071347.011889:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071347.012004:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707536512:0@lo:13: 00000100:00100000:3.0:1783071347.012045:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071347.012133:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707536640 00000100:00100000:2.0:1783071347.012143:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707536640 00000100:00100000:2.0:1783071347.012191:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707536512 00000100:00100000:2.0:1783071347.012195:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707536512 00000100:00100000:2.0:1783071347.012211:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783071347.012236:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707536640:12345-0@lo:13: 00002000:00000024:2.0:1783071347.012277:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783071347.012336:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707536640:12345-0@lo:13: Request processed in 102us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071347.012343:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783071347.012704:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783071347.012716:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0178ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1869685707536512:12345-0@lo:13: 00002000:00000024:2.0:1783071347.012731:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783071347.012762:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0178ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1869685707536512:12345-0@lo:13: Request processed in 50us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071347.012769:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1783071347.013052:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a01765880 x1869685707536512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071363 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071347.013079:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707536512:0@lo:13: 00010000:00080000:3.0:1783071347.013121:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a0178f480 x1869685707536640/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071363 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071347.013137:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0178f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707536640:0@lo:13: 00000001:00080000:2.0:1783071347.013955:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:2.0:1783071347.971532:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071348.034937:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707536768:0@lo:41: 00000100:00100000:2.0:1783071348.035016:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071348.035093:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707536768 00000100:00100000:2.0:1783071348.035101:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707536768 00000100:00100000:2.0:1783071348.035145:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783071348.035153:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01764a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707536768:12345-0@lo:41: 00000004:00000024:2.0:1783071348.035190:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1783071348.035352:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01764a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707536768:12345-0@lo:41: Request processed in 198us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071348.036078:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783071348.036139:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707536768:0@lo:41: 00010000:00010000:1.0:1783071348.994560:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071350.020786:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071351.046339:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071351.618986:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b2fcb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707536896:0@lo:41: 00000100:00100000:2.0:1783071351.619084:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071351.619130:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707536896 00000100:00100000:1.0:1783071351.619138:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707536896 00000100:00100000:1.0:1783071351.619183:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783071351.619217:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707536896:12345-0@lo:41: 00000004:00000024:1.0:1783071351.619257:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1783071351.619310:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707536896:12345-0@lo:41: Request processed in 95us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071351.619445:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b2fcb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869685707537152:0@lo:400: 00000100:00100000:0.0:1783071351.619476:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071351.619503:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b078db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1869685707537664:0@lo:400: 00000100:00100000:0.0:1783071351.619525:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071351.619544:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1783071351.619549:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b2fcb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869685707537280:0@lo:400: 00000100:00100000:0.0:1783071351.619591:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071351.619610:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b078daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707537792:0@lo:400: 00000100:00100000:0.0:1783071351.619633:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071351.619670:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707537152 00000100:00100000:0.0:1783071351.619674:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707537152 00000100:00100000:0.0:1783071351.619696:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707537664 00000100:00100000:0.0:1783071351.619699:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707537664 00000100:00100000:0.0:1783071351.619722:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707537280 00000100:00100000:0.0:1783071351.619725:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707537280 00000100:00100000:0.0:1783071351.619737:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783071351.619743:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b078d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869685707537152:12345-0@lo:400: 00000100:00100000:0.0:1783071351.619779:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b078d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869685707537152:12345-0@lo:400: Request processed in 36us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071351.619786:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783071351.619804:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783071351.619810:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b078db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869685707537664:12345-0@lo:400: 00000100:00100000:0.0:1783071351.619837:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b078db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869685707537664:12345-0@lo:400: Request processed in 27us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071351.619842:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783071351.619854:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783071351.619859:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37a60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869685707537280:12345-0@lo:400: 00000100:00100000:0.0:1783071351.619881:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37a60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869685707537280:12345-0@lo:400: Request processed in 22us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071351.619896:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783071351.619921:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707537792 00000100:00100000:0.0:1783071351.619924:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707537792 00000100:00100000:0.0:1783071351.619951:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783071351.619957:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37a60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707537792:12345-0@lo:400: 00000100:00100000:0.0:1783071351.619988:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37a60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707537792:12345-0@lo:400: Request processed in 31us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071351.619994:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1783071351.620008:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783071351.620012:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1783071351.620043:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8b2fcb2680 x1869685707537280/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071351.620058:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b2fcb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869685707537280:0@lo:400: 00010000:00080000:0.0:1783071351.620068:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8b078daa00 x1869685707537792/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071351.620076:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b078daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707537792:0@lo:400: 00010000:00080000:0.0:1783071351.620084:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8b2fcb2d80 x1869685707537152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071351.620091:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b2fcb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869685707537152:0@lo:400: 00010000:00080000:0.0:1783071351.620100:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8b078db480 x1869685707537664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071351.620107:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b078db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1869685707537664:0@lo:400: 00000100:00100000:3.0:1783071351.620201:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b2fcb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:feaa1501-b927-4e07-baad-3200e92d7497:3646:1869685707537024:0@lo:400: 00000100:00100000:3.0:1783071351.620237:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071351.620260:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b078dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1869685707537536:0@lo:400: 00000100:00100000:3.0:1783071351.620283:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071351.620298:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1783071351.620304:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b2fcb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707537408:0@lo:400: 00000100:00100000:3.0:1783071351.620325:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071351.620336:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b078d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707537920:0@lo:400: 00000100:00100000:3.0:1783071351.620355:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071351.620384:0:6522:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1783071351.620393:0:6522:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1783071351.620405:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707537024 00000100:00100000:3.0:1783071351.620410:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707537024 00000100:00100000:3.0:1783071351.620446:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1783071351.620453:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18685450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+21:3646:x1869685707537024:12345-0@lo:400: 00000100:00100000:3.0:1783071351.620488:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18685450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+21:3646:x1869685707537024:12345-0@lo:400: Request processed in 35us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071351.620494:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1783071351.620535:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b2fcb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:feaa1501-b927-4e07-baad-3200e92d7497:3646:1869685707537024:0@lo:400: 00000100:00100000:0.0:1783071351.620680:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707537920 00000100:00100000:0.0:1783071351.620684:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707537920 00000100:00100000:0.0:1783071351.620734:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783071351.620740:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0178f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707537920:12345-0@lo:400: 00000100:00100000:0.0:1783071351.620783:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0178f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707537920:12345-0@lo:400: Request processed in 43us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071351.620789:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783071351.620801:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b2fcb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707536896:0@lo:41: 00010000:00080000:0.0:1783071351.620828:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8b078d9500 x1869685707537920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071351.620837:0:3646:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:2.0:1783071351.620845:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707537408 00000100:00100000:2.0:1783071351.620850:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707537408 00000100:00100000:0.0:1783071351.620850:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b078d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707537920:0@lo:400: 00000100:00100000:0.0:1783071351.620881:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707537536 00000100:00100000:0.0:1783071351.620885:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707537536 00000100:00100000:0.0:1783071351.620915:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783071351.620921:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0178f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869685707537536:12345-0@lo:400: 00000100:00100000:2.0:1783071351.620955:0:9413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783071351.620961:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0178f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869685707537536:12345-0@lo:400: Request processed in 39us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071351.620966:0:9413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0178e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707537408:12345-0@lo:400: 00000100:00100000:0.0:1783071351.620972:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1783071351.621007:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8b078dbb80 x1869685707537536/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071351.621016:0:9413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0178e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707537408:12345-0@lo:400: Request processed in 52us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071351.621020:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b078dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1869685707537536:0@lo:400: 00000100:00100000:2.0:1783071351.621028:0:9413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783071351.621045:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b2fcb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707537408:0@lo:400: 00000100:00080000:3.0:1783071351.621090:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783071351.621094:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783071351.621291:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:2.0:1783071352.067142:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071352.130991:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783071352.131017:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707538048:0@lo:13: 00000100:00100000:2.0:1783071352.131104:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071352.131180:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707538048 00000100:00100000:2.0:1783071352.131188:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707538048 00000100:00100000:2.0:1783071352.131244:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783071352.131257:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01766680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707538048:12345-0@lo:13: 00002000:00000024:2.0:1783071352.131297:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783071352.131347:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01766680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707538048:12345-0@lo:13: Request processed in 92us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071352.131354:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1783071352.131430:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a01767480 x1869685707538048/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071368 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071352.131449:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707538048:0@lo:13: 00000100:00100000:1.0:1783071352.131646:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783071352.133754:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c79dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707538176:0@lo:13: 00000100:00100000:1.0:1783071352.133826:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071352.134070:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707538176 00000100:00100000:2.0:1783071352.134085:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707538176 00000100:00100000:2.0:1783071352.134142:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783071352.134151:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c79c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707538176:12345-0@lo:13: 00002000:00000024:2.0:1783071352.134176:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783071352.134227:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c79c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707538176:12345-0@lo:13: Request processed in 77us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071352.134234:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1783071352.134275:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8b3c79dc00 x1869685707538176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071368 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071352.134294:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c79dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707538176:0@lo:13: 00010000:00010000:0.0:1783071353.090643:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1783071353.130110:0:9508:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:3.0:1783071353.130115:0:9508:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1783071353.130116:0:9508:0:(obd_mount.c:920:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1783071353.131021:0:9508:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8f8b34e49800 00000020:01000004:3.0:1783071353.131049:0:9508:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1783071353.131068:0:9508:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1783071353.131087:0:9508:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8f8b3b5c3380) 00000020:00000080:3.0:1783071353.131109:0:9508:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00000100:00100000:2.0:1783071353.156328:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0178c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707538304:0@lo:41: 00000100:00100000:2.0:1783071353.156425:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071353.156569:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707538304 00000100:00100000:3.0:1783071353.156577:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707538304 00000100:00100000:3.0:1783071353.161058:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783071353.161075:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707538304:12345-0@lo:41: 00000004:00000024:3.0:1783071353.161126:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1783071353.161225:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707538304:12345-0@lo:41: Request processed in 155us (4800us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071353.161233:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783071353.161634:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0178c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707538304:0@lo:41: 00100000:10000000:0.0:1783071353.179310:0:9508:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1783071353.179384:0:9508:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:0.0:1783071353.212052:0:9508:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1783071353.212290:0:9508:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1783071353.212305:0:9508:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:0.0:1783071353.212321:0:9508:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x6b58994c2cbdbe79 00000020:01000004:0.0:1783071353.212328:0:9508:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1783071353.212353:0:9508:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.204.138@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1783071353.212357:0:9508:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.138@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1783071353.212386:0:9508:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1783071353.212422:0:9508:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1783071353.212426:0:9508:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.138@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1783071353.231790:0:9508:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.138@tcp ctxt 0 is initialized 00000020:01000004:1.0:1783071353.231828:0:9508:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.138@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1783071353.231832:0:9508:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1783071353.231834:0:9508:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783071353.231835:0:9508:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783071353.231836:0:9508:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783071353.231838:0:9508:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783071353.231839:0:9508:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783071353.231840:0:9508:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783071353.231842:0:9508:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783071353.231843:0:9508:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783071353.231845:0:9508:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783071353.231846:0:9508:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783071353.231849:0:9508:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1783071353.231852:0:9508:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783071353.231853:0:9508:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783071353.231854:0:9508:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783071353.231855:0:9508:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783071353.231855:0:9508:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783071353.231856:0:9508:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783071353.231857:0:9508:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783071353.231859:0:9508:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783071353.231859:0:9508:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783071353.231860:0:9508:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783071353.231861:0:9508:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783071353.231900:0:9508:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1783071353.231920:0:9508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c79f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:9508:1869685707538432:0@lo:253: 00000100:00100000:1.0:1783071353.231993:0:9508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071353.232102:0:9508:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0179e900 going to sleep for 11 seconds 00000100:00100000:2.0:1783071353.232186:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707538432 00000100:00100000:2.0:1783071353.232194:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707538432 00000100:00100000:2.0:1783071353.232252:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1783071353.232261:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18687450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+21:9508:x1869685707538432:12345-0@lo:253: 20000000:01000000:2.0:1783071353.232357:0:6508:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1783071353.232945:0:6508:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1783071353.232952:0:6508:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1783071353.232956:0:6508:0:(mgs_llog.c:3853:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1783071353.233226:0:6508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783071353.233352:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:2.0:1783071353.233618:0:6508:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1783071353.233711:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:3.0:1783071353.233721:0:6508:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1783071353.233734:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:3.0:1783071353.233750:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:3.0:1783071353.233847:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:3.0:1783071353.233863:0:6508:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.204.138@tcp 20000000:01000000:3.0:1783071353.233865:0:6508:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.204.138@tcp (null) (null) (null) 00000040:00080000:3.0:1783071353.233879:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:3.0:1783071353.233886:0:6508:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1783071353.233898:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:3.0:1783071353.233903:0:6508:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.138@tcp (null) (null) 00000040:00080000:3.0:1783071353.233913:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:3.0:1783071353.233925:0:6508:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1783071353.233934:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:3.0:1783071353.233942:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:3.0:1783071353.234010:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:3.0:1783071353.234022:0:6508:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.204.138@tcp 20000000:01000000:3.0:1783071353.234024:0:6508:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.204.138@tcp (null) (null) (null) 00000040:00080000:3.0:1783071353.234038:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:3.0:1783071353.234043:0:6508:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1783071353.234051:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:3.0:1783071353.234054:0:6508:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.204.138@tcp (null) (null) 00000040:00080000:3.0:1783071353.234065:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:3.0:1783071353.234071:0:6508:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1783071353.234082:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:3.0:1783071353.234095:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:3.0:1783071353.234848:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:3.0:1783071353.234860:0:6508:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.204.138@tcp 20000000:01000000:3.0:1783071353.234862:0:6508:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.204.138@tcp (null) (null) (null) 00000040:00080000:3.0:1783071353.234870:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:3.0:1783071353.234874:0:6508:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1783071353.234885:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:3.0:1783071353.234890:0:6508:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.138@tcp (null) (null) 00000040:00080000:3.0:1783071353.234904:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:3.0:1783071353.234909:0:6508:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1783071353.234919:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:3.0:1783071353.234931:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:3.0:1783071353.234943:0:6508:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1783071353.234945:0:6508:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1783071353.234949:0:6508:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1783071353.234987:0:6508:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1783071353.234990:0:6508:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1783071353.235679:0:9514:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:3.0:1783071353.235900:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:3.0:1783071353.235927:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:3.0:1783071353.235935:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:3.0:1783071353.235942:0:6508:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1783071353.235944:0:6508:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1783071353.236243:0:9515:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 36 marker 25 1->4: lustre sys.timeout 20000000:01000000:0.0:1783071353.236264:0:9515:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 38 marker 25 2->4: lustre sys.timeout 00000040:00080000:0.0:1783071353.236278:0:9515:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:3.0:1783071353.236753:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:3.0:1783071353.236775:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:3.0:1783071353.236790:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:3.0:1783071353.236799:0:6508:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1783071353.236801:0:6508:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1783071353.237110:0:9516:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 31 marker 26 1->4: lustre sys.timeout 20000000:01000000:1.0:1783071353.237138:0:9516:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 33 marker 26 2->4: lustre sys.timeout 00000040:00080000:1.0:1783071353.237152:0:9516:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:3.0:1783071353.237359:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:3.0:1783071353.238528:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:3.0:1783071353.238557:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:3.0:1783071353.238569:0:6508:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1783071353.238570:0:6508:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1783071353.239072:0:9517:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:1.0:1783071353.239092:0:9517:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:1.0:1783071353.239107:0:9517:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:3.0:1783071353.239284:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:3.0:1783071353.239558:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:3.0:1783071353.239601:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:3.0:1783071353.239612:0:6508:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1783071353.239614:0:6508:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1783071353.239903:0:9518:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 5 marker 28 1->4: lustre sys.timeout 20000000:01000000:1.0:1783071353.239938:0:9518:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 7 marker 28 2->4: lustre sys.timeout 00000040:00080000:1.0:1783071353.239948:0:9518:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1783071353.240104:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1783071353.240123:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:3.0:1783071353.240139:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 10000000:01000000:3.0:1783071353.240153:0:6508:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1783071353.240173:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f8b014b8a00/0x6b58994c2cbdbe80 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071353.240191:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8b014b9400/0x6b58994c2cbdbd76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbd6f expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071353.240199:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8b3c460c00/0x6b58994c2cbdbda0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbd99 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071353.240205:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8b10967600/0x6b58994c2cbdbddf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbdd8 expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071353.240218:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8b3c461a00/0x6b58994c2cbdbdfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbdf4 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071353.240224:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8b3c460000/0x6b58994c2cbdbe25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbe1e expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071353.240231:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8b3c461800/0x6b58994c2cbdbe41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbe3a expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071353.240237:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8b10966600/0x6b58994c2cbdbe6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbe64 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071353.240246:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f8b014b8a00/0x6b58994c2cbdbe80 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071353.240290:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8b10966600/0x6b58994c2cbdbe6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6b58994c2cbdbe64 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071353.240593:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8b10966600/0x6b58994c2cbdbe6b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6b58994c2cbdbe64 expref: 21 pid: 6511 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071353.240609:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0178c000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1869685707538560:0@lo:104: 00000100:00100000:3.0:1783071353.240674:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783071353.240759:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8b3c461800/0x6b58994c2cbdbe41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6b58994c2cbdbe3a expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071353.240768:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8b3c461800/0x6b58994c2cbdbe41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6b58994c2cbdbe3a expref: 21 pid: 6508 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071353.240776:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0178ca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1869685707538688:0@lo:104: 00000100:00100000:3.0:1783071353.240805:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783071353.240918:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8b3c460000/0x6b58994c2cbdbe25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6b58994c2cbdbe1e expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071353.240927:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8b3c460000/0x6b58994c2cbdbe25 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6b58994c2cbdbe1e expref: 21 pid: 6510 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071353.240935:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0178d500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1869685707538816:0@lo:104: 00000100:00100000:3.0:1783071353.240951:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071353.240971:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707538560 00000100:00100000:2.0:1783071353.240978:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707538560 00000100:00100000:0.0:1783071353.241023:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707538688 00000100:00100000:0.0:1783071353.241026:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707538688 00000100:00100000:0.0:1783071353.241045:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783071353.241053:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0178dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:feaa1501-b927-4e07-baad-3200e92d7497+4:6508:x1869685707538560:12345-0@lo:104: 00010000:00010000:0.0:1783071353.241064:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8f8b10966000/0x6b58994c2cbdbe64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbe6b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071353.241120:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783071353.241126:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0178dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:feaa1501-b927-4e07-baad-3200e92d7497+4:6508:x1869685707538560:12345-0@lo:104: Request processed in 74us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071353.241133:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783071353.241149:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783071353.241155:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0178ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:feaa1501-b927-4e07-baad-3200e92d7497+3:6508:x1869685707538688:12345-0@lo:104: 00010000:00010000:0.0:1783071353.241162:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460200/0x6b58994c2cbdbe3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbe41 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071353.241194:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783071353.241199:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0178ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:feaa1501-b927-4e07-baad-3200e92d7497+3:6508:x1869685707538688:12345-0@lo:104: Request processed in 44us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071353.241211:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:0.0:1783071353.241229:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783071353.241235:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8b10966000/0x6b58994c2cbdbe64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbe6b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071353.241242:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b10966000 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:0.0:1783071353.241245:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8b10966000/0x6b58994c2cbdbe64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x6b58994c2cbdbe6b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071353.241254:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8b10966000/0x6b58994c2cbdbe64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x6b58994c2cbdbe6b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783071353.241260:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8b10966000/0x6b58994c2cbdbe64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x6b58994c2cbdbe6b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783071353.241265:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783071353.241301:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8f8b10966000/0x6b58994c2cbdbe64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbe6b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071353.241308:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783071353.241328:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8b10966000/0x6b58994c2cbdbe64 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbe6b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071353.241335:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8b10966000/0x6b58994c2cbdbe64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbe6b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071353.241349:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783071353.241352:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460200/0x6b58994c2cbdbe3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbe41 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071353.241389:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b3c460200 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:0.0:1783071353.241392:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460200/0x6b58994c2cbdbe3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x6b58994c2cbdbe41 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071353.241399:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460200/0x6b58994c2cbdbe3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x6b58994c2cbdbe41 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783071353.241405:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460200/0x6b58994c2cbdbe3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x6b58994c2cbdbe41 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783071353.241410:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783071353.241424:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460200/0x6b58994c2cbdbe3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbe41 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071353.241429:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783071353.241434:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460200/0x6b58994c2cbdbe3a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbe41 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071353.241439:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460200/0x6b58994c2cbdbe3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbe41 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071353.241460:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071353.241462:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071353.241464:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071353.241512:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071353.241724:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8b3c461a00/0x6b58994c2cbdbdfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6b58994c2cbdbdf4 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071353.241734:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8b3c461a00/0x6b58994c2cbdbdfb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6b58994c2cbdbdf4 expref: 21 pid: 6510 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071353.241743:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02c0ad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1869685707539200:0@lo:104: 00000100:00100000:3.0:1783071353.241768:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783071353.241785:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8b10967600/0x6b58994c2cbdbddf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6b58994c2cbdbdd8 expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071353.241792:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8b10967600/0x6b58994c2cbdbddf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6b58994c2cbdbdd8 expref: 21 pid: 6508 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071353.241800:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02c08700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1869685707539328:0@lo:104: 00000100:00100000:3.0:1783071353.241819:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783071353.241834:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8b3c460c00/0x6b58994c2cbdbda0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6b58994c2cbdbd99 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071353.241841:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8b3c460c00/0x6b58994c2cbdbda0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6b58994c2cbdbd99 expref: 21 pid: 6510 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071353.241860:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02c08e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1869685707539456:0@lo:104: 00000100:00100000:3.0:1783071353.241883:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783071353.241899:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8b014b9400/0x6b58994c2cbdbd76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6b58994c2cbdbd6f expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071353.241907:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8b014b9400/0x6b58994c2cbdbd76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6b58994c2cbdbd6f expref: 21 pid: 6510 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071353.241915:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02c0b100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1869685707539584:0@lo:104: 00000100:00100000:3.0:1783071353.241941:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b34e1c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071353.241960:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0178c000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1869685707538560:0@lo:104: 00000100:00100000:3.0:1783071353.241967:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0178ca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1869685707538688:0@lo:104: 00000100:00100000:3.0:1783071353.241983:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37a62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:feaa1501-b927-4e07-baad-3200e92d7497:3646:1869685707539072:0@lo:103: 00000100:00100000:3.0:1783071353.242002:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071353.242062:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783071353.242068:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37a61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:feaa1501-b927-4e07-baad-3200e92d7497:3646:1869685707538944:0@lo:103: 00000100:00100000:3.0:1783071353.242086:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071353.242148:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1783071353.242166:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071353.242175:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707538816 00000100:00100000:2.0:1783071353.242185:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707538816 00000100:00100000:2.0:1783071353.242206:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707539200 00000100:00100000:2.0:1783071353.242209:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707539200 00000100:00100000:2.0:1783071353.242218:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707539328 00000100:00100000:2.0:1783071353.242221:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707539328 00000100:00100000:2.0:1783071353.242229:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707539456 00000100:00100000:2.0:1783071353.242231:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707539456 00000100:00100000:2.0:1783071353.242237:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707539584 00000100:00100000:2.0:1783071353.242239:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707539584 00000100:00100000:2.0:1783071353.242248:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783071353.242253:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0178f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:feaa1501-b927-4e07-baad-3200e92d7497+7:6508:x1869685707538816:12345-0@lo:104: 00010000:00010000:2.0:1783071353.242261:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8c00/0x6b58994c2cbdbe1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbe25 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.242313:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783071353.242319:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0178f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:feaa1501-b927-4e07-baad-3200e92d7497+7:6508:x1869685707538816:12345-0@lo:104: Request processed in 66us (1366us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071353.242325:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783071353.242337:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783071353.242343:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02c09c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:feaa1501-b927-4e07-baad-3200e92d7497+6:6508:x1869685707539200:12345-0@lo:104: 00010000:00010000:2.0:1783071353.242350:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8f8b421d8600/0x6b58994c2cbdbdf4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbdfb expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.242399:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783071353.242404:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02c09c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:feaa1501-b927-4e07-baad-3200e92d7497+6:6508:x1869685707539200:12345-0@lo:104: Request processed in 62us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071353.242410:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783071353.242422:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783071353.242427:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02c0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:feaa1501-b927-4e07-baad-3200e92d7497+5:6508:x1869685707539328:12345-0@lo:104: 00010000:00010000:2.0:1783071353.242442:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9e00/0x6b58994c2cbdbdd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbddf expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.242476:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1783071353.242481:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02c0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:feaa1501-b927-4e07-baad-3200e92d7497+5:6508:x1869685707539328:12345-0@lo:104: Request processed in 54us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071353.242486:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783071353.242497:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783071353.242501:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01791450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:feaa1501-b927-4e07-baad-3200e92d7497+4:6508:x1869685707539456:12345-0@lo:104: 00010000:00010000:2.0:1783071353.242507:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8f8b014b9200/0x6b58994c2cbdbd99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbda0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.242526:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1783071353.242530:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01791450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:feaa1501-b927-4e07-baad-3200e92d7497+4:6508:x1869685707539456:12345-0@lo:104: Request processed in 29us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071353.242545:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783071353.242570:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783071353.242575:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01765880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:feaa1501-b927-4e07-baad-3200e92d7497+3:6508:x1869685707539584:12345-0@lo:104: 00010000:00010000:2.0:1783071353.242582:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8f8b10967000/0x6b58994c2cbdbd6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbd76 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.242601:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1783071353.242606:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01765880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:feaa1501-b927-4e07-baad-3200e92d7497+3:6508:x1869685707539584:12345-0@lo:104: Request processed in 31us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071353.242611:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1783071353.242627:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783071353.242631:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8c00/0x6b58994c2cbdbe1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbe25 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.242644:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b014b8c00 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:2.0:1783071353.242647:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8c00/0x6b58994c2cbdbe1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x6b58994c2cbdbe25 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.242654:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8c00/0x6b58994c2cbdbe1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x6b58994c2cbdbe25 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783071353.242660:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8c00/0x6b58994c2cbdbe1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x6b58994c2cbdbe25 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071353.242665:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783071353.242687:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8c00/0x6b58994c2cbdbe1e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbe25 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.242694:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783071353.242706:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8c00/0x6b58994c2cbdbe1e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbe25 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.242713:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8c00/0x6b58994c2cbdbe1e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbe25 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.242723:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783071353.242726:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8b421d8600/0x6b58994c2cbdbdf4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbdfb expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.242731:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b421d8600 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:2.0:1783071353.242734:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8b421d8600/0x6b58994c2cbdbdf4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x6b58994c2cbdbdfb expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.242750:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8b421d8600/0x6b58994c2cbdbdf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x6b58994c2cbdbdfb expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783071353.242757:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8b421d8600/0x6b58994c2cbdbdf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x6b58994c2cbdbdfb expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071353.242762:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783071353.242772:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8f8b421d8600/0x6b58994c2cbdbdf4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbdfb expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.242777:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783071353.242781:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8b421d8600/0x6b58994c2cbdbdf4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbdfb expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.242787:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8b421d8600/0x6b58994c2cbdbdf4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbdfb expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.242796:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783071353.242798:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9e00/0x6b58994c2cbdbdd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbddf expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.242803:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b421d9e00 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:2.0:1783071353.242806:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9e00/0x6b58994c2cbdbdd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6b58994c2cbdbddf expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.242813:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9e00/0x6b58994c2cbdbdd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6b58994c2cbdbddf expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783071353.242818:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9e00/0x6b58994c2cbdbdd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6b58994c2cbdbddf expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071353.242827:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783071353.242836:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9e00/0x6b58994c2cbdbdd8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbddf expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.242841:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783071353.242848:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9e00/0x6b58994c2cbdbdd8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbddf expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.242854:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9e00/0x6b58994c2cbdbdd8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbddf expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.242863:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783071353.242865:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8b014b9200/0x6b58994c2cbdbd99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbda0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.242870:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b014b9200 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:2.0:1783071353.242873:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8b014b9200/0x6b58994c2cbdbd99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6b58994c2cbdbda0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.242880:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8b014b9200/0x6b58994c2cbdbd99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6b58994c2cbdbda0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783071353.242885:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8b014b9200/0x6b58994c2cbdbd99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6b58994c2cbdbda0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071353.242890:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783071353.242898:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8f8b014b9200/0x6b58994c2cbdbd99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbda0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.242903:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783071353.242911:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8b014b9200/0x6b58994c2cbdbd99 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbda0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.242917:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8b014b9200/0x6b58994c2cbdbd99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbda0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.242925:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783071353.242928:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8b10967000/0x6b58994c2cbdbd6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbd76 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.242933:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b10967000 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:2.0:1783071353.242936:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8b10967000/0x6b58994c2cbdbd6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6b58994c2cbdbd76 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.242942:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8b10967000/0x6b58994c2cbdbd6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6b58994c2cbdbd76 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783071353.242948:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8b10967000/0x6b58994c2cbdbd6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6b58994c2cbdbd76 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071353.242952:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783071353.242960:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8f8b10967000/0x6b58994c2cbdbd6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbd76 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.242965:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783071353.242968:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8b10967000/0x6b58994c2cbdbd6f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbd76 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.242973:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8b10967000/0x6b58994c2cbdbd6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbd76 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.242983:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071353.242988:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071353.242989:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071353.242999:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01765180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:feaa1501-b927-4e07-baad-3200e92d7497:3647:1869685707539712:0@lo:103: 00000100:00100000:2.0:1783071353.243024:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:feaa1501-b927-4e07-baad-3200e92d7497:3648:1869685707539840:0@lo:103: 00000100:00100000:2.0:1783071353.243048:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01765c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:feaa1501-b927-4e07-baad-3200e92d7497:3645:1869685707539968:0@lo:103: 00000100:00100000:2.0:1783071353.243068:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071353.243346:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01764e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:feaa1501-b927-4e07-baad-3200e92d7497:3646:1869685707540096:0@lo:103: 00010000:00010000:3.0:1783071353.243495:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071353.243542:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0178d500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1869685707538816:0@lo:104: 00000100:00100000:3.0:1783071353.243554:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02c0ad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1869685707539200:0@lo:104: 00000100:00100000:3.0:1783071353.243561:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02c08700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1869685707539328:0@lo:104: 00000100:00100000:3.0:1783071353.243568:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02c08e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1869685707539456:0@lo:104: 00000100:00100000:3.0:1783071353.243575:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02c0b100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1869685707539584:0@lo:104: 00010000:00010000:3.0:1783071353.243620:0:6508:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f8b014b8a00/0x6b58994c2cbdbe80 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071353.244557:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707539072 00000100:00100000:3.0:1783071353.244566:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707539072 00010000:00010000:3.0:1783071353.244607:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8b3c461800/0x6b58994c2cbdbe41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbe3a expref: 22 pid: 6508 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071353.244633:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707538944 00000100:00100000:3.0:1783071353.244637:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707538944 00010000:00010000:3.0:1783071353.244650:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8b10966600/0x6b58994c2cbdbe6b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbe64 expref: 23 pid: 6511 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071353.244661:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707539968 00000100:00100000:3.0:1783071353.244663:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707539968 00010000:00010000:3.0:1783071353.244673:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8b10967600/0x6b58994c2cbdbddf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbdd8 expref: 24 pid: 6508 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071353.244686:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783071353.244692:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02c0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:feaa1501-b927-4e07-baad-3200e92d7497+24:3646:x1869685707539072:12345-0@lo:103: 00010000:00010000:3.0:1783071353.244703:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071353.244708:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8b3c461800/0x6b58994c2cbdbe41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbe3a expref: 24 pid: 6508 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071353.244718:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8b3c461800/0x6b58994c2cbdbe41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6b58994c2cbdbe3a expref: 24 pid: 6508 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071353.244733:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b3c461800/0x6b58994c2cbdbe41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6b58994c2cbdbe3a expref: 24 pid: 6508 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071353.244745:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783071353.244792:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02c0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:feaa1501-b927-4e07-baad-3200e92d7497+23:3646:x1869685707539072:12345-0@lo:103: Request processed in 99us (2787us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071353.244816:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783071353.244833:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783071353.244839:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02c0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:feaa1501-b927-4e07-baad-3200e92d7497+22:3646:x1869685707538944:12345-0@lo:103: 00010000:00010000:3.0:1783071353.244846:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071353.244850:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8b10966600/0x6b58994c2cbdbe6b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbe64 expref: 22 pid: 6511 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071353.244858:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8b10966600/0x6b58994c2cbdbe6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6b58994c2cbdbe64 expref: 22 pid: 6511 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071353.244867:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b10966600/0x6b58994c2cbdbe6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6b58994c2cbdbe64 expref: 22 pid: 6511 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071353.244876:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783071353.244897:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02c0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:feaa1501-b927-4e07-baad-3200e92d7497+21:3646:x1869685707538944:12345-0@lo:103: Request processed in 58us (2809us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071353.244903:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783071353.244914:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783071353.244920:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0178ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:feaa1501-b927-4e07-baad-3200e92d7497+20:3645:x1869685707539968:12345-0@lo:103: 00010000:00010000:3.0:1783071353.244926:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071353.244931:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8b10967600/0x6b58994c2cbdbddf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbdd8 expref: 20 pid: 6508 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071353.244939:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8b10967600/0x6b58994c2cbdbddf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6b58994c2cbdbdd8 expref: 20 pid: 6508 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071353.244947:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b10967600/0x6b58994c2cbdbddf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6b58994c2cbdbdd8 expref: 20 pid: 6508 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071353.244962:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071353.245015:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071353.245050:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071353.245065:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0178dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:feaa1501-b927-4e07-baad-3200e92d7497:3647:1869685707540224:0@lo:103: 00000100:00100000:2.0:1783071353.245091:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071353.245112:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071353.245132:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37a61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:feaa1501-b927-4e07-baad-3200e92d7497:3646:1869685707538944:0@lo:103: 00000100:00100000:2.0:1783071353.245140:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37a62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:feaa1501-b927-4e07-baad-3200e92d7497:3646:1869685707539072:0@lo:103: 00000100:00100000:2.0:1783071353.245446:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707539840 00000100:00100000:2.0:1783071353.245462:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707539840 00010000:00010000:2.0:1783071353.245480:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8b3c461a00/0x6b58994c2cbdbdfb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbdf4 expref: 20 pid: 6510 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071353.245494:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707539712 00000100:00100000:2.0:1783071353.245496:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707539712 00010000:00010000:2.0:1783071353.245510:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8b3c460000/0x6b58994c2cbdbe25 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbe1e expref: 21 pid: 6510 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071353.245520:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707540224 00000100:00100000:2.0:1783071353.245522:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707540224 00010000:00010000:2.0:1783071353.245541:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8b014b9400/0x6b58994c2cbdbd76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbd6f expref: 22 pid: 6510 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071353.245552:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707540096 00000100:00100000:2.0:1783071353.245561:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707540096 00010000:00010000:2.0:1783071353.245575:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8b3c460c00/0x6b58994c2cbdbda0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbd99 expref: 23 pid: 6510 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071353.245589:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783071353.245599:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0178f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:feaa1501-b927-4e07-baad-3200e92d7497+23:3648:x1869685707539840:12345-0@lo:103: 00010000:00010000:2.0:1783071353.245611:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071353.245615:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8b3c461a00/0x6b58994c2cbdbdfb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbdf4 expref: 23 pid: 6510 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.245623:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8b3c461a00/0x6b58994c2cbdbdfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6b58994c2cbdbdf4 expref: 23 pid: 6510 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.245633:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b3c461a00/0x6b58994c2cbdbdfb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6b58994c2cbdbdf4 expref: 23 pid: 6510 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.245642:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071353.245674:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0178f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:feaa1501-b927-4e07-baad-3200e92d7497+22:3648:x1869685707539840:12345-0@lo:103: Request processed in 80us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071353.245681:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783071353.245693:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783071353.245698:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab8d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:feaa1501-b927-4e07-baad-3200e92d7497+21:3647:x1869685707539712:12345-0@lo:103: 00010000:00010000:2.0:1783071353.245705:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071353.245709:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8b3c460000/0x6b58994c2cbdbe25 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbe1e expref: 21 pid: 6510 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.245717:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8b3c460000/0x6b58994c2cbdbe25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6b58994c2cbdbe1e expref: 21 pid: 6510 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.245727:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b3c460000/0x6b58994c2cbdbe25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6b58994c2cbdbe1e expref: 21 pid: 6510 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.245741:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071353.245768:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab8d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:feaa1501-b927-4e07-baad-3200e92d7497+20:3647:x1869685707539712:12345-0@lo:103: Request processed in 70us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071353.245775:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783071353.245812:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783071353.245826:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0178d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:feaa1501-b927-4e07-baad-3200e92d7497+19:3647:x1869685707540224:12345-0@lo:103: 00010000:00010000:2.0:1783071353.245832:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071353.245837:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8b014b9400/0x6b58994c2cbdbd76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbd6f expref: 19 pid: 6510 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.245844:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8b014b9400/0x6b58994c2cbdbd76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6b58994c2cbdbd6f expref: 19 pid: 6510 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.245857:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b014b9400/0x6b58994c2cbdbd76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6b58994c2cbdbd6f expref: 19 pid: 6510 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.245865:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071353.245891:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0178d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:feaa1501-b927-4e07-baad-3200e92d7497+18:3647:x1869685707540224:12345-0@lo:103: Request processed in 68us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071353.245897:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783071353.245908:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783071353.245914:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0178ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:feaa1501-b927-4e07-baad-3200e92d7497+17:3646:x1869685707540096:12345-0@lo:103: 00010000:00010000:2.0:1783071353.245920:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071353.245923:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8b3c460c00/0x6b58994c2cbdbda0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbd99 expref: 17 pid: 6510 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.245931:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8b3c460c00/0x6b58994c2cbdbda0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6b58994c2cbdbd99 expref: 17 pid: 6510 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.245947:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b3c460c00/0x6b58994c2cbdbda0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6b58994c2cbdbd99 expref: 17 pid: 6510 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.245958:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f8b014b8a00/0x6b58994c2cbdbe80 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.245966:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b014b8a00/0x6b58994c2cbdbe80 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.245980:0:6502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f8b014b8a00/0x6b58994c2cbdbe80 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.245988:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f8b014b8a00/0x6b58994c2cbdbe80 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.245995:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f8b014b8a00/0x6b58994c2cbdbe80 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.246001:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f8b014b8a00/0x6b58994c2cbdbe80 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.246007:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b014b8a00 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:2.0:1783071353.246011:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f8b014b8a00/0x6b58994c2cbdbe80 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.246019:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f8b014b8a00/0x6b58994c2cbdbe80 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.246036:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f8b014b8a00/0x6b58994c2cbdbe80 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.246056:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071353.246083:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0178ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:feaa1501-b927-4e07-baad-3200e92d7497+16:3646:x1869685707540096:12345-0@lo:103: Request processed in 169us (970us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071353.246089:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783071353.246117:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:feaa1501-b927-4e07-baad-3200e92d7497:3648:1869685707539840:0@lo:103: 00000100:00100000:2.0:1783071353.246138:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01765180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:feaa1501-b927-4e07-baad-3200e92d7497:3647:1869685707539712:0@lo:103: 00000100:00100000:2.0:1783071353.246145:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0178dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:feaa1501-b927-4e07-baad-3200e92d7497:3647:1869685707540224:0@lo:103: 00000100:00100000:2.0:1783071353.246162:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01764e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:feaa1501-b927-4e07-baad-3200e92d7497:3646:1869685707540096:0@lo:103: 00010000:00010000:2.0:1783071353.246176:0:6508:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f8b014b8a00/0x6b58994c2cbdbe80 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.246184:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f8b014b8a00/0x6b58994c2cbdbe80 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.246191:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b014b8a00/0x6b58994c2cbdbe80 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783071353.246203:0:6508:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1783071353.246833:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0178ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:feaa1501-b927-4e07-baad-3200e92d7497+15:3645:x1869685707539968:12345-0@lo:103: Request processed in 1909us (3761us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071353.246842:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783071353.246966:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01765c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:feaa1501-b927-4e07-baad-3200e92d7497:3645:1869685707539968:0@lo:103: 00000100:00100000:2.0:1783071353.249277:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18687450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+14:9508:x1869685707538432:12345-0@lo:253: Request processed in 17005us (17272us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071353.249417:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1783071353.249586:0:9508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c79f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:9508:1869685707538432:0@lo:253: 10000000:01000000:1.0:1783071353.249602:0:9508:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1783071353.249676:0:9508:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783071353.249678:0:9508:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783071353.249680:0:9508:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783071353.249681:0:9508:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1783071353.249683:0:9508:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783071353.249684:0:9508:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783071353.249685:0:9508:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783071353.249687:0:9508:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1783071353.249688:0:9508:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783071353.249689:0:9508:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1783071353.249713:0:9508:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8f8b34e49800 from lustre-OST0001 10000000:01000000:1.0:1783071353.249744:0:9508:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1783071353.249747:0:9508:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1783071353.249755:0:9508:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8f8b06c74d40 local copy 10000000:01000000:1.0:1783071353.249759:0:9508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1783071353.249796:0:9508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9000/0x6b58994c2cbdbe87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071353.249806:0:9508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9000/0x6b58994c2cbdbe87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071353.249815:0:9508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9000/0x6b58994c2cbdbe87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071353.249831:0:9508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c79f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:9508:1869685707540352:0@lo:101: 00000100:00100000:1.0:1783071353.249868:0:9508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071353.249942:0:9508:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0179ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1783071353.249977:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707540352 00000100:00100000:2.0:1783071353.249983:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707540352 00000100:00100000:2.0:1783071353.250051:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1783071353.250061:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18687850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+14:9508:x1869685707540352:12345-0@lo:101: 00010000:00010000:2.0:1783071353.250086:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071353.250102:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b10966e00/0x6b58994c2cbdbe8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdbe87 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.250124:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b10966e00/0x6b58994c2cbdbe8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdbe87 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.250134:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b10966e00/0x6b58994c2cbdbe8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbe87 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.250143:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b10966e00, rc 0) 00000100:00100000:2.0:1783071353.250217:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18687850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+15:9508:x1869685707540352:12345-0@lo:101: Request processed in 157us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071353.250223:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1783071353.250288:0:9508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c79f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:9508:1869685707540352:0@lo:101: 00010000:00010000:1.0:1783071353.250405:0:9508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9000/0x6b58994c2cbdbe87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x6b58994c2cbdbe8e expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071353.250414:0:9508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9000/0x6b58994c2cbdbe87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x6b58994c2cbdbe8e expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071353.250694:0:9508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c79f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:9508:1869685707540480:0@lo:501: 00000100:00100000:1.0:1783071353.250724:0:9508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071353.250783:0:9508:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0179ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1783071353.250835:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707540480 00000100:00100000:2.0:1783071353.250840:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707540480 00000100:00100000:2.0:1783071353.250875:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1783071353.250882:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18685850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+15:9508:x1869685707540480:12345-0@lo:501: 00000100:00100000:2.0:1783071353.250947:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18685850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+15:9508:x1869685707540480:12345-0@lo:501: Request processed in 66us (223us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783071353.250953:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1783071353.251009:0:9508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c79f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:9508:1869685707540480:0@lo:501: 10000000:01000000:1.0:1783071353.251019:0:9508:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.138@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1783071353.251035:0:9508:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.138@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1783071353.251039:0:9508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9000/0x6b58994c2cbdbe87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x6b58994c2cbdbe8e expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071353.251047:0:9508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9000/0x6b58994c2cbdbe87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x6b58994c2cbdbe8e expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071353.251053:0:9508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9000/0x6b58994c2cbdbe87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x6b58994c2cbdbe8e expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071353.251072:0:9508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1783071353.251093:0:9508:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f8b34e49800 10000000:01000000:1.0:1783071353.251097:0:9508:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1783071353.251103:0:9508:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1783071353.251105:0:9508:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783071353.251109:0:9508:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1783071353.251112:0:9508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1783071353.251135:0:9508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b421d8400/0x6b58994c2cbdbe95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071353.251141:0:9508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8b421d8400/0x6b58994c2cbdbe95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071353.251148:0:9508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8b421d8400/0x6b58994c2cbdbe95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071353.251161:0:9508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c79f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:9508:1869685707540608:0@lo:101: 00000100:00100000:1.0:1783071353.251185:0:9508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071353.251195:0:9508:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b07c17000 going to sleep for 11 seconds 00010000:00010000:2.0:1783071353.251236:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783071353.251242:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9000/0x6b58994c2cbdbe87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x6b58994c2cbdbe8e expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.251249:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b421d9000 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:2.0:1783071353.251253:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9000/0x6b58994c2cbdbe87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x6b58994c2cbdbe8e expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.251274:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9000/0x6b58994c2cbdbe87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x6b58994c2cbdbe8e expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783071353.251280:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9000/0x6b58994c2cbdbe87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x6b58994c2cbdbe8e expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071353.251285:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783071353.251640:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9000/0x6b58994c2cbdbe87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x6b58994c2cbdbe8e expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.251648:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783071353.251663:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9000/0x6b58994c2cbdbe87 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x6b58994c2cbdbe8e expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.251670:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9000/0x6b58994c2cbdbe87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x6b58994c2cbdbe8e expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.251683:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071353.251685:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071353.251687:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071353.251697:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0178dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:feaa1501-b927-4e07-baad-3200e92d7497:3648:1869685707540736:0@lo:103: 00000100:00100000:2.0:1783071353.251725:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071353.251762:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707540608 00000100:00100000:2.0:1783071353.251766:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707540608 00000100:00100000:2.0:1783071353.251784:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1783071353.251789:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18684c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+15:9508:x1869685707540608:12345-0@lo:101: 00010000:00010000:2.0:1783071353.251797:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071353.251806:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b10966400/0x6b58994c2cbdbe9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdbe95 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.251829:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b10966400/0x6b58994c2cbdbe9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdbe95 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.251837:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b10966400/0x6b58994c2cbdbe9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbe95 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.251845:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b10966400, rc 0) 00000100:00100000:2.0:1783071353.251873:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18684c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+16:9508:x1869685707540608:12345-0@lo:101: Request processed in 84us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071353.251879:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1783071353.251903:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707540736 00000100:00100000:2.0:1783071353.251906:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707540736 00000100:00100000:2.0:1783071353.251930:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783071353.251935:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0178fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:feaa1501-b927-4e07-baad-3200e92d7497+16:3648:x1869685707540736:12345-0@lo:103: 00010000:00010000:2.0:1783071353.251942:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071353.251952:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b10966e00/0x6b58994c2cbdbe8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6b58994c2cbdbe87 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.251962:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071353.251983:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0178fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:feaa1501-b927-4e07-baad-3200e92d7497+15:3648:x1869685707540736:12345-0@lo:103: Request processed in 48us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071353.251990:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783071353.252010:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0178dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:feaa1501-b927-4e07-baad-3200e92d7497:3648:1869685707540736:0@lo:103: 00000100:00100000:2.0:1783071353.252596:0:9508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c79f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:9508:1869685707540608:0@lo:101: 00010000:00010000:2.0:1783071353.252675:0:9508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8b421d8400/0x6b58994c2cbdbe95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbe9c expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.252698:0:9508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8b421d8400/0x6b58994c2cbdbe95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdbe9c expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071353.252790:0:9508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0178dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:9508:1869685707540864:0@lo:501: 00000100:00100000:2.0:1783071353.252824:0:9508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071353.252841:0:9508:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0208be40 going to sleep for 11 seconds 00000100:00100000:3.0:1783071353.252922:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707540864 00000100:00100000:3.0:1783071353.252927:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707540864 00000100:00100000:3.0:1783071353.252966:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1783071353.252974:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18684850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+15:9508:x1869685707540864:12345-0@lo:501: 00000100:00100000:3.0:1783071353.253085:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18684850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+15:9508:x1869685707540864:12345-0@lo:501: Request processed in 112us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071353.253091:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1783071353.253254:0:9508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0178dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:9508:1869685707540864:0@lo:501: 00000100:00100000:2.0:1783071353.253281:0:9508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0178dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:9508:1869685707540992:0@lo:503: 00000100:00100000:2.0:1783071353.253518:0:9508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071353.253554:0:9508:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0208be40 going to sleep for 11 seconds 00000100:00100000:3.0:1783071353.253598:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707540992 00000100:00100000:3.0:1783071353.253603:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707540992 00000100:00100000:3.0:1783071353.253674:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1783071353.253681:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07695850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+15:9508:x1869685707540992:12345-0@lo:503: 00000100:00100000:3.0:1783071353.253769:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07695850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+15:9508:x1869685707540992:12345-0@lo:503: Request processed in 88us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071353.253775:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1783071353.253847:0:9508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0178dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:9508:1869685707540992:0@lo:503: 00000040:00080000:0.0:1783071353.254114:0:9508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783071353.254191:0:9508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37a63b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:9508:1869685707541120:0@lo:502: 00000100:00100000:0.0:1783071353.254229:0:9508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071353.254615:0:9508:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b419cdcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783071353.254704:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707541120 00000100:00100000:2.0:1783071353.254709:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707541120 00000100:00100000:2.0:1783071353.254733:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1783071353.254738:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07697850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+15:9508:x1869685707541120:12345-0@lo:502: 00000100:00100000:2.0:1783071353.254829:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07697850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+15:9508:x1869685707541120:12345-0@lo:502: Request processed in 90us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071353.254836:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1783071353.255017:0:9508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37a63b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:9508:1869685707541120:0@lo:502: 00000040:00080000:0.0:1783071353.255209:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1783071353.255236:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1783071353.255248:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1783071353.255261:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1783071353.255275:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1783071353.255290:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1783071353.255716:0:9508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37a63b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:9508:1869685707541248:0@lo:502: 00000100:00100000:0.0:1783071353.255759:0:9508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071353.255823:0:9508:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b419cdcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783071353.255864:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707541248 00000100:00100000:2.0:1783071353.255869:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707541248 00000100:00100000:2.0:1783071353.255905:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1783071353.255911:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07697450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+15:9508:x1869685707541248:12345-0@lo:502: 00000100:00100000:2.0:1783071353.256041:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07697450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+15:9508:x1869685707541248:12345-0@lo:502: Request processed in 129us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071353.256048:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1783071353.256145:0:9508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37a63b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:9508:1869685707541248:0@lo:502: 00000040:00080000:0.0:1783071353.256191:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1783071353.256199:0:9508:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:3.0:1783071353.257165:0:9519:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783071353.257175:0:9519:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1783071353.257182:0:9519:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071353.257184:0:9519:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1783071353.257190:0:9519:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783071353.257205:0:9519:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8f8b3b5c4d40) 00000020:00000080:3.0:1783071353.257230:0:9519:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:3.0:1783071353.257236:0:9519:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1783071353.257758:0:9519:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f8b34e49800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1783071353.257772:0:9519:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1783071353.257779:0:9519:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x6b58994c2cbdbeaa 00010000:00010000:3.0:1783071353.264033:0:9519:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:3.0:1783071353.264564:0:9519:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1783071353.268985:0:9519:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1783071353.270065:0:9519:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1783071353.284060:0:9519:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1783071353.284243:0:9519:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1783071353.295602:0:9519:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1783071353.296900:0:9519:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1783071353.296914:0:9519:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783071353.296920:0:9519:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071353.296923:0:9519:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1783071353.296927:0:9519:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783071353.296931:0:9519:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071353.296932:0:9519:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783071353.296936:0:9519:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783071353.296938:0:9519:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1783071353.296960:0:9519:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783071353.296964:0:9519:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071353.296966:0:9519:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:2.0:1783071353.296969:0:9519:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1783071353.297251:0:9508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1783071353.297285:0:9508:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1783071353.297308:0:9508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b421d8400/0x6b58994c2cbdbe95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbe9c expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071353.297320:0:9508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8b421d8400/0x6b58994c2cbdbe95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbe9c expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783071353.297329:0:9508:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8f8b34e49800 from 1 10000000:01000000:0.0:1783071353.297332:0:9508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783071353.297391:0:9508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460200/0x6b58994c2cbdbeb1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071353.297401:0:9508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460200/0x6b58994c2cbdbeb1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071353.297425:0:9508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460200/0x6b58994c2cbdbeb1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071353.297449:0:9508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37a63b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:9508:1869685707541376:0@lo:101: 00000100:00100000:0.0:1783071353.297524:0:9508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071353.297587:0:9508:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b419cdcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783071353.297951:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707541376 00000100:00100000:1.0:1783071353.297959:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707541376 00000100:00100000:1.0:1783071353.298009:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1783071353.298019:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07695450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+15:9508:x1869685707541376:12345-0@lo:101: 00010000:00010000:1.0:1783071353.298032:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071353.298046:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b421d9000/0x6b58994c2cbdbeb8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdbeb1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071353.298069:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b421d9000/0x6b58994c2cbdbeb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdbeb1 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071353.298080:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b421d9000/0x6b58994c2cbdbeb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbeb1 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071353.298089:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b421d9000, rc 0) 00000100:00100000:1.0:1783071353.298137:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07695450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+16:9508:x1869685707541376:12345-0@lo:101: Request processed in 119us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071353.298144:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1783071353.298248:0:9508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37a63b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:9508:1869685707541376:0@lo:101: 00010000:00010000:0.0:1783071353.298264:0:9508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460200/0x6b58994c2cbdbeb1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbeb8 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071353.298274:0:9508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460200/0x6b58994c2cbdbeb1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdbeb8 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071353.298355:0:9508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37a63b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:9508:1869685707541504:0@lo:501: 00000100:00100000:0.0:1783071353.298422:0:9508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071353.298448:0:9508:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b419cdcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783071353.298505:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707541504 00000100:00100000:2.0:1783071353.298509:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707541504 00000100:00100000:2.0:1783071353.298550:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1783071353.298558:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07697c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+16:9508:x1869685707541504:12345-0@lo:501: 00000100:00100000:2.0:1783071353.298734:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07697c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+16:9508:x1869685707541504:12345-0@lo:501: Request processed in 176us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071353.298741:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1783071353.298774:0:9508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37a63b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:9508:1869685707541504:0@lo:501: 00000100:00100000:2.0:1783071353.299050:0:9508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0178f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:9508:1869685707541632:0@lo:503: 00000100:00100000:2.0:1783071353.299081:0:9508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071353.299096:0:9508:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0208bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1783071353.299117:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707541632 00000100:00100000:0.0:1783071353.299121:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707541632 00000100:00100000:0.0:1783071353.299153:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1783071353.299160:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07696050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+16:9508:x1869685707541632:12345-0@lo:503: 00000100:00100000:0.0:1783071353.299252:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07696050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+16:9508:x1869685707541632:12345-0@lo:503: Request processed in 92us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071353.299259:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1783071353.299305:0:9508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0178f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:9508:1869685707541632:0@lo:503: 00000040:00080000:2.0:1783071353.299595:0:9508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783071353.299882:0:9508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0178f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:9508:1869685707541760:0@lo:502: 00000100:00100000:2.0:1783071353.299926:0:9508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071353.299959:0:9508:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0208bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1783071353.300099:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707541760 00000100:00100000:3.0:1783071353.300106:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707541760 00000100:00100000:3.0:1783071353.300142:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1783071353.300150:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07695c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+16:9508:x1869685707541760:12345-0@lo:502: 00000100:00100000:3.0:1783071353.300252:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07695c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+16:9508:x1869685707541760:12345-0@lo:502: Request processed in 103us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071353.300259:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1783071353.300318:0:9508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0178f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:9508:1869685707541760:0@lo:502: 00000040:00080000:3.0:1783071353.300632:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1783071353.300658:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1783071353.300679:0:9508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02c0b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:9508:1869685707541888:0@lo:502: 00000100:00100000:3.0:1783071353.300729:0:9508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071353.300757:0:9508:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b06c44c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783071353.301024:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707541888 00000100:00100000:0.0:1783071353.301029:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707541888 00000100:00100000:0.0:1783071353.301072:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1783071353.301080:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07696450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+16:9508:x1869685707541888:12345-0@lo:502: 00000100:00100000:0.0:1783071353.301164:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07696450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+16:9508:x1869685707541888:12345-0@lo:502: Request processed in 85us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071353.301176:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1783071353.301254:0:9508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02c0b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:9508:1869685707541888:0@lo:502: 00000040:00080000:3.0:1783071353.301317:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1783071353.301326:0:9508:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1783071353.304784:0:9523:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783071353.304797:0:9523:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071353.304799:0:9523:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1783071353.304806:0:9523:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f8b34e49800 00000020:00000080:3.0:1783071353.304809:0:9523:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783071353.304820:0:9523:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783071353.304823:0:9523:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071353.304825:0:9523:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1783071353.304829:0:9523:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1783071353.305041:0:9508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1783071353.305073:0:9508:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783071353.305129:0:9508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460200/0x6b58994c2cbdbeb1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbeb8 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.305150:0:9508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460200/0x6b58994c2cbdbeb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbeb8 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071353.305207:0:9508:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1783071353.305211:0:9508:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f8b34e49800 10000000:01000000:2.0:1783071353.305214:0:9508:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f8b34e49800 10000000:01000000:2.0:1783071353.305217:0:9508:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783071353.305223:0:9508:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8f8b34e49800 from 1 10000000:01000000:2.0:1783071353.305226:0:9508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783071353.305260:0:9508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b10966e00/0x6b58994c2cbdbebf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.305279:0:9508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8b10966e00/0x6b58994c2cbdbebf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.305289:0:9508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8b10966e00/0x6b58994c2cbdbebf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071353.305312:0:9508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0178f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:9508:1869685707542016:0@lo:101: 00000100:00100000:2.0:1783071353.305403:0:9508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071353.305497:0:9508:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0208be40 going to sleep for 11 seconds 00000100:00100000:0.0:1783071353.305676:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707542016 00000100:00100000:0.0:1783071353.305683:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707542016 00000100:00100000:0.0:1783071353.305760:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1783071353.305770:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07697050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+16:9508:x1869685707542016:12345-0@lo:101: 00010000:00010000:0.0:1783071353.305784:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071353.305796:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b3c460600/0x6b58994c2cbdbec6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdbebf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071353.305821:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b3c460600/0x6b58994c2cbdbec6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdbebf expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071353.305831:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b3c460600/0x6b58994c2cbdbec6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbebf expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071353.305840:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b3c460600, rc 0) 00000100:00100000:0.0:1783071353.305892:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07697050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+17:9508:x1869685707542016:12345-0@lo:101: Request processed in 123us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071353.305899:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1783071353.305981:0:9508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0178f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:9508:1869685707542016:0@lo:101: 00010000:00010000:3.0:1783071353.306006:0:9508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8b10966e00/0x6b58994c2cbdbebf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbec6 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071353.306015:0:9508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8b10966e00/0x6b58994c2cbdbebf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdbec6 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071353.306105:0:9508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02c0b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:9508:1869685707542144:0@lo:501: 00000100:00100000:3.0:1783071353.306149:0:9508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071353.306281:0:9508:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b06c44180 going to sleep for 11 seconds 00000100:00100000:2.0:1783071353.306361:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707542144 00000100:00100000:2.0:1783071353.306451:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707542144 00000100:00100000:0.0:1783071353.306544:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1783071353.306554:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07694450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+17:9508:x1869685707542144:12345-0@lo:501: 00000100:00100000:0.0:1783071353.306661:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07694450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+17:9508:x1869685707542144:12345-0@lo:501: Request processed in 109us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071353.306669:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1783071353.306732:0:9508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02c0b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:9508:1869685707542144:0@lo:501: 00000100:00100000:3.0:1783071353.306760:0:9508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02c0b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:9508:1869685707542272:0@lo:503: 00000100:00100000:3.0:1783071353.306800:0:9508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071353.306831:0:9508:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b06c44180 going to sleep for 11 seconds 00000100:00100000:1.0:1783071353.306878:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707542272 00000100:00100000:1.0:1783071353.307509:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707542272 00000100:00100000:1.0:1783071353.307554:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1783071353.307561:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07694050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+17:9508:x1869685707542272:12345-0@lo:503: 00000100:00100000:1.0:1783071353.307711:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07694050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+17:9508:x1869685707542272:12345-0@lo:503: Request processed in 150us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071353.307719:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1783071353.307880:0:9508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02c0b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:9508:1869685707542272:0@lo:503: 00000040:00080000:3.0:1783071353.308130:0:9508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783071353.308651:0:9508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02c0b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:9508:1869685707542400:0@lo:502: 00000100:00100000:3.0:1783071353.308704:0:9508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071353.308773:0:9508:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b06c44180 going to sleep for 11 seconds 00000100:00100000:2.0:1783071353.309254:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707542400 00000100:00100000:2.0:1783071353.309272:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707542400 00000100:00100000:2.0:1783071353.309323:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1783071353.309332:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07696850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+17:9508:x1869685707542400:12345-0@lo:502: 00000100:00100000:2.0:1783071353.309475:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07696850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+17:9508:x1869685707542400:12345-0@lo:502: Request processed in 144us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071353.309483:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1783071353.309645:0:9508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02c0b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:9508:1869685707542400:0@lo:502: 00000040:00080000:3.0:1783071353.309879:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1783071353.309909:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1783071353.309923:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1783071353.309937:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1783071353.309950:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1783071353.309961:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1783071353.309974:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1783071353.309999:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1783071353.310027:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1783071353.310038:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1783071353.310051:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1783071353.310063:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1783071353.310076:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1783071353.310088:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1783071353.310100:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1783071353.310112:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1783071353.310124:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1783071353.310135:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1783071353.310146:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1783071353.310159:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1783071353.310171:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1783071353.310183:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1783071353.310195:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1783071353.310220:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1783071353.310237:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1783071353.310250:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1783071353.310262:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1783071353.310275:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1783071353.310288:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1783071353.310300:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:3.0:1783071353.310312:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:3.0:1783071353.310325:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:3.0:1783071353.310338:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1783071353.310351:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1783071353.310402:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1783071353.310418:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1783071353.310432:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:3.0:1783071353.310443:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1783071353.310456:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:3.0:1783071353.310482:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:3.0:1783071353.310497:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:3.0:1783071353.310521:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:3.0:1783071353.310546:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:3.0:1783071353.310562:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:3.0:1783071353.310576:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:3.0:1783071353.310589:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:3.0:1783071353.310629:0:9508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02c0b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:9508:1869685707542528:0@lo:502: 00000100:00100000:3.0:1783071353.310687:0:9508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071353.310723:0:9508:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b06c44180 going to sleep for 11 seconds 00000100:00100000:2.0:1783071353.310892:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707542528 00000100:00100000:2.0:1783071353.310898:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707542528 00000100:00100000:2.0:1783071353.310942:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1783071353.310950:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07695050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+17:9508:x1869685707542528:12345-0@lo:502: 00000100:00100000:2.0:1783071353.311058:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07695050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+17:9508:x1869685707542528:12345-0@lo:502: Request processed in 109us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071353.311066:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1783071353.311176:0:9508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02c0b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:9508:1869685707542528:0@lo:502: 00000040:00080000:3.0:1783071353.311223:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:3.0:1783071353.311231:0:9508:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:2.0:1783071353.312143:0:9524:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1783071353.312161:0:9524:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8f8b3c6cb380) 00000020:00000080:2.0:1783071353.312186:0:9524:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:3.0:1783071353.312942:0:9524:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f8b34e49800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1783071353.312948:0:9524:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f8b34e49800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1783071353.312950:0:9524:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8f8b34e49800 3 00010000:00080000:3.0:1783071353.312992:0:9524:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f8a023e4000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.138@tcp at head 00010000:00010000:3.0:1783071353.320056:0:9524:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:3.0:1783071353.320175:0:9524:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1783071353.320229:0:9524:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783071353.320243:0:9524:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x6b58994c2cbdbed4 00000100:00080000:3.0:1783071353.320255:0:9524:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783071353.320261:0:9524:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8f8a023e4000 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:3.0:1783071353.320297:0:9524:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8a02c0b100 x1869685707542656/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783071353.320327:0:9524:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1783071353.320396:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02c0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1869685707542656:0@lo:38: 00000100:00100000:0.0:1783071353.320478:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071353.320767:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0178c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869685707542784:0@lo:400: 00000100:00100000:2.0:1783071353.320795:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071353.320816:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01764e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1869685707543296:0@lo:400: 00000100:00100000:2.0:1783071353.320838:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071353.320857:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1783071353.320863:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0178f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707542912:0@lo:400: 00000100:00100000:2.0:1783071353.320898:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071353.320915:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01765180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1869685707543424:0@lo:400: 00000100:00100000:2.0:1783071353.320935:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071353.320956:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0178dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869685707543040:0@lo:400: 00000100:00100000:2.0:1783071353.320977:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071353.320987:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707543552:0@lo:400: 00000100:00100000:2.0:1783071353.321005:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071353.321023:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1783071353.321027:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01765c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707543168:0@lo:400: 00000100:00100000:2.0:1783071353.321042:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071353.321053:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01767b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707543680:0@lo:400: 00000100:00100000:2.0:1783071353.321067:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071353.321097:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707542656 00000100:00100000:2.0:1783071353.321104:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707542656 00000100:00100000:2.0:1783071353.321125:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707542784 00000100:00100000:2.0:1783071353.321128:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707542784 00000100:00100000:2.0:1783071353.321147:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707543296 00000100:00100000:2.0:1783071353.321149:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707543296 00000100:00100000:2.0:1783071353.321171:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707543424 00000100:00100000:2.0:1783071353.321173:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707543424 00000100:00100000:2.0:1783071353.321184:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707543040 00000100:00100000:2.0:1783071353.321186:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707543040 00000100:00100000:2.0:1783071353.321201:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783071353.321210:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01766300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1869685707542784:12345-0@lo:400: 00000100:00100000:2.0:1783071353.321259:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01766300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1869685707542784:12345-0@lo:400: Request processed in 49us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071353.321643:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783071353.321659:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783071353.321674:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3b4db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1869685707543296:12345-0@lo:400: 00000100:00100000:2.0:1783071353.321751:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3b4db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1869685707543296:12345-0@lo:400: Request processed in 34us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071353.321758:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783071353.321771:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783071353.321778:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3b4da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1869685707543424:12345-0@lo:400: 00000100:00100000:2.0:1783071353.321806:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3b4da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1869685707543424:12345-0@lo:400: Request processed in 29us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071353.321812:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783071353.321823:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783071353.321829:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3b4db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869685707543040:12345-0@lo:400: 00000100:00100000:2.0:1783071353.321867:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3b4db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869685707543040:12345-0@lo:400: Request processed in 38us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071353.321873:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783071353.321885:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783071353.321889:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37a61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1869685707542656:12345-0@lo:38: 00010000:00080000:2.0:1783071353.321909:0:6517:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 255 last 0 00000020:00000080:2.0:1783071353.321950:0:6517:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x6b58994c2cbdbedb 00000004:00100000:2.0:1783071353.321966:0:6517:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783071353.322001:0:6517:0:(import.c:65:import_set_state_nolock()) ffff8f8a0177b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783071353.322042:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37a61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1869685707542656:12345-0@lo:38: Request processed in 151us (1565us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071353.322049:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783071353.322075:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707542912 00000100:00100000:2.0:1783071353.322079:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707542912 00000100:00100000:2.0:1783071353.322102:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707543168 00000100:00100000:2.0:1783071353.322109:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707543168 00000100:00100000:2.0:1783071353.322124:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783071353.322129:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3b4d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707542912:12345-0@lo:400: 00000100:00100000:2.0:1783071353.322158:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3b4d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707542912:12345-0@lo:400: Request processed in 29us (1260us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071353.322162:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783071353.322173:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783071353.322179:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3b4daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707543168:12345-0@lo:400: 00000100:00100000:2.0:1783071353.322205:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3b4daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707543168:12345-0@lo:400: Request processed in 26us (1160us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071353.322209:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783071353.322226:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707543552 00000100:00100000:2.0:1783071353.322229:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707543552 00000100:00100000:2.0:1783071353.322251:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707543680 00000100:00100000:2.0:1783071353.322254:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707543680 00000100:00100000:2.0:1783071353.325679:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783071353.325699:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3b4d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707543552:12345-0@lo:400: 00000100:00100000:2.0:1783071353.325799:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3b4d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707543552:12345-0@lo:400: Request processed in 109us (4791us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071353.325806:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783071353.325824:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783071353.325830:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3b4d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707543680:12345-0@lo:400: 00000100:00100000:2.0:1783071353.325858:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3b4d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707543680:12345-0@lo:400: Request processed in 29us (4789us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071353.325864:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1783071353.325896:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783071353.325901:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783071353.325904:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1783071353.325960:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a02c0b100 x1869685707542656/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783071363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071353.325972:0:3644:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783071353.325982:0:3644:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1783071353.325990:0:3644:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1783071353.325996:0:3644:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1783071353.325999:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8f8a023e4000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783071353.326006:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02c0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1869685707542656:0@lo:38: 00000100:00100000:2.0:1783071353.326056:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0178f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707542912:0@lo:400: 00010000:00080000:2.0:1783071353.326068:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a01765180 x1869685707543424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071353.326077:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01765180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1869685707543424:0@lo:400: 00010000:00080000:2.0:1783071353.326090:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a0178c000 x1869685707542784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071353.326097:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0178c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869685707542784:0@lo:400: 00010000:00080000:2.0:1783071353.326108:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a01764e00 x1869685707543296/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071353.326114:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01764e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1869685707543296:0@lo:400: 00000100:00100000:0.0:1783071353.326335:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01765c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707543168:0@lo:400: 00010000:00080000:0.0:1783071353.326348:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a01767b80 x1869685707543680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071353.326355:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01767b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707543680:0@lo:400: 00010000:00080000:0.0:1783071353.326385:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a0178dc00 x1869685707543040/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071353.326393:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0178dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869685707543040:0@lo:400: 00010000:00080000:0.0:1783071353.326404:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a01765f80 x1869685707543552/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071353.326413:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707543552:0@lo:400: 00000100:00100000:0.0:1783071353.326638:0:9526:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37a62a00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9526:1869685707543808:0@lo:901: 00000020:01000004:3.0:1783071353.326640:0:9524:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1783071353.326655:0:9524:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8f8b3b5c19c0) 00000020:00000080:3.0:1783071353.326676:0:9524:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000100:00100000:0.0:1783071353.326677:0:9526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071353.326707:0:9526:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b419cd0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783071353.326756:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707543808 00000100:00100000:2.0:1783071353.326762:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707543808 00000100:00100000:2.0:1783071353.326806:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783071353.326812:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37a60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9526:x1869685707543808:12345-0@lo:901: 00000020:01000004:3.0:1783071353.326853:0:9524:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f8b34e49800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1783071353.326858:0:9524:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f8b34e49800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1783071353.326866:0:9524:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8f8b34e49800 3 00000100:00100000:2.0:1783071353.326893:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37a60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9526:x1869685707543808:12345-0@lo:901: Request processed in 81us (215us total) trans 0 rc 0/0 00010000:00080000:3.0:1783071353.326895:0:9524:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f8a023e6800@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.138@tcp at head 00000100:00100000:2.0:1783071353.326907:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1783071353.326938:0:9526:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8b37a62a00 x1869685707543808/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1783071369 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071353.326947:0:9526:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37a62a00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9526:1869685707543808:0@lo:901: 00000100:00080000:0.0:1783071353.327119:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783071353.328500:0:9524:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:3.0:1783071353.328599:0:9524:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1783071353.328641:0:9524:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783071353.328653:0:9524:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x6b58994c2cbdbee9 00000100:00080000:3.0:1783071353.328662:0:9524:0:(import.c:512:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783071353.328668:0:9524:0:(import.c:626:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8f8a023e6800 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:3.0:1783071353.328702:0:9524:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8a02c08e00 x1869685707543936/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783071353.328728:0:9524:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1783071353.329462:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02c08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1869685707543936:0@lo:38: 00000100:00100000:2.0:1783071353.329542:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071353.330565:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707543936 00000100:00100000:0.0:1783071353.330577:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707543936 00000100:00100000:0.0:1783071353.330623:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783071353.330637:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3b4d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1869685707543936:12345-0@lo:38: 00010000:00080000:0.0:1783071353.330669:0:6517:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 255 last 0 00000020:00000080:0.0:1783071353.330708:0:6517:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x6b58994c2cbdbef0 00000004:00100000:0.0:1783071353.330727:0:6517:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783071353.330769:0:6517:0:(import.c:65:import_set_state_nolock()) ffff8f8a02c73800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783071353.330956:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3b4d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1869685707543936:12345-0@lo:38: Request processed in 319us (1423us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071353.330980:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1783071353.331082:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a02c08e00 x1869685707543936/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783071363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071353.331094:0:3644:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783071353.331103:0:3644:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1783071353.331111:0:3644:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1783071353.331117:0:3644:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1783071353.331119:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8f8a023e6800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783071353.331126:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02c08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1869685707543936:0@lo:38: 00000040:00080000:0.0:1783071353.340632:0:9524:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:3.0:1783071353.340812:0:9508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:3.0:1783071353.340842:0:9508:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783071353.340867:0:9508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b10966e00/0x6b58994c2cbdbebf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbec6 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071353.340879:0:9508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8b10966e00/0x6b58994c2cbdbebf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbec6 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1783071353.340933:0:9508:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1783071353.340935:0:9508:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783071353.340937:0:9508:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783071353.340938:0:9508:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783071353.340939:0:9508:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783071353.340940:0:9508:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783071353.340942:0:9508:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783071353.340943:0:9508:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783071353.340944:0:9508:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783071353.340946:0:9508:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783071353.340947:0:9508:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783071353.340951:0:9508:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1783071353.340953:0:9508:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783071353.340959:0:9508:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783071353.340960:0:9508:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783071353.340961:0:9508:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783071353.340961:0:9508:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783071353.340962:0:9508:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783071353.340963:0:9508:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783071353.340964:0:9508:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783071353.340965:0:9508:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783071353.340966:0:9508:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783071353.340967:0:9508:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783071353.340997:0:9508:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1783071353.341017:0:9508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02c08700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:9508:1869685707544064:0@lo:253: 00000100:00100000:3.0:1783071353.341091:0:9508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071353.341138:0:9508:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b06c44540 going to sleep for 11 seconds 00000100:00100000:2.0:1783071353.341453:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707544064 00000100:00100000:2.0:1783071353.341461:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707544064 00000100:00100000:2.0:1783071353.341504:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1783071353.341513:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+17:9508:x1869685707544064:12345-0@lo:253: 20000000:01000000:2.0:1783071353.341551:0:6511:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1783071353.341567:0:6511:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1783071353.351238:0:6511:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783071353.351252:0:6511:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1783071353.351441:0:6533:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783071353.351446:0:6533:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783071353.351469:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f8b3c461c00/0x6b58994c2cbdbef7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071353.351487:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8b3c461000/0x6b58994c2cbdbded lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbde6 expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071353.351495:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8b10966800/0x6b58994c2cbdbe33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbe2c expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071353.351504:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f8b3c461c00/0x6b58994c2cbdbef7 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071353.351552:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8b10966800/0x6b58994c2cbdbe33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6b58994c2cbdbe2c expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071353.351568:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8b10966800/0x6b58994c2cbdbe33 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6b58994c2cbdbe2c expref: 17 pid: 6511 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071353.351583:0:6533:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37a61500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1869685707544192:0@lo:104: 00000100:00100000:0.0:1783071353.351654:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783071353.351701:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8b3c461000/0x6b58994c2cbdbded lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6b58994c2cbdbde6 expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071353.351709:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8b3c461000/0x6b58994c2cbdbded lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6b58994c2cbdbde6 expref: 17 pid: 6510 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071353.351718:0:6533:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37a62d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1869685707544320:0@lo:104: 00000100:00100000:0.0:1783071353.351756:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071353.351781:0:6533:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b419cd300 going to sleep for 11 seconds 00000100:00100000:2.0:1783071353.351974:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707544192 00000100:00100000:2.0:1783071353.351982:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707544192 00000100:00100000:2.0:1783071353.352017:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707544320 00000100:00100000:2.0:1783071353.352020:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707544320 00000100:00100000:2.0:1783071353.352045:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783071353.352054:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37a61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:feaa1501-b927-4e07-baad-3200e92d7497+4:6533:x1869685707544192:12345-0@lo:104: 00010000:00010000:2.0:1783071353.352066:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461400/0x6b58994c2cbdbe2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbe33 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.352122:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783071353.352129:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37a61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:feaa1501-b927-4e07-baad-3200e92d7497+4:6533:x1869685707544192:12345-0@lo:104: Request processed in 76us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071353.352136:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783071353.352153:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783071353.352159:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37a61c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:feaa1501-b927-4e07-baad-3200e92d7497+3:6533:x1869685707544320:12345-0@lo:104: 00010000:00010000:2.0:1783071353.352166:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8f8b10967200/0x6b58994c2cbdbde6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbded expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.352194:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783071353.352199:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37a61c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:feaa1501-b927-4e07-baad-3200e92d7497+3:6533:x1869685707544320:12345-0@lo:104: Request processed in 42us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071353.352206:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1783071353.352220:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783071353.352226:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461400/0x6b58994c2cbdbe2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbe33 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.352233:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b3c461400 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:2.0:1783071353.352237:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461400/0x6b58994c2cbdbe2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6b58994c2cbdbe33 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.352247:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461400/0x6b58994c2cbdbe2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6b58994c2cbdbe33 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783071353.352264:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461400/0x6b58994c2cbdbe2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6b58994c2cbdbe33 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071353.352271:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783071353.352300:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461400/0x6b58994c2cbdbe2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbe33 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.352307:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783071353.352323:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461400/0x6b58994c2cbdbe2c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbe33 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.352330:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461400/0x6b58994c2cbdbe2c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbe33 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.352342:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783071353.352345:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8b10967200/0x6b58994c2cbdbde6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbded expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.352351:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b10967200 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:2.0:1783071353.352353:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8b10967200/0x6b58994c2cbdbde6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6b58994c2cbdbded expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.352360:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8b10967200/0x6b58994c2cbdbde6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6b58994c2cbdbded expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783071353.352394:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8b10967200/0x6b58994c2cbdbde6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6b58994c2cbdbded expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071353.352400:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783071353.352420:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8f8b10967200/0x6b58994c2cbdbde6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbded expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.352426:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783071353.352432:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8b10967200/0x6b58994c2cbdbde6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbded expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.352438:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8b10967200/0x6b58994c2cbdbde6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbded expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.352451:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071353.352453:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071353.352455:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071353.352461:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071353.352472:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:feaa1501-b927-4e07-baad-3200e92d7497:3646:1869685707544576:0@lo:103: 00000100:00100000:2.0:1783071353.352502:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071353.352527:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783071353.352547:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3b4dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:feaa1501-b927-4e07-baad-3200e92d7497:3646:1869685707544448:0@lo:103: 00000100:00100000:2.0:1783071353.352571:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071353.352598:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707544576 00000100:00100000:2.0:1783071353.352601:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707544576 00010000:00010000:2.0:1783071353.352618:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8b3c461000/0x6b58994c2cbdbded lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbde6 expref: 18 pid: 6510 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071353.352637:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707544448 00000100:00100000:2.0:1783071353.352640:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707544448 00010000:00010000:2.0:1783071353.352649:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8b10966800/0x6b58994c2cbdbe33 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbe2c expref: 19 pid: 6511 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071353.352665:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783071353.352671:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01767b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:feaa1501-b927-4e07-baad-3200e92d7497+19:3646:x1869685707544576:12345-0@lo:103: 00010000:00010000:2.0:1783071353.352687:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071353.352693:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8b3c461000/0x6b58994c2cbdbded lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbde6 expref: 19 pid: 6510 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.352702:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8b3c461000/0x6b58994c2cbdbded lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6b58994c2cbdbde6 expref: 19 pid: 6510 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.352716:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071353.352742:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01767b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:feaa1501-b927-4e07-baad-3200e92d7497+19:3646:x1869685707544576:12345-0@lo:103: Request processed in 71us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071353.352748:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783071353.352760:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783071353.352767:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01765c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:feaa1501-b927-4e07-baad-3200e92d7497+18:3646:x1869685707544448:12345-0@lo:103: 00010000:00010000:2.0:1783071353.352773:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071353.352777:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8b10966800/0x6b58994c2cbdbe33 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbe2c expref: 18 pid: 6511 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.352785:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8b10966800/0x6b58994c2cbdbe33 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6b58994c2cbdbe2c expref: 18 pid: 6511 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.352795:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f8b3c461c00/0x6b58994c2cbdbef7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.352801:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b3c461c00/0x6b58994c2cbdbef7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783071353.352813:0:6501:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009337254s 00010000:00010000:2.0:1783071353.352816:0:6501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f8b3c461c00/0x6b58994c2cbdbef7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.352831:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f8b3c461c00/0x6b58994c2cbdbef7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.352837:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f8b3c461c00/0x6b58994c2cbdbef7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.352842:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f8b3c461c00/0x6b58994c2cbdbef7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.352846:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b3c461c00 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:2.0:1783071353.352850:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f8b3c461c00/0x6b58994c2cbdbef7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.352856:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f8b3c461c00/0x6b58994c2cbdbef7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.352863:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f8b3c461c00/0x6b58994c2cbdbef7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.352871:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071353.352889:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01765c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:feaa1501-b927-4e07-baad-3200e92d7497+18:3646:x1869685707544448:12345-0@lo:103: Request processed in 124us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071353.352895:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783071353.352935:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3b4dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:feaa1501-b927-4e07-baad-3200e92d7497:3646:1869685707544448:0@lo:103: 00000100:00100000:2.0:1783071353.352942:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:feaa1501-b927-4e07-baad-3200e92d7497:3646:1869685707544576:0@lo:103: 00010000:00010000:2.0:1783071353.352970:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b10966800/0x6b58994c2cbdbe33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6b58994c2cbdbe2c expref: 17 pid: 6511 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071353.352978:0:6533:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37a61500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1869685707544192:0@lo:104: 00010000:00010000:2.0:1783071353.352992:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b3c461000/0x6b58994c2cbdbded lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6b58994c2cbdbde6 expref: 16 pid: 6510 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071353.352998:0:6533:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37a62d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1869685707544320:0@lo:104: 00010000:00010000:2.0:1783071353.353012:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f8b3c461c00/0x6b58994c2cbdbef7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.353020:0:6533:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f8b3c461c00/0x6b58994c2cbdbef7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.353026:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f8b3c461c00/0x6b58994c2cbdbef7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.353031:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b3c461c00/0x6b58994c2cbdbef7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071353.353145:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+15:9508:x1869685707544064:12345-0@lo:253: Request processed in 11633us (12054us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071353.353154:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1783071353.353543:0:9508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02c08700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:feaa1501-b927-4e07-baad-3200e92d7497:9508:1869685707544064:0@lo:253: 10000000:01000000:2.0:1783071353.353554:0:9508:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1783071353.353558:0:9508:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783071353.353560:0:9508:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783071353.353561:0:9508:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783071353.353562:0:9508:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783071353.353563:0:9508:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783071353.353564:0:9508:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783071353.353566:0:9508:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783071353.353567:0:9508:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783071353.353569:0:9508:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783071353.353571:0:9508:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783071353.353572:0:9508:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1783071353.353583:0:9508:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1783071353.360191:0:9508:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1783071353.360307:0:9508:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1783071353.360500:0:9508:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1783071353.360671:0:9508:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1783071353.360881:0:9508:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1783071353.361095:0:9508:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:2.0:1783071353.364756:0:9508:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1783071353.373930:0:9508:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1783071353.373941:0:9508:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1783071353.373974:0:9508:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1783071353.374021:0:9508:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.138@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1783071353.374044:0:9508:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1783071353.374061:0:9508:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1783071353.374887:0:9508:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783071353.375077:0:9508:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1783071354.115758:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783071354.140666:0:9580:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783071354.141006:0:9580:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783071355.142627:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071356.162885:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071356.740458:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707544704:0@lo:41: 00000100:00100000:2.0:1783071356.740543:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071356.740635:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707544704 00000100:00100000:2.0:1783071356.740643:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707544704 00000100:00100000:2.0:1783071356.740688:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783071356.740698:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707544704:12345-0@lo:41: 00000004:00000024:2.0:1783071356.740733:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:2.0:1783071356.740781:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707544704:12345-0@lo:41: Request processed in 83us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071356.740788:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783071356.740840:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707544704:0@lo:41: 00010000:00010000:3.0:1783071357.187966:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071357.251549:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707544832:0@lo:13: 00000100:00100000:2.0:1783071357.251633:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071357.252224:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02c0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707544960:0@lo:13: 00000100:00100000:3.0:1783071357.252261:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071357.252626:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707544832 00000100:00100000:0.0:1783071357.252634:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707544832 00000100:00100000:0.0:1783071357.252679:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707544960 00000100:00100000:0.0:1783071357.252682:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707544960 00000100:00100000:0.0:1783071357.252701:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783071357.252709:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01765180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707544832:12345-0@lo:13: 00002000:00000024:0.0:1783071357.252740:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783071357.252792:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01765180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707544832:12345-0@lo:13: Request processed in 83us (1159us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071357.252799:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783071357.252815:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783071357.252828:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02c08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707544960:12345-0@lo:13: 00002000:00000024:0.0:1783071357.252838:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783071357.252884:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02c08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707544960:12345-0@lo:13: Request processed in 56us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071357.252890:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1783071357.252929:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a01765f80 x1869685707544832/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071373 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071357.252947:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707544832:0@lo:13: 00010000:00080000:0.0:1783071357.252977:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a02c0ad80 x1869685707544960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071373 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071357.252988:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02c0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707544960:0@lo:13: 00000100:00080000:3.0:1783071357.253595:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1783071358.211426:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071358.275467:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02c08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707545088:0@lo:41: 00000100:00100000:0.0:1783071358.275546:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071358.275701:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707545088 00000100:00100000:2.0:1783071358.275713:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707545088 00000100:00100000:2.0:1783071358.275766:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783071358.275776:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37a60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707545088:12345-0@lo:41: 00000004:00000024:2.0:1783071358.275819:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1783071358.275874:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37a60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707545088:12345-0@lo:41: Request processed in 100us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071358.275881:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783071358.276378:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02c08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707545088:0@lo:41: 00000100:00100000:3.0:1783071358.788721:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02c09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:feaa1501-b927-4e07-baad-3200e92d7497:3647:1869685707545216:0@lo:400: 00000100:00100000:3.0:1783071358.788795:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071358.788847:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02c0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1869685707545728:0@lo:400: 00000100:00100000:3.0:1783071358.788873:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071358.788891:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02c08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1869685707546240:0@lo:400: 00000100:00100000:3.0:1783071358.788914:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071358.788937:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1783071358.788943:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02c0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869685707545344:0@lo:400: 00000100:00100000:3.0:1783071358.788962:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071358.788977:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02c08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1869685707545856:0@lo:400: 00000100:00100000:3.0:1783071358.789015:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071358.789026:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02c0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1869685707546368:0@lo:400: 00000100:00100000:3.0:1783071358.789045:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071358.789067:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02c0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707545472:0@lo:400: 00000100:00100000:3.0:1783071358.789091:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071358.789109:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02c09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707545984:0@lo:400: 00000100:00100000:3.0:1783071358.789130:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071358.789148:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1783071358.789154:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02c09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869685707545600:0@lo:400: 00000100:00100000:3.0:1783071358.789188:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071358.789201:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02c09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707546112:0@lo:400: 00000100:00100000:3.0:1783071358.789221:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071358.789489:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707545216 00000100:00100000:1.0:1783071358.789498:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707545216 00000100:00100000:1.0:1783071358.789556:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1783071358.789566:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+15:3647:x1869685707545216:12345-0@lo:400: 00000100:00100000:1.0:1783071358.789621:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+15:3647:x1869685707545216:12345-0@lo:400: Request processed in 57us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071358.789629:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1783071358.790035:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707545728 00000100:00100000:3.0:1783071358.790041:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707545728 00000100:00100000:3.0:1783071358.790082:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707546240 00000100:00100000:3.0:1783071358.790085:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707546240 00000100:00100000:3.0:1783071358.790100:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707545344 00000100:00100000:3.0:1783071358.790102:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707545344 00000100:00100000:3.0:1783071358.790112:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707545856 00000100:00100000:3.0:1783071358.790114:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707545856 00000100:00100000:3.0:1783071358.790126:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707546368 00000100:00100000:3.0:1783071358.790128:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707546368 00000100:00100000:3.0:1783071358.790141:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707545600 00000100:00100000:3.0:1783071358.790143:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707545600 00000100:00100000:3.0:1783071358.790156:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783071358.790162:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02c08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869685707545728:12345-0@lo:400: 00000100:00100000:3.0:1783071358.790203:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02c08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869685707545728:12345-0@lo:400: Request processed in 40us (1328us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071358.790222:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783071358.790236:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783071358.790242:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02c08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869685707546240:12345-0@lo:400: 00000100:00100000:3.0:1783071358.790350:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02c08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869685707546240:12345-0@lo:400: Request processed in 107us (1434us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071358.790356:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783071358.790386:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783071358.790392:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02c0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869685707545344:12345-0@lo:400: 00000100:00100000:3.0:1783071358.790419:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02c0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869685707545344:12345-0@lo:400: Request processed in 28us (1456us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071358.790425:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783071358.790447:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783071358.790454:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02c0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869685707545856:12345-0@lo:400: 00000100:00100000:3.0:1783071358.790492:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02c0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869685707545856:12345-0@lo:400: Request processed in 39us (1475us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071358.790497:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783071358.790507:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783071358.790512:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02c0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869685707546368:12345-0@lo:400: 00000100:00100000:3.0:1783071358.790536:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02c0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869685707546368:12345-0@lo:400: Request processed in 24us (1490us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071358.790541:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783071358.790550:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783071358.790555:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03330a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1869685707545600:12345-0@lo:400: 00000100:00100000:3.0:1783071358.790594:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03330a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1869685707545600:12345-0@lo:400: Request processed in 38us (1405us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071358.790605:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1783071358.790626:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a02c09880 x1869685707545600/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071358.790630:0:9413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707545472 00000100:00100000:3.0:1783071358.790633:0:9413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707545472 00000100:00100000:1.0:1783071358.790642:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02c09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869685707545600:0@lo:400: 00000100:00100000:3.0:1783071358.790657:0:9413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783071358.790663:0:9413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02c09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707545472:12345-0@lo:400: 00000100:00100000:3.0:1783071358.790717:0:9413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02c09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707545472:12345-0@lo:400: Request processed in 54us (1624us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071358.790723:0:9413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783071358.790742:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707545984 00000100:00100000:3.0:1783071358.790745:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707545984 00000100:00100000:1.0:1783071358.790766:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02c0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707545472:0@lo:400: 00000100:00100000:3.0:1783071358.790767:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707546112 00000100:00100000:3.0:1783071358.790770:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707546112 00000100:00100000:3.0:1783071358.790787:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783071358.790794:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02c0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707545984:12345-0@lo:400: 00000100:00100000:3.0:1783071358.790835:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02c0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707545984:12345-0@lo:400: Request processed in 41us (1703us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071358.790841:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783071358.790853:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783071358.790858:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03331180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707546112:12345-0@lo:400: 00000100:00100000:3.0:1783071358.790885:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03331180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707546112:12345-0@lo:400: Request processed in 28us (1663us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071358.790890:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1783071358.790919:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a02c0a300 x1869685707545344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071358.790929:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02c0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869685707545344:0@lo:400: 00010000:00080000:3.0:1783071358.790940:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a02c08380 x1869685707545856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071358.790954:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02c08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1869685707545856:0@lo:400: 00010000:00080000:3.0:1783071358.790966:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a02c0ad80 x1869685707546368/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071358.790973:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02c0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1869685707546368:0@lo:400: 00000100:00100000:3.0:1783071358.790982:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02c09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:feaa1501-b927-4e07-baad-3200e92d7497:3647:1869685707545216:0@lo:400: 00010000:00080000:3.0:1783071358.790990:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a02c0aa00 x1869685707545728/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071358.790997:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02c0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1869685707545728:0@lo:400: 00010000:00080000:3.0:1783071358.791006:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a02c08a80 x1869685707546240/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071358.791013:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02c08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1869685707546240:0@lo:400: 00000100:00080000:0.0:1783071358.791128:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783071358.791132:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1783071358.791315:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a02c09f80 x1869685707546112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071358.791325:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02c09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707546112:0@lo:400: 00010000:00080000:1.0:1783071358.791336:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a02c09500 x1869685707545984/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071358.791344:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02c09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707545984:0@lo:400: 00000001:02000400:2.0:1783071358.914018:0:9870:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg438-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1783071359.236403:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783071359.741061:0:9922:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783071359.741299:0:9922:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783071360.258534:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071361.286135:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071361.858652:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783071361.858683:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707546496:0@lo:41: 00000100:00100000:3.0:1783071361.858761:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071361.858833:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707546496 00000100:00100000:3.0:1783071361.858841:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707546496 00000100:00100000:3.0:1783071361.858889:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1783071361.858897:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03332300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707546496:12345-0@lo:41: 00000004:00000024:3.0:1783071361.858937:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:3.0:1783071361.858982:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03332300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707546496:12345-0@lo:41: Request processed in 86us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071361.858998:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1783071361.859049:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707546496:0@lo:41: 10000000:01000000:0.0:1783071361.859734:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783071361.859739:0:6513:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8f8b069b2000 from 39 10000000:01000000:0.0:1783071361.859743:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783071361.859778:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461c00/0x6b58994c2cbdbefe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071361.859788:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461c00/0x6b58994c2cbdbefe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071361.859796:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461c00/0x6b58994c2cbdbefe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071361.859825:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37a63800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707546624:0@lo:101: 00000100:00100000:0.0:1783071361.859865:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071361.859893:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b0511dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1783071361.859918:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707546624 00000100:00100000:0.0:1783071361.859925:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707546624 00000100:00100000:0.0:1783071361.859959:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1783071361.859965:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+15:6513:x1869685707546624:12345-0@lo:101: 00010000:00010000:0.0:1783071361.859975:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071361.859987:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b3c460e00/0x6b58994c2cbdbf05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdbefe expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071361.860009:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b3c460e00/0x6b58994c2cbdbf05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdbefe expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071361.860019:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b3c460e00/0x6b58994c2cbdbf05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbefe expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071361.860027:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b3c460e00, rc 0) 00000100:00100000:0.0:1783071361.860056:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+16:6513:x1869685707546624:12345-0@lo:101: Request processed in 91us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071361.860061:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1783071361.860102:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37a63800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707546624:0@lo:101: 00010000:00010000:0.0:1783071361.860116:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461c00/0x6b58994c2cbdbefe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbf05 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071361.860123:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461c00/0x6b58994c2cbdbefe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdbf05 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071361.860186:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37a63800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707546752:0@lo:501: 00000100:00100000:0.0:1783071361.860214:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071361.860229:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b0511dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1783071361.860242:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707546752 00000100:00100000:0.0:1783071361.860245:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707546752 00000100:00100000:0.0:1783071361.860268:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1783071361.860274:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+16:6513:x1869685707546752:12345-0@lo:501: 00000100:00100000:0.0:1783071361.860418:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+16:6513:x1869685707546752:12345-0@lo:501: Request processed in 142us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071361.860425:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1783071361.860455:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37a63800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707546752:0@lo:501: 00000100:00100000:0.0:1783071361.860479:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37a63800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707546880:0@lo:503: 00000100:00100000:0.0:1783071361.860516:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071361.860543:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b0511dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1783071361.860694:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707546880 00000100:00100000:3.0:1783071361.860699:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707546880 00000100:00100000:3.0:1783071361.860731:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1783071361.860739:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+16:6513:x1869685707546880:12345-0@lo:503: 00000100:00100000:3.0:1783071361.860829:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+16:6513:x1869685707546880:12345-0@lo:503: Request processed in 91us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071361.860836:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1783071361.862125:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37a63800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707546880:0@lo:503: 00000100:00100000:2.0:1783071361.863910:0:9993:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01765f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:9993:1869685707547008:0@lo:502: 00000100:00100000:2.0:1783071361.864046:0:9993:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071361.864094:0:9993:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0324f840 going to sleep for 11 seconds 00000100:00100000:0.0:1783071361.864209:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707547008 00000100:00100000:0.0:1783071361.864216:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707547008 00000100:00100000:0.0:1783071361.864284:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1783071361.864297:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+16:9993:x1869685707547008:12345-0@lo:502: 00000100:00100000:0.0:1783071361.864514:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+16:9993:x1869685707547008:12345-0@lo:502: Request processed in 219us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071361.864523:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1783071361.864848:0:9993:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01765f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:9993:1869685707547008:0@lo:502: 00000100:00100000:2.0:1783071361.864915:0:9993:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01765f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:9993:1869685707547136:0@lo:502: 00000100:00100000:2.0:1783071361.864960:0:9993:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071361.864992:0:9993:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0324f840 going to sleep for 11 seconds 00000100:00100000:0.0:1783071361.865615:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707547136 00000100:00100000:0.0:1783071361.865633:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707547136 00000100:00100000:0.0:1783071361.865691:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1783071361.865700:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+16:9993:x1869685707547136:12345-0@lo:502: 00000100:00100000:0.0:1783071361.865832:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+16:9993:x1869685707547136:12345-0@lo:502: Request processed in 134us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071361.865839:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1783071361.866407:0:9993:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01765f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:9993:1869685707547136:0@lo:502: 00000040:00080000:2.0:1783071361.866438:0:9993:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1783071361.867309:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1783071361.867334:0:6513:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783071361.867345:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461c00/0x6b58994c2cbdbefe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbf05 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071361.867356:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461c00/0x6b58994c2cbdbefe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbf05 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783071361.867400:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1783071361.867403:0:6513:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1783071361.867406:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1783071361.867449:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460800/0x6b58994c2cbdbf0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071361.867459:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460800/0x6b58994c2cbdbf0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071361.867469:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460800/0x6b58994c2cbdbf0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071361.867488:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37a63800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707547264:0@lo:101: 00000100:00100000:0.0:1783071361.867555:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071361.867595:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b0511d780 going to sleep for 11 seconds 00000100:00100000:2.0:1783071361.867743:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707547264 00000100:00100000:2.0:1783071361.867750:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707547264 00000100:00100000:2.0:1783071361.868735:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1783071361.868750:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+16:6513:x1869685707547264:12345-0@lo:101: 00010000:00010000:2.0:1783071361.868768:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071361.868784:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b10967600/0x6b58994c2cbdbf13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdbf0c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071361.868813:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b10967600/0x6b58994c2cbdbf13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdbf0c expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071361.868823:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b10967600/0x6b58994c2cbdbf13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbf0c expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071361.868832:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b10967600, rc 0) 00000100:00100000:2.0:1783071361.868899:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+17:6513:x1869685707547264:12345-0@lo:101: Request processed in 154us (1344us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071361.868906:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1783071361.869586:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37a63800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707547264:0@lo:101: 00010000:00010000:1.0:1783071361.869622:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460800/0x6b58994c2cbdbf0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbf13 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071361.869632:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460800/0x6b58994c2cbdbf0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdbf13 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071361.869726:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c79ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707547392:0@lo:501: 00000100:00100000:1.0:1783071361.869775:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071361.873191:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b06dbc900 going to sleep for 11 seconds 00000100:00100000:3.0:1783071361.875455:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707547392 00000100:00100000:3.0:1783071361.875472:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707547392 00000100:00100000:3.0:1783071361.875727:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1783071361.875742:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+17:6513:x1869685707547392:12345-0@lo:501: 00000100:00100000:3.0:1783071361.875994:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+17:6513:x1869685707547392:12345-0@lo:501: Request processed in 255us (6219us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071361.876002:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1783071361.880284:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c79ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707547392:0@lo:501: 00000100:00100000:1.0:1783071361.880343:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c79ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707547520:0@lo:503: 00000100:00100000:1.0:1783071361.880463:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071361.880508:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b06dbc900 going to sleep for 11 seconds 00000100:00100000:0.0:1783071361.881195:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707547520 00000100:00100000:0.0:1783071361.881202:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707547520 00000100:00100000:0.0:1783071361.881269:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1783071361.881277:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+17:6513:x1869685707547520:12345-0@lo:503: 00000100:00100000:0.0:1783071361.881427:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+17:6513:x1869685707547520:12345-0@lo:503: Request processed in 150us (965us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071361.881435:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1783071361.881601:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c79ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707547520:0@lo:503: 00000100:00100000:1.0:1783071361.881793:0:9994:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c79ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:9994:1869685707547648:0@lo:502: 00000100:00100000:1.0:1783071361.881829:0:9994:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071361.881845:0:9994:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b06dbce40 going to sleep for 11 seconds 00000100:00100000:1.0:1783071361.881868:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707547648 00000100:00100000:1.0:1783071361.881871:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707547648 00000100:00100000:1.0:1783071361.881890:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1783071361.881896:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+18:9994:x1869685707547648:12345-0@lo:502: 00000100:00100000:1.0:1783071361.881980:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+18:9994:x1869685707547648:12345-0@lo:502: Request processed in 83us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071361.881986:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1783071361.882024:0:9994:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c79ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:9994:1869685707547648:0@lo:502: 00000020:01000000:1.0:1783071361.882047:0:9994:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783071361.882055:0:9994:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783071361.882058:0:9994:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1783071361.882062:0:9994:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783071361.882064:0:9994:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1783071361.882077:0:9994:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c79ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:9994:1869685707547776:0@lo:502: 00000100:00100000:1.0:1783071361.882103:0:9994:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071361.882118:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707547776 00000100:00100000:1.0:1783071361.882121:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707547776 00000100:00100000:1.0:1783071361.882137:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1783071361.882142:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+18:9994:x1869685707547776:12345-0@lo:502: 00000100:00100000:1.0:1783071361.882189:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+18:9994:x1869685707547776:12345-0@lo:502: Request processed in 46us (84us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071361.882194:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1783071361.882217:0:9994:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b06dbce40 going to sleep for 11 seconds 00000100:00100000:1.0:1783071361.882227:0:9994:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c79ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:9994:1869685707547776:0@lo:502: 00000020:01000000:1.0:1783071361.882242:0:9994:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783071361.882246:0:9994:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783071361.882248:0:9994:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:1.0:1783071361.882252:0:9994:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1783071361.882311:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1783071361.882329:0:6513:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1783071361.882341:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460800/0x6b58994c2cbdbf0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbf13 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071361.882352:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460800/0x6b58994c2cbdbf0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbf13 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783071361.882396:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783071361.882404:0:6513:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8f8b3447b000 from 39 10000000:01000000:1.0:1783071361.882407:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783071361.882433:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b421d8600/0x6b58994c2cbdbf1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071361.882442:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8b421d8600/0x6b58994c2cbdbf1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071361.882461:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8b421d8600/0x6b58994c2cbdbf1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071361.882472:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c79ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707547904:0@lo:101: 00000100:00100000:1.0:1783071361.882503:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071361.882515:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b06dbce40 going to sleep for 11 seconds 00000100:00100000:1.0:1783071361.882525:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707547904 00000100:00100000:1.0:1783071361.882528:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707547904 00000100:00100000:1.0:1783071361.882545:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1783071361.882549:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+18:6513:x1869685707547904:12345-0@lo:101: 00010000:00010000:1.0:1783071361.882557:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071361.882568:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b421d9e00/0x6b58994c2cbdbf21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdbf1a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071361.882588:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b421d9e00/0x6b58994c2cbdbf21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdbf1a expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071361.882598:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b421d9e00/0x6b58994c2cbdbf21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbf1a expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071361.882607:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b421d9e00, rc 0) 00000100:00100000:1.0:1783071361.882629:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+19:6513:x1869685707547904:12345-0@lo:101: Request processed in 79us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071361.882640:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1783071361.882665:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c79ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707547904:0@lo:101: 00010000:00010000:1.0:1783071361.882675:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8b421d8600/0x6b58994c2cbdbf1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbf21 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071361.882684:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8b421d8600/0x6b58994c2cbdbf1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdbf21 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071361.882717:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c79ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707548032:0@lo:501: 00000100:00100000:1.0:1783071361.882736:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071361.882745:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b06dbce40 going to sleep for 11 seconds 00000100:00100000:1.0:1783071361.882754:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707548032 00000100:00100000:1.0:1783071361.882758:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707548032 00000100:00100000:1.0:1783071361.882773:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1783071361.882778:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+19:6513:x1869685707548032:12345-0@lo:501: 00000100:00100000:1.0:1783071361.882869:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+19:6513:x1869685707548032:12345-0@lo:501: Request processed in 90us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071361.882875:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1783071361.882897:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c79ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707548032:0@lo:501: 00000100:00100000:1.0:1783071361.882915:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c79ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707548160:0@lo:503: 00000100:00100000:1.0:1783071361.882942:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071361.882952:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b06dbce40 going to sleep for 11 seconds 00000100:00100000:1.0:1783071361.882961:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707548160 00000100:00100000:1.0:1783071361.882964:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707548160 00000100:00100000:1.0:1783071361.882978:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1783071361.882983:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+19:6513:x1869685707548160:12345-0@lo:503: 00000100:00100000:1.0:1783071361.883038:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+19:6513:x1869685707548160:12345-0@lo:503: Request processed in 54us (95us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071361.883044:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1783071361.883074:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c79ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707548160:0@lo:503: 00000100:00100000:1.0:1783071361.883270:0:9995:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c79ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:9995:1869685707548288:0@lo:502: 00000100:00100000:1.0:1783071361.883299:0:9995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071361.883315:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707548288 00000100:00100000:1.0:1783071361.883318:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707548288 00000100:00100000:1.0:1783071361.883334:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1783071361.883339:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+19:9995:x1869685707548288:12345-0@lo:502: 00000100:00100000:1.0:1783071361.883438:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+19:9995:x1869685707548288:12345-0@lo:502: Request processed in 98us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071361.883444:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1783071361.883472:0:9995:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b06dbc840 going to sleep for 11 seconds 00000100:00100000:1.0:1783071361.883484:0:9995:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c79ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:9995:1869685707548288:0@lo:502: 00000100:00100000:1.0:1783071361.883540:0:9995:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c79ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:9995:1869685707548416:0@lo:502: 00000100:00100000:1.0:1783071361.883570:0:9995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071361.883587:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707548416 00000100:00100000:1.0:1783071361.883590:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707548416 00000100:00100000:1.0:1783071361.883608:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1783071361.883614:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+19:9995:x1869685707548416:12345-0@lo:502: 00000100:00100000:1.0:1783071361.883668:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+19:9995:x1869685707548416:12345-0@lo:502: Request processed in 53us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071361.883675:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1783071361.883704:0:9995:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b34e1c780 going to sleep for 11 seconds 00000100:00100000:1.0:1783071361.884834:0:9995:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c79ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:9995:1869685707548416:0@lo:502: 00000040:00080000:1.0:1783071361.884880:0:9995:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1783071361.888195:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1783071361.888239:0:6513:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783071361.888253:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b421d8600/0x6b58994c2cbdbf1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbf21 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071361.888266:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8b421d8600/0x6b58994c2cbdbf1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbf21 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783071361.888276:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783071361.888279:0:6513:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8f8b3447b000 from 6 10000000:01000000:0.0:1783071361.888281:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783071361.888323:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461000/0x6b58994c2cbdbf28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071361.888333:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461000/0x6b58994c2cbdbf28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071361.888345:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461000/0x6b58994c2cbdbf28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071361.888390:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37a60e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707548544:0@lo:101: 00000100:00100000:0.0:1783071361.888470:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071361.888519:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b0511d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783071361.888728:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707548544 00000100:00100000:1.0:1783071361.888736:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707548544 00000100:00100000:1.0:1783071361.888793:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1783071361.888803:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+18:6513:x1869685707548544:12345-0@lo:101: 00010000:00010000:1.0:1783071361.888819:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071361.888856:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8a01748c00/0x6b58994c2cbdbf2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdbf28 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071361.888886:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8a01748c00/0x6b58994c2cbdbf2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdbf28 expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071361.888897:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8a01748c00/0x6b58994c2cbdbf2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbf28 expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071361.888908:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a01748c00, rc 0) 00000100:00100000:1.0:1783071361.888967:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+19:6513:x1869685707548544:12345-0@lo:101: Request processed in 165us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071361.888974:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1783071361.889062:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37a60e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707548544:0@lo:101: 00010000:00010000:0.0:1783071361.889086:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461000/0x6b58994c2cbdbf28 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbf2f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071361.889095:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461000/0x6b58994c2cbdbf28 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdbf2f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071361.889147:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37a60e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707548672:0@lo:256: 00000100:00100000:0.0:1783071361.889182:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071361.889203:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b0511d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071361.889302:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707548672 00000100:00100000:3.0:1783071361.889307:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707548672 00000100:00100000:3.0:1783071361.889340:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1783071361.889348:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+19:6513:x1869685707548672:12345-0@lo:256: 20000000:01000000:3.0:1783071361.889392:0:6508:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783071361.889411:0:6508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783071361.889414:0:6508:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1783071361.890260:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+19:6513:x1869685707548672:12345-0@lo:256: Request processed in 908us (1072us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071361.890269:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1783071361.890272:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37a60e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707548672:0@lo:256: 10000000:01000000:0.0:1783071361.890320:0:6513:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783071361.890329:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461000/0x6b58994c2cbdbf28 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbf2f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071361.890338:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461000/0x6b58994c2cbdbf28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbf2f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783071361.890347:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1783071361.890350:0:6513:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:0.0:1783071361.890352:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1783071361.890433:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461400/0x6b58994c2cbdbf36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071361.890442:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461400/0x6b58994c2cbdbf36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071361.890450:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461400/0x6b58994c2cbdbf36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071361.890477:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37a60e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707548800:0@lo:101: 00000100:00100000:0.0:1783071361.890508:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071361.890543:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b0511d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783071361.890607:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707548800 00000100:00100000:1.0:1783071361.890613:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707548800 00000100:00100000:1.0:1783071361.890724:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1783071361.890732:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+19:6513:x1869685707548800:12345-0@lo:101: 00010000:00010000:1.0:1783071361.890742:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071361.890754:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8a01748800/0x6b58994c2cbdbf3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdbf36 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071361.890775:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8a01748800/0x6b58994c2cbdbf3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdbf36 expref: 20 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071361.890791:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8a01748800/0x6b58994c2cbdbf3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbf36 expref: 20 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071361.890799:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a01748800, rc 0) 00000100:00100000:1.0:1783071361.890831:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+20:6513:x1869685707548800:12345-0@lo:101: Request processed in 101us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071361.890836:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1783071361.891815:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37a60e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707548800:0@lo:101: 00010000:00010000:3.0:1783071361.891835:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461400/0x6b58994c2cbdbf36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbf3d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071361.891846:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461400/0x6b58994c2cbdbf36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdbf3d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071361.891921:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03333b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707548928:0@lo:501: 00000100:00100000:3.0:1783071361.891958:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071361.891995:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b05e0bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1783071361.892171:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707548928 00000100:00100000:0.0:1783071361.892178:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707548928 00000100:00100000:0.0:1783071361.892220:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1783071361.892229:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+20:6513:x1869685707548928:12345-0@lo:501: 00000100:00100000:0.0:1783071361.892412:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+20:6513:x1869685707548928:12345-0@lo:501: Request processed in 184us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071361.892419:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1783071361.894771:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03333b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707548928:0@lo:501: 00000100:00100000:3.0:1783071361.894866:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03333b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707549056:0@lo:503: 00000100:00100000:3.0:1783071361.894954:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071361.895010:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b05e0bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1783071361.895105:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707549056 00000100:00100000:1.0:1783071361.895113:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707549056 00000100:00100000:1.0:1783071361.895168:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1783071361.895178:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+20:6513:x1869685707549056:12345-0@lo:503: 00000100:00100000:1.0:1783071361.895314:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+20:6513:x1869685707549056:12345-0@lo:503: Request processed in 137us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071361.895322:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1783071361.895557:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03333b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707549056:0@lo:503: 00000100:00100000:1.0:1783071361.896286:0:9997:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c79ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:9997:1869685707549184:0@lo:502: 00000100:00100000:1.0:1783071361.896340:0:9997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071361.896430:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707549184 00000100:00100000:2.0:1783071361.896445:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707549184 00000100:00100000:2.0:1783071361.896478:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1783071361.896485:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+20:9997:x1869685707549184:12345-0@lo:502: 00000100:00100000:1.0:1783071361.896978:0:9997:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b34e1cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1783071361.896986:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+20:9997:x1869685707549184:12345-0@lo:502: Request processed in 499us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071361.896995:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1783071361.897065:0:9997:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c79ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:9997:1869685707549184:0@lo:502: 00000020:01000000:1.0:1783071361.897095:0:9997:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783071361.897103:0:9997:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1783071361.897111:0:9997:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783071361.897114:0:9997:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1783071361.897120:0:9997:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783071361.897125:0:9997:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.138@tcp to nid 0x20000c0a8cc8a (192.168.204.138@tcp) 00000020:01000000:1.0:1783071361.897151:0:9997:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1783071361.897155:0:9997:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783071361.897178:0:9997:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8f8a017d8000) 00000020:00000080:1.0:1783071361.897203:0:9997:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:1.0:1783071361.897211:0:9997:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783071361.897476:0:9997:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1783071361.897484:0:9997:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:1.0:1783071361.897491:0:9997:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x6b58994c2cbdbf4b 00010000:00080000:1.0:1783071361.897522:0:9997:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f8a0319d000@lustre-OST0001-osc-MDT0001: add connection 192.168.204.138@tcp at head 00010000:00010000:1.0:1783071361.897902:0:9997:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:1.0:1783071361.899272:0:9997:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1783071361.899297:0:9997:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1783071361.900783:0:9997:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783071361.901721:0:9997:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783071361.901951:0:9997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1783071361.902082:0:9997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1783071361.903910:0:9998:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783071361.903918:0:9998:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1783071361.910971:0:9997:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1783071361.911358:0:9997:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1783071361.912500:0:9997:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1783071361.912529:0:9997:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x6b58994c2cbdbf52 00000100:00080000:1.0:1783071361.912749:0:9997:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783071361.913144:0:9997:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8f8a0319d000 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:1.0:1783071361.913195:0:9997:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8b3c79ce00 x1869685707549312/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783071361.913261:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c79ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1869685707549312:0@lo:8: 00000100:00100000:2.0:1783071361.913442:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783071361.913522:0:9997:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1783071361.913675:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707549312 00000100:00100000:3.0:1783071361.913684:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707549312 00000020:01000000:1.0:1783071361.913691:0:9997:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783071361.913699:0:9997:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783071361.913701:0:9997:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1783071361.913705:0:9997:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783071361.913710:0:9997:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783071361.913711:0:9997:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000100:00100000:3.0:1783071361.913726:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000020:00000080:1.0:1783071361.913731:0:9997:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783071361.913735:0:9997:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1783071361.913737:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01765f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3644:x1869685707549312:12345-0@lo:8: 00010000:00080000:3.0:1783071361.913773:0:8431:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 263 last 0 00000020:00000080:3.0:1783071361.913802:0:8431:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x6b58994c2cbdbf59 00002000:00100000:3.0:1783071361.913819:0:8431:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8f8a023e7000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1783071361.913824:0:8431:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:3.0:1783071361.913829:0:8431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1783071361.913904:0:8431:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1783071361.914026:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37a60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1869685707549952:0@lo:400: 00000100:00100000:0.0:1783071361.914270:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071361.914355:0:9997:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c79f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:9997:1869685707549440:0@lo:502: 00000100:00100000:1.0:1783071361.914444:0:9997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071361.914468:0:9997:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b34e1c840 going to sleep for 11 seconds 00000100:00100000:0.0:1783071361.914623:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37a62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1869685707550464:0@lo:400: 00000100:00100000:0.0:1783071361.914651:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071361.914677:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1783071361.914684:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37a63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869685707549568:0@lo:400: 00000100:00100000:0.0:1783071361.914711:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071361.914731:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37a63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1869685707550080:0@lo:400: 00002000:00080000:3.0:1783071361.914806:0:8431:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1783071361.914849:0:8431:0:(import.c:65:import_set_state_nolock()) ffff8f8a023e2800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783071361.914942:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707549440 00000100:00100000:2.0:1783071361.914948:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707549440 00000100:00100000:2.0:1783071361.914999:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1783071361.915008:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+20:9997:x1869685707549440:12345-0@lo:502: 00000100:00100000:1.0:1783071361.915151:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707549952 00000100:00100000:1.0:1783071361.915156:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707549952 00000100:00100000:1.0:1783071361.915190:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707550464 00000100:00100000:1.0:1783071361.915193:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707550464 00000100:00100000:1.0:1783071361.915206:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707549568 00000100:00100000:1.0:1783071361.915208:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707549568 00000100:00100000:1.0:1783071361.915218:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783071361.915225:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37a62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1869685707549952:12345-0@lo:400: 00000100:00100000:1.0:1783071361.915697:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37a62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1869685707549952:12345-0@lo:400: Request processed in 468us (1423us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071361.915707:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783071361.915709:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01765f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3644:x1869685707549312:12345-0@lo:8: Request processed in 1968us (2263us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071361.915725:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783071361.915733:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783071361.915742:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37a61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1869685707550464:12345-0@lo:400: 00000100:00100000:1.0:1783071361.915804:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37a61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1869685707550464:12345-0@lo:400: Request processed in 64us (1152us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071361.915811:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783071361.915823:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783071361.915829:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1869685707549568:12345-0@lo:400: 00000100:00100000:1.0:1783071361.915853:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1869685707549568:12345-0@lo:400: Request processed in 24us (1142us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071361.915859:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783071361.916461:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071361.916614:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37a63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1869685707550592:0@lo:400: 00000100:00100000:0.0:1783071361.916658:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071361.916781:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+20:9997:x1869685707549440:12345-0@lo:502: Request processed in 1772us (2334us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071361.916801:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00010000:00080000:2.0:1783071361.916900:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c79ce00 x1869685707549312/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783071371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071361.916914:0:3644:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783071361.916923:0:3644:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1783071361.916934:0:3644:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1783071361.916941:0:3644:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1783071361.916946:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8f8a0319d000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1783071361.916960:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1783071361.916967:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c79ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1869685707549312:0@lo:8: 00000100:00100000:3.0:1783071361.917411:0:9997:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c79f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:9997:1869685707549440:0@lo:502: 00010000:00080000:0.0:1783071361.917415:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b37a60e00 x1869685707549952/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071361.917429:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37a60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1869685707549952:0@lo:400: 00000020:01000000:3.0:1783071361.917455:0:9997:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00010000:00080000:0.0:1783071361.917466:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b37a62a00 x1869685707550464/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071361.917476:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37a62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1869685707550464:0@lo:400: 00010000:00080000:0.0:1783071361.917502:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b37a63100 x1869685707549568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071361.917511:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37a63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869685707549568:0@lo:400: 00000100:00100000:0.0:1783071361.917535:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37a62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869685707549696:0@lo:400: 00000100:00100000:2.0:1783071361.917685:0:9999:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3b4dbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9999:1869685707550720:0@lo:700: 00000100:00100000:2.0:1783071361.917723:0:9999:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1783071361.917729:0:9997:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071361.917735:0:9997:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:3.0:1783071361.917742:0:9997:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000100:00100000:2.0:1783071361.917756:0:9999:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0324f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783071361.917822:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1783071361.917859:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:2.0:1783071361.917889:0:6513:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1783071361.917901:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461400/0x6b58994c2cbdbf36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbf3d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071361.917913:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461400/0x6b58994c2cbdbf36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbf3d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071361.917923:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783071361.917926:0:6513:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8f8b10f7e000 from 39 10000000:01000000:2.0:1783071361.917929:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783071361.917957:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b10966000/0x6b58994c2cbdbf60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071361.917965:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8b10966000/0x6b58994c2cbdbf60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071361.917975:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8b10966000/0x6b58994c2cbdbf60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071361.917987:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0178c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707550848:0@lo:101: 00000100:00100000:2.0:1783071361.918026:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071361.918063:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0324f900 going to sleep for 11 seconds 00000100:00100000:1.0:1783071361.918263:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707550080 00000100:00100000:1.0:1783071361.918271:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707550080 00000100:00100000:1.0:1783071361.918326:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707550592 00000100:00100000:1.0:1783071361.918330:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707550592 00000100:00100000:1.0:1783071361.918347:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783071361.918354:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b078dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1869685707550080:12345-0@lo:400: 00000100:00100000:1.0:1783071361.918431:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b078dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1869685707550080:12345-0@lo:400: Request processed in 76us (1971us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071361.918435:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707550848 00000100:00100000:1.0:1783071361.918440:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783071361.918441:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707550848 00000100:00100000:1.0:1783071361.918460:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783071361.918469:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b078d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1869685707550592:12345-0@lo:400: 00000100:00100000:3.0:1783071361.918501:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1783071361.918502:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b078d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1869685707550592:12345-0@lo:400: Request processed in 33us (1841us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071361.918512:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783071361.918516:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+20:6513:x1869685707550848:12345-0@lo:101: 00010000:00010000:3.0:1783071361.918529:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00080000:1.0:1783071361.918537:0:9998:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00010000:00010000:3.0:1783071361.918544:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b014b9000/0x6b58994c2cbdbf67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdbf60 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071361.918569:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b014b9000/0x6b58994c2cbdbf67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdbf60 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071361.918580:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b014b9000/0x6b58994c2cbdbf67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbf60 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071361.918588:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b014b9000, rc 0) 00000100:00100000:3.0:1783071361.918624:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+21:6513:x1869685707550848:12345-0@lo:101: Request processed in 113us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071361.918630:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1783071361.918671:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0178c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707550848:0@lo:101: 00010000:00010000:3.0:1783071361.918687:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8b10966000/0x6b58994c2cbdbf60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbf67 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071361.918707:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8b10966000/0x6b58994c2cbdbf60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdbf67 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1783071361.918709:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b37a63800 x1869685707550080/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071361.918727:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37a63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1869685707550080:0@lo:400: 00010000:00080000:2.0:1783071361.918739:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b37a63b80 x1869685707550592/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071361.918761:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37a63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1869685707550592:0@lo:400: 00000100:00100000:3.0:1783071361.918781:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03333b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707550976:0@lo:501: 00000100:00100000:3.0:1783071361.918818:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071361.918853:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b05e0b540 going to sleep for 11 seconds 00000100:00100000:2.0:1783071361.918884:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707550976 00000100:00100000:2.0:1783071361.918889:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707550976 00000100:00100000:2.0:1783071361.918919:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1783071361.918925:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+21:6513:x1869685707550976:12345-0@lo:501: 00000100:00100000:2.0:1783071361.919065:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+21:6513:x1869685707550976:12345-0@lo:501: Request processed in 139us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071361.919071:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000004:00080000:1.0:1783071361.919288:0:9998:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 263707922823ns, next at 0ns, rc = 0 00080000:00080000:1.0:1783071361.919295:0:9998:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1783071361.919597:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03333b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707550976:0@lo:501: 00000100:00100000:3.0:1783071361.919629:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03333b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707551104:0@lo:503: 00000100:00100000:3.0:1783071361.919676:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071361.919698:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b05e0b540 going to sleep for 11 seconds 00000100:00100000:1.0:1783071361.919911:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707551104 00000100:00100000:1.0:1783071361.919916:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707551104 00000100:00100000:1.0:1783071361.919956:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1783071361.919963:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+21:6513:x1869685707551104:12345-0@lo:503: 00000100:00100000:1.0:1783071361.920079:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+21:6513:x1869685707551104:12345-0@lo:503: Request processed in 116us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071361.920086:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1783071361.920223:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03333b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707551104:0@lo:503: 00000100:00100000:0.0:1783071361.921423:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37a62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707550208:0@lo:400: 00000100:00100000:0.0:1783071361.921473:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071361.921506:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1783071361.921516:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707550208 00000100:00100000:0.0:1783071361.921516:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37a63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707549824:0@lo:400: 00000100:00100000:3.0:1783071361.921526:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707550208 00000100:00100000:0.0:1783071361.921549:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071361.921580:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783071361.921588:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b078daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707550208:12345-0@lo:400: 00000100:00100000:3.0:1783071361.921638:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b078daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707550208:12345-0@lo:400: Request processed in 50us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071361.921644:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783071361.921665:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707549824 00000100:00100000:3.0:1783071361.921668:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707549824 00000100:00100000:3.0:1783071361.921691:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783071361.921696:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37a63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707549824:12345-0@lo:400: 00000100:00100000:3.0:1783071361.921730:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37a63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707549824:12345-0@lo:400: Request processed in 34us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071361.921735:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783071361.921756:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37a61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707550336:0@lo:400: 00000100:00100000:3.0:1783071361.921779:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707549696 00000100:00100000:3.0:1783071361.921789:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707549696 00000100:00100000:0.0:1783071361.921792:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071361.921818:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783071361.921823:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b078db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869685707549696:12345-0@lo:400: 00000100:00100000:3.0:1783071361.921857:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b078db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869685707549696:12345-0@lo:400: Request processed in 33us (4035us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071361.921865:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783071361.921890:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707550336 00000100:00100000:3.0:1783071361.921893:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707550336 00010000:00080000:0.0:1783071361.921898:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b37a62680 x1869685707549696/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071361.921912:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37a62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869685707549696:0@lo:400: 00010000:00080000:0.0:1783071361.921925:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b37a62d80 x1869685707550208/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071361.921929:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783071361.921939:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37a62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707550208:0@lo:400: 00000100:00100000:3.0:1783071361.921941:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37a63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707550336:12345-0@lo:400: 00000004:00080000:2.0:1783071361.921966:0:7447:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:0.0:1783071361.921969:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37a63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707549824:0@lo:400: 00010000:00080000:0.0:1783071361.921982:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b37a61500 x1869685707550336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071361.921984:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37a63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707550336:12345-0@lo:400: Request processed in 46us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071361.922000:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37a61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707550336:0@lo:400: 00000100:00100000:3.0:1783071361.922006:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1783071361.922055:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783071361.922061:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783071361.922063:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783071361.922134:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707550720 00000100:00100000:0.0:1783071361.922139:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707550720 00000100:00100000:0.0:1783071361.922190:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783071361.922196:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0178dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9999:x1869685707550720:12345-0@lo:700: 00000100:00100000:2.0:1783071361.922213:0:10000:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0178f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:10000:1869685707551232:0@lo:502: 00000100:00100000:0.0:1783071361.922229:0:8439:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37a61500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8439:1869685707551360:0@lo:700: 00000100:00080000:3.0:1783071361.922283:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783071361.922657:0:8439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071361.922660:0:10000:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071361.922680:0:8439:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b0511d780 going to sleep for 11 seconds 00000100:00100000:1.0:1783071361.922700:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707551360 00000100:00100000:1.0:1783071361.922704:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707551360 00000100:00100000:1.0:1783071361.922731:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783071361.922738:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37a63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8439:x1869685707551360:12345-0@lo:700: 00000100:00100000:3.0:1783071361.922899:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707551232 00000100:00100000:3.0:1783071361.922903:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707551232 00000100:00100000:3.0:1783071361.922945:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1783071361.922952:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+21:10000:x1869685707551232:12345-0@lo:502: 00000100:00100000:3.0:1783071361.923210:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+21:10000:x1869685707551232:12345-0@lo:502: Request processed in 258us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071361.923215:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1783071361.923248:0:10000:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0324f780 going to sleep for 11 seconds 00000100:00100000:3.0:1783071361.923260:0:10000:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0178f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:10000:1869685707551232:0@lo:502: 00000100:00100000:3.0:1783071361.923306:0:10000:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03333b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:10000:1869685707551488:0@lo:502: 00000100:00100000:3.0:1783071361.923339:0:10000:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071361.923489:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707551488 00000100:00100000:2.0:1783071361.923494:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707551488 00000100:00100000:2.0:1783071361.923522:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1783071361.923530:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+21:10000:x1869685707551488:12345-0@lo:502: 00000100:00100000:3.0:1783071361.923634:0:10000:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b05e0b600 going to sleep for 11 seconds 00000100:00100000:2.0:1783071361.923738:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+21:10000:x1869685707551488:12345-0@lo:502: Request processed in 209us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071361.923743:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1783071361.923865:0:10000:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03333b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:10000:1869685707551488:0@lo:502: 00000040:00080000:3.0:1783071361.923882:0:10000:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1783071361.923961:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1783071361.923986:0:6513:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783071361.924155:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b10966000/0x6b58994c2cbdbf60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbf67 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071361.924166:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8b10966000/0x6b58994c2cbdbf60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbf67 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783071361.924174:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783071361.924177:0:6513:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8f8b10f7e000 from 6 10000000:01000000:0.0:1783071361.924178:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783071361.924205:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460c00/0x6b58994c2cbdbf6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071361.924210:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460c00/0x6b58994c2cbdbf6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071361.924225:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460c00/0x6b58994c2cbdbf6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071361.924235:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37a62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707551616:0@lo:101: 00000100:00100000:0.0:1783071361.924260:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071361.924287:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b07c17c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783071361.924330:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707551616 00000100:00100000:3.0:1783071361.924335:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707551616 00000100:00100000:0.0:1783071361.924478:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1783071361.924486:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+21:6513:x1869685707551616:12345-0@lo:101: 00010000:00010000:0.0:1783071361.924497:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071361.924511:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b3c460000/0x6b58994c2cbdbf75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdbf6e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071361.924541:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b3c460000/0x6b58994c2cbdbf75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdbf6e expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071361.924553:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b3c460000/0x6b58994c2cbdbf75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbf6e expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071361.924563:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b3c460000, rc 0) 00000100:00100000:0.0:1783071361.924666:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+22:6513:x1869685707551616:12345-0@lo:101: Request processed in 181us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071361.924673:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1783071361.924747:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37a62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707551616:0@lo:101: 00010000:00010000:2.0:1783071361.924760:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460c00/0x6b58994c2cbdbf6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbf75 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071361.924768:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460c00/0x6b58994c2cbdbf6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdbf75 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071361.924950:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0178f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707551744:0@lo:256: 00000100:00100000:2.0:1783071361.924986:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071361.925015:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0324fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1783071361.925155:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707551744 00000100:00100000:0.0:1783071361.925160:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707551744 00000100:00100000:0.0:1783071361.925188:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1783071361.925195:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+22:6513:x1869685707551744:12345-0@lo:256: 20000000:01000000:0.0:1783071361.925212:0:6508:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783071361.925237:0:6508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783071361.925240:0:6508:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1783071361.925312:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+22:6513:x1869685707551744:12345-0@lo:256: Request processed in 117us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071361.925319:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1783071361.925748:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0178f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707551744:0@lo:256: 10000000:01000000:3.0:1783071361.925866:0:6513:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783071361.925876:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460c00/0x6b58994c2cbdbf6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbf75 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071361.925886:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460c00/0x6b58994c2cbdbf6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbf75 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783071361.925894:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1783071361.925896:0:6513:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1783071361.925898:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1783071361.925927:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8000/0x6b58994c2cbdbf7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071361.925935:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8000/0x6b58994c2cbdbf7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071361.925943:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8000/0x6b58994c2cbdbf7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071361.925957:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03333b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707551872:0@lo:101: 00000100:00100000:3.0:1783071361.925995:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071361.926173:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707551872 00000100:00100000:2.0:1783071361.926180:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707551872 00000100:00100000:2.0:1783071361.926221:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1783071361.926229:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+22:6513:x1869685707551872:12345-0@lo:101: 00010000:00010000:2.0:1783071361.926239:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071361.926254:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b10966800/0x6b58994c2cbdbf83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdbf7c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071361.926277:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b10966800/0x6b58994c2cbdbf83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdbf7c expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071361.926287:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b10966800/0x6b58994c2cbdbf83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbf7c expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071361.926297:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b10966800, rc 0) 00000100:00100000:2.0:1783071361.926328:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+23:6513:x1869685707551872:12345-0@lo:101: Request processed in 99us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071361.926334:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1783071361.926449:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b05e0b600 going to sleep for 11 seconds 00000100:00100000:3.0:1783071361.926463:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03333b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707551872:0@lo:101: 00010000:00010000:3.0:1783071361.926474:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8000/0x6b58994c2cbdbf7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbf83 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071361.926495:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8000/0x6b58994c2cbdbf7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdbf83 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071361.926646:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03333b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707552000:0@lo:501: 00000100:00100000:3.0:1783071361.926675:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071361.926696:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b05e0b600 going to sleep for 11 seconds 00000100:00100000:2.0:1783071361.927147:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707552000 00000100:00100000:2.0:1783071361.927153:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707552000 00000100:00100000:2.0:1783071361.927192:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1783071361.927199:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0d1cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+23:6513:x1869685707552000:12345-0@lo:501: 00000100:00100000:2.0:1783071361.927336:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0d1cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+23:6513:x1869685707552000:12345-0@lo:501: Request processed in 136us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071361.927342:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1783071361.927653:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03333b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707552000:0@lo:501: 00000100:00100000:0.0:1783071361.927691:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37a62680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707552128:0@lo:503: 00000100:00100000:0.0:1783071361.927734:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071361.927807:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b2fc82600 going to sleep for 11 seconds 00000100:00100000:3.0:1783071361.934252:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707552128 00000100:00100000:3.0:1783071361.934274:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707552128 00000100:00100000:3.0:1783071361.934387:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1783071361.934398:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b13f99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+23:6513:x1869685707552128:12345-0@lo:503: 00000100:00100000:3.0:1783071361.934575:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b13f99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+23:6513:x1869685707552128:12345-0@lo:503: Request processed in 179us (6840us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071361.934584:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1783071361.939652:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37a62680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707552128:0@lo:503: 40000000:02000000:0.0:1783071361.942428:0:6524:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:3.0:1783071361.944641:0:10002:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03331880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:10002:1869685707552256:0@lo:502: 00000100:00100000:3.0:1783071361.944744:0:10002:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071361.944800:0:10002:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b05e0bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783071361.944886:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707552256 00000100:00100000:2.0:1783071361.944895:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707552256 00000100:00100000:2.0:1783071361.944952:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1783071361.944965:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b02bf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+23:10002:x1869685707552256:12345-0@lo:502: 00000100:00100000:2.0:1783071361.945258:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b02bf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+23:10002:x1869685707552256:12345-0@lo:502: Request processed in 294us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071361.945266:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1783071361.945714:0:10002:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03331880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:10002:1869685707552256:0@lo:502: 00000020:01000000:3.0:1783071361.945748:0:10002:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783071361.945757:0:10002:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1783071361.945764:0:10002:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071361.945767:0:10002:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1783071361.945772:0:10002:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783071361.945776:0:10002:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.138@tcp to nid 0x20000c0a8cc8a (192.168.204.138@tcp) 00000020:01000000:3.0:1783071361.945802:0:10002:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1783071361.945805:0:10002:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783071361.945835:0:10002:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8f8a03364d40) 00000020:00000080:3.0:1783071361.945867:0:10002:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:3.0:1783071361.945875:0:10002:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1783071361.945973:0:10002:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1783071361.945980:0:10002:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:3.0:1783071361.945988:0:10002:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6b58994c2cbdbf91 00010000:00080000:3.0:1783071361.946047:0:10002:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f8b37a52800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.138@tcp at head 00010000:00010000:3.0:1783071361.946288:0:10002:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:3.0:1783071361.947234:0:10002:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1783071361.947252:0:10002:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1783071361.947464:0:10002:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783071361.947587:0:10002:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783071361.947735:0:10002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1783071361.947858:0:10002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1783071361.949308:0:10003:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783071361.949315:0:10003:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1783071361.951934:0:10002:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783071361.951956:0:10002:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1783071361.952397:0:10002:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1783071361.952434:0:10002:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6b58994c2cbdbf98 00000100:00080000:2.0:1783071361.952875:0:10002:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783071361.952884:0:10002:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8f8b37a52800 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:2.0:1783071361.952929:0:10002:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8a0178c000 x1869685707552384/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783071361.952967:0:10002:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1783071361.953130:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0178c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869685707552384:0@lo:8: 00000100:00100000:3.0:1783071361.953213:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071361.953278:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707552384 00000100:00100000:3.0:1783071361.953287:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707552384 00000100:00100000:3.0:1783071361.953324:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783071361.953332:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03331880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1869685707552384:12345-0@lo:8: 00010000:00080000:3.0:1783071361.953409:0:8429:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 263 last 0 00000020:00000080:3.0:1783071361.953446:0:8429:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6b58994c2cbdbf9f 00002000:00100000:3.0:1783071361.953461:0:8429:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8f8b37a53000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1783071361.953465:0:8429:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1783071361.953469:0:8429:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1783071361.953556:0:8429:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1783071361.953581:0:8429:0:(import.c:65:import_set_state_nolock()) ffff8f8b37a52000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783071361.953635:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03331880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1869685707552384:12345-0@lo:8: Request processed in 301us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071361.953647:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1783071361.953704:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a0178c000 x1869685707552384/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783071371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071361.953715:0:3644:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783071361.953724:0:3644:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1783071361.953732:0:3644:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1783071361.953737:0:3644:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1783071361.953740:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8f8b37a52800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1783071361.953749:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1783071361.953755:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0178c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869685707552384:0@lo:8: 00000004:00080000:3.0:1783071361.953778:0:10003:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1783071361.953827:0:10003:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 263742462862ns, next at 0ns, rc = 0 00080000:00080000:3.0:1783071361.953834:0:10003:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000020:01000000:2.0:1783071361.953881:0:10002:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783071361.953888:0:10002:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071361.953890:0:10002:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1783071361.953897:0:10002:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783071361.953901:0:10002:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071361.953903:0:10002:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783071361.953905:0:10002:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783071361.953907:0:10002:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1783071361.953935:0:10002:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0178c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:10002:1869685707552512:0@lo:502: 00000100:00100000:2.0:1783071361.953979:0:10002:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071361.954017:0:10002:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0324f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071361.954263:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707552512 00000100:00100000:3.0:1783071361.954268:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707552512 00000100:00100000:3.0:1783071361.954303:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1783071361.954310:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b06199c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+23:10002:x1869685707552512:12345-0@lo:502: 00000100:00100000:3.0:1783071361.954745:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b06199c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+23:10002:x1869685707552512:12345-0@lo:502: Request processed in 433us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071361.954752:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1783071361.954758:0:10002:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0178c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:10002:1869685707552512:0@lo:502: 00000020:01000000:2.0:1783071361.954781:0:10002:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783071361.954786:0:10002:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071361.956132:0:10002:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:2.0:1783071361.956147:0:10002:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:2.0:1783071361.957660:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:2.0:1783071361.957703:0:6513:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1783071361.957718:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8000/0x6b58994c2cbdbf7c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbf83 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071361.957733:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8000/0x6b58994c2cbdbf7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbf83 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071361.957745:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1783071361.957748:0:6513:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff8f8b06c74d40 from 1 10000000:01000000:2.0:1783071361.957751:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1783071361.958861:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b10967200/0x6b58994c2cbdbfa6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071361.958877:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8b10967200/0x6b58994c2cbdbfa6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071361.958891:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8b10967200/0x6b58994c2cbdbfa6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071361.958916:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0178c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707552640:0@lo:101: 00000100:00100000:2.0:1783071361.959002:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071361.959913:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0324f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783071361.959939:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707552640 00000100:00100000:2.0:1783071361.959946:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707552640 00000004:00080000:3.0:1783071361.959979:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:2.0:1783071361.960021:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1783071361.960031:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b06198c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+23:6513:x1869685707552640:12345-0@lo:101: 00010000:00010000:2.0:1783071361.960945:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071361.960967:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b10967000/0x6b58994c2cbdbfad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdbfa6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071361.960996:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b10967000/0x6b58994c2cbdbfad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdbfa6 expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071361.961008:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b10967000/0x6b58994c2cbdbfad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbfa6 expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071361.961017:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b10967000, rc 0) 00000100:00100000:2.0:1783071361.961475:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b06198c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+24:6513:x1869685707552640:12345-0@lo:101: Request processed in 1443us (2470us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071361.961483:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1783071361.962560:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0178c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707552640:0@lo:101: 00010000:00010000:3.0:1783071361.962589:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8b10967200/0x6b58994c2cbdbfa6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbfad expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071361.962602:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8b10967200/0x6b58994c2cbdbfa6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdbfad expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071361.962694:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03332a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707552768:0@lo:501: 00000100:00100000:3.0:1783071361.962743:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071361.962779:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b05e0b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783071361.962781:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707552768 00000100:00100000:2.0:1783071361.962799:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707552768 00000100:00100000:2.0:1783071361.962842:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1783071361.962852:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18686850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+24:6513:x1869685707552768:12345-0@lo:501: 00000100:00100000:2.0:1783071361.962944:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18686850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+24:6513:x1869685707552768:12345-0@lo:501: Request processed in 94us (201us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783071361.962953:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1783071361.963124:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03332a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707552768:0@lo:501: 10000000:01000000:3.0:1783071361.963151:0:6513:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1783071361.963158:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b10967200/0x6b58994c2cbdbfa6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbfad expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071361.963167:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8b10967200/0x6b58994c2cbdbfa6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbfad expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071361.967253:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37a63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8439:x1869685707551360:12345-0@lo:700: Request processed in 44505us (44586us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071361.967269:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1783071361.969081:0:8439:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b37a61500 x1869685707551360/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1783071377 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071361.969101:0:8439:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37a61500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8439:1869685707551360:0@lo:700: 40000000:02000000:2.0:1783071361.969115:0:8439:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000004:00080000:0.0:1783071361.969856:0:10004:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1783071361.969881:0:10004:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37a62a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10004:1869685707553024:0@lo:7: 00000100:00100000:0.0:1783071361.969952:0:10004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071361.969984:0:10004:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b2fc82240 going to sleep for 11 seconds 00000100:00100000:0.0:1783071361.970008:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707553024 00000100:00100000:0.0:1783071361.970015:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707553024 00000100:00100000:0.0:1783071361.974487:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783071361.974504:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37a60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:10004:x1869685707553024:12345-0@lo:7: 00000100:00100000:3.0:1783071361.976697:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783071361.976722:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37a63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707552896:0@lo:13: 00000100:00100000:3.0:1783071361.976793:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783071361.978568:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:0.0:1783071361.984570:0:8431:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1783071361.984580:0:8431:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1783071361.984673:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37a60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:10004:x1869685707553024:12345-0@lo:7: Request processed in 10170us (14716us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071361.984684:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783071361.984722:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707552896 00000100:00100000:0.0:1783071361.984735:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707552896 00000100:00100000:0.0:1783071361.984776:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783071361.984783:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03332a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1869685707552896:12345-0@lo:13: 00002000:00000024:0.0:1783071361.984811:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923808256 avail 3692285952 00000100:00100000:0.0:1783071361.984846:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03332a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1869685707552896:12345-0@lo:13: Request processed in 62us (8052us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071361.984853:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1783071361.984895:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b37a63100 x1869685707552896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071377 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071361.984917:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37a63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707552896:0@lo:13: 00010000:00080000:3.0:1783071361.985197:0:10004:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b37a62a00 x1869685707553024/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783071377 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071361.985208:0:10004:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37a62a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10004:1869685707553024:0@lo:7: 00000004:00080000:3.0:1783071361.985221:0:10004:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1783071361.985255:0:10004:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03330380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10004:1869685707553152:0@lo:5: 00000100:00100000:3.0:1783071361.985304:0:10004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071361.985339:0:10004:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b05e0b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783071361.985706:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707553152 00000100:00100000:0.0:1783071361.985710:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707553152 00000100:00100000:0.0:1783071361.985742:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783071361.985749:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03331500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:10004:x1869685707553152:12345-0@lo:5: 00002000:00080000:0.0:1783071361.985769:0:8429:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1783071361.985774:0:8429:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000001:00100000:2.0:1783071361.990518:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1783071361.990539:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1783071361.990758:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0178dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9999:x1869685707550720:12345-0@lo:700: Request processed in 68551us (73024us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071361.990774:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1783071361.990872:0:9999:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3b4dbb80 x1869685707550720/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1783071377 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071361.990892:0:9999:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3b4dbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9999:1869685707550720:0@lo:700: 00000004:00080000:2.0:1783071362.000013:0:9999:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1783071362.000039:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0178f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707553280:0@lo:13: 00000100:00100000:2.0:1783071362.000045:0:9999:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0178c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9999:1869685707553408:0@lo:7: 00000100:00100000:2.0:1783071362.000115:0:9999:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071362.000116:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071362.000180:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707553408 00000100:00100000:3.0:1783071362.000188:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707553408 00000100:00100000:3.0:1783071362.000243:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783071362.000253:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3b4dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9999:x1869685707553408:12345-0@lo:7: 00000100:00100000:0.0:1783071362.001448:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707553280 00000100:00100000:0.0:1783071362.001459:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707553280 00000100:00100000:0.0:1783071362.001508:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783071362.001519:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37a63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1869685707553280:12345-0@lo:13: 00002000:00000024:0.0:1783071362.001553:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923808256 avail 3692285952 00000100:00100000:0.0:1783071362.001627:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37a63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1869685707553280:12345-0@lo:13: Request processed in 111us (1514us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071362.001641:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1783071362.001693:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a0178f100 x1869685707553280/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071377 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071362.001717:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0178f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707553280:0@lo:13: 00000100:00100000:2.0:1783071362.003614:0:9999:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0324f780 going to sleep for 10 seconds 00000001:00080000:2.0:1783071362.007043:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:1.0:1783071362.007487:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03331500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:10004:x1869685707553152:12345-0@lo:5: Request processed in 21732us (22176us total) trans 4294967297 rc 0/0 00010000:00080000:2.0:1783071362.007505:0:10004:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a03330380 x1869685707553152/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783071377 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071362.007505:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783071362.007516:0:10004:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1783071362.007524:0:10004:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03330380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10004:1869685707553152:0@lo:5: 00000004:00080000:2.0:1783071362.007539:0:10004:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1783071362.007593:0:10004:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b08871880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10004:1869685707553536:0@lo:700: 00000100:00100000:2.0:1783071362.007647:0:10004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071362.007694:0:10004:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0324f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783071362.007744:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707553536 00000100:00100000:1.0:1783071362.007750:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707553536 00000100:00100000:1.0:1783071362.007818:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783071362.007827:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c78dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:10004:x1869685707553536:12345-0@lo:700: 00002000:00080000:3.0:1783071362.010518:0:8432:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1783071362.010529:0:8432:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1783071362.010624:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3b4dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9999:x1869685707553408:12345-0@lo:7: Request processed in 10367us (10506us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071362.010636:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1783071362.010852:0:9999:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a0178c000 x1869685707553408/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783071377 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071362.010868:0:9999:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0178c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9999:1869685707553408:0@lo:7: 00000004:00080000:2.0:1783071362.010883:0:9999:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1783071362.010930:0:9999:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9999:1869685707553664:0@lo:5: 00000100:00100000:2.0:1783071362.010968:0:9999:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071362.010994:0:9999:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0324f780 going to sleep for 11 seconds 00000100:00100000:1.0:1783071362.011742:0:8910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707553664 00000100:00100000:1.0:1783071362.011774:0:8910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707553664 00000100:00100000:1.0:1783071362.011956:0:8910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783071362.011970:0:8910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c78f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9999:x1869685707553664:12345-0@lo:5: 00002000:00080000:1.0:1783071362.012323:0:8910:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1783071362.012469:0:8910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c78f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9999:x1869685707553664:12345-0@lo:5: Request processed in 502us (1500us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071362.012477:0:8910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1783071362.012518:0:9999:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c78c700 x1869685707553664/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783071378 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071362.012532:0:9999:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9999:1869685707553664:0@lo:5: 00000004:00080000:1.0:1783071362.012555:0:9999:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1783071362.012721:0:9999:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c79e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9999:1869685707553792:0@lo:5: 00000100:00100000:1.0:1783071362.013969:0:9999:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071362.014080:0:9999:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b34e1cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1783071362.014436:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707553792 00000100:00100000:2.0:1783071362.014455:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707553792 00000100:00100000:2.0:1783071362.014506:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783071362.014516:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c79f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9999:x1869685707553792:12345-0@lo:5: 00002000:00080000:2.0:1783071362.014561:0:8429:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:2.0:1783071362.016304:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c79f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:9999:x1869685707553792:12345-0@lo:5: Request processed in 1782us (2331us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1783071362.016317:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1783071362.016883:0:9999:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c79e680 x1869685707553792/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783071378 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071362.016902:0:9999:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c79e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9999:1869685707553792:0@lo:5: 00000004:00080000:1.0:1783071362.016917:0:9999:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1783071362.016961:0:9999:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c79c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9999:1869685707553920:0@lo:900: 00000100:00100000:2.0:1783071362.019544:0:9999:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071362.019588:0:9999:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b34e1cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1783071362.019619:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707553920 00000100:00100000:2.0:1783071362.019627:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707553920 00000100:00100000:2.0:1783071362.019681:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783071362.019690:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c78ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9999:x1869685707553920:12345-0@lo:900: 00000100:00100000:2.0:1783071362.019762:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c78ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9999:x1869685707553920:12345-0@lo:900: Request processed in 72us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071362.019771:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1783071362.020652:0:9999:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c79c000 x1869685707553920/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783071378 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071362.020667:0:9999:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c79c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9999:1869685707553920:0@lo:900: 00000001:00080000:2.0:1783071362.020807:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:1.0:1783071362.021481:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c78dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:10004:x1869685707553536:12345-0@lo:700: Request processed in 13651us (13830us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071362.021493:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1783071362.021538:0:10004:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b08871880 x1869685707553536/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1783071378 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071362.021550:0:10004:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b08871880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10004:1869685707553536:0@lo:700: 00000004:02000040:2.0:1783071362.023869:0:10004:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:2.0:1783071362.030859:0:10004:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10004:1869685707554048:0@lo:5: 00000100:00100000:2.0:1783071362.030939:0:10004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071362.030975:0:10004:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0324f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783071362.033460:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707554048 00000100:00100000:0.0:1783071362.033478:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707554048 00000100:00100000:0.0:1783071362.033567:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783071362.033583:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c78e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:10004:x1869685707554048:12345-0@lo:5: 00002000:00080000:1.0:1783071362.040904:0:8431:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1783071362.040927:0:8431:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:1.0:1783071362.043904:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c78e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:10004:x1869685707554048:12345-0@lo:5: Request processed in 10318us (12959us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1783071362.043917:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1783071362.044010:0:10004:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c78f100 x1869685707554048/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783071378 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071362.044028:0:10004:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10004:1869685707554048:0@lo:5: 00000004:00080000:3.0:1783071362.044042:0:10004:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000020:00000004:0.0:1783071362.292352:0:10033:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783071362.292828:0:10033:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783071362.307107:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071362.371832:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03331f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707554176:0@lo:13: 00000100:00100000:3.0:1783071362.371897:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071362.372013:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707554176 00000100:00100000:0.0:1783071362.372021:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707554176 00000100:00100000:0.0:1783071362.372062:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783071362.372070:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03332d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707554176:12345-0@lo:13: 00002000:00000024:0.0:1783071362.372098:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783071362.372140:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03332d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707554176:12345-0@lo:13: Request processed in 71us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071362.372147:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1783071362.372233:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a03331f80 x1869685707554176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071378 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071362.372250:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03331f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707554176:0@lo:13: 00000100:00100000:0.0:1783071362.372716:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707554304:0@lo:13: 00000100:00100000:0.0:1783071362.372753:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071362.372987:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707554304 00000100:00100000:3.0:1783071362.372992:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707554304 00000100:00100000:3.0:1783071362.373027:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783071362.373034:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37a62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707554304:12345-0@lo:13: 00002000:00000024:3.0:1783071362.373047:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783071362.373147:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37a62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707554304:12345-0@lo:13: Request processed in 113us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071362.373153:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1783071362.373198:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c78f480 x1869685707554304/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071378 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071362.373211:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707554304:0@lo:13: 00000020:00000004:3.0:1783071363.022155:0:10081:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783071363.022164:0:10081:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:3.0:1783071363.331932:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071363.394917:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03331f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707554432:0@lo:41: 00000100:00100000:0.0:1783071363.395011:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071363.395153:0:9413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707554432 00000100:00100000:3.0:1783071363.395161:0:9413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707554432 00000100:00100000:3.0:1783071363.395216:0:9413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783071363.395226:0:9413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37a61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707554432:12345-0@lo:41: 00000004:00000024:3.0:1783071363.395285:0:9413:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783071363.395387:0:9413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37a61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707554432:12345-0@lo:41: Request processed in 162us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071363.395394:0:9413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783071363.395607:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03331f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707554432:0@lo:41: 00000100:00100000:2.0:1783071363.503560:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071363.503707:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692825728 00000100:00100000:0.0:1783071363.503748:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692825728 00000100:00100000:0.0:1783071363.503954:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 179 00000100:00100000:0.0:1783071363.503967:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18684050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2402:x1869685692825728:12345-192.168.204.38@tcp:250: 00010000:00080000:0.0:1783071363.504102:0:6510:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 5e4e7df8-beb0-40df-a2a1-9decaa005633@192.168.204.38@tcp t0 exp 0000000000000000 cur 265 last 0 00000020:00000080:0.0:1783071363.504159:0:6510:0:(genops.c:1406:class_connect()) connect: client 5e4e7df8-beb0-40df-a2a1-9decaa005633, cookie 0x6b58994c2cbdbfb4 00000100:00080000:0.0:1783071363.504360:0:6510:0:(import.c:65:import_set_state_nolock()) ffff8f8a02c71800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783071363.504515:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18684050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e4e7df8-beb0-40df-a2a1-9decaa005633+5:2402:x1869685692825728:12345-192.168.204.38@tcp:250: Request processed in 548us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071363.504523:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 179 00000100:00100000:2.0:1783071363.521770:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071363.521862:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692825856 00000100:00100000:3.0:1783071363.521873:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692825856 00000100:00100000:3.0:1783071363.521934:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 180 00000100:00100000:3.0:1783071363.521944:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18684450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e4e7df8-beb0-40df-a2a1-9decaa005633+5:6158:x1869685692825856:12345-192.168.204.38@tcp:101: 00010000:00010000:3.0:1783071363.521962:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071363.521994:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b014b8800/0x6b58994c2cbdbfbb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98c22 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071363.522024:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b014b8800/0x6b58994c2cbdbfbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98c22 expref: 6 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071363.522036:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b014b8800/0x6b58994c2cbdbfbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98c22 expref: 6 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071363.522045:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b014b8800, rc 0) 00000100:00100000:3.0:1783071363.522109:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18684450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e4e7df8-beb0-40df-a2a1-9decaa005633+6:6158:x1869685692825856:12345-192.168.204.38@tcp:101: Request processed in 166us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071363.522117:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 180 00000100:00100000:3.0:1783071363.530739:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071363.531933:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692825984 00000100:00100000:2.0:1783071363.531953:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692825984 00000100:00100000:2.0:1783071363.532114:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 181 00000100:00100000:2.0:1783071363.532127:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18687050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e4e7df8-beb0-40df-a2a1-9decaa005633+6:6158:x1869685692825984:12345-192.168.204.38@tcp:501: 00000100:00100000:2.0:1783071363.532303:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18687050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e4e7df8-beb0-40df-a2a1-9decaa005633+6:6158:x1869685692825984:12345-192.168.204.38@tcp:501: Request processed in 178us (1579us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783071363.532311:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 181 00000100:00100000:0.0:1783071363.536894:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071363.537029:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692826112 00000100:00100000:3.0:1783071363.537053:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692826112 00000100:00100000:3.0:1783071363.537102:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 182 00000100:00100000:3.0:1783071363.537111:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18686450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e4e7df8-beb0-40df-a2a1-9decaa005633+6:6158:x1869685692826112:12345-192.168.204.38@tcp:101: 00010000:00010000:3.0:1783071363.537130:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071363.537149:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b014b9a00/0x6b58994c2cbdbfc2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98c29 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071363.537179:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b014b9a00/0x6b58994c2cbdbfc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98c29 expref: 7 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071363.537190:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b014b9a00/0x6b58994c2cbdbfc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98c29 expref: 7 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071363.537200:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b014b9a00, rc 0) 00000100:00100000:3.0:1783071363.537268:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18686450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e4e7df8-beb0-40df-a2a1-9decaa005633+7:6158:x1869685692826112:12345-192.168.204.38@tcp:101: Request processed in 157us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071363.537276:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 182 00000100:00100000:0.0:1783071363.540914:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071363.541031:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692826240 00000100:00100000:3.0:1783071363.541044:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692826240 00000100:00100000:3.0:1783071363.541112:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 183 00000100:00100000:3.0:1783071363.541124:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18685c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e4e7df8-beb0-40df-a2a1-9decaa005633+7:6158:x1869685692826240:12345-192.168.204.38@tcp:501: 00000100:00100000:3.0:1783071363.541410:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18685c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e4e7df8-beb0-40df-a2a1-9decaa005633+8:6158:x1869685692826240:12345-192.168.204.38@tcp:501: Request processed in 286us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071363.541419:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 183 00000100:00100000:1.0:1783071363.544481:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071363.544626:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692826368 00000100:00100000:0.0:1783071363.544639:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692826368 00000100:00100000:0.0:1783071363.544712:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 184 00000100:00100000:0.0:1783071363.544723:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18686050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e4e7df8-beb0-40df-a2a1-9decaa005633+8:6158:x1869685692826368:12345-192.168.204.38@tcp:503: 00000100:00100000:0.0:1783071363.544970:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18686050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e4e7df8-beb0-40df-a2a1-9decaa005633+8:6158:x1869685692826368:12345-192.168.204.38@tcp:503: Request processed in 239us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071363.544981:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 184 00000100:00100000:0.0:1783071363.547838:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071363.549461:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692826496 00000100:00100000:3.0:1783071363.549982:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692826496 00000100:00100000:2.0:1783071363.550756:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 185 00000100:00100000:2.0:1783071363.550785:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18687c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e4e7df8-beb0-40df-a2a1-9decaa005633+8:6176:x1869685692826496:12345-192.168.204.38@tcp:502: 00000100:00100000:2.0:1783071363.551692:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18687c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e4e7df8-beb0-40df-a2a1-9decaa005633+8:6176:x1869685692826496:12345-192.168.204.38@tcp:502: Request processed in 916us (3864us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071363.551705:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 185 00000100:00100000:2.0:1783071363.578720:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071363.580301:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692826624 00000100:00100000:0.0:1783071363.580622:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692826624 00000100:00100000:0.0:1783071363.580912:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 186 00000100:00100000:0.0:1783071363.580929:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18685450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e4e7df8-beb0-40df-a2a1-9decaa005633+8:6176:x1869685692826624:12345-192.168.204.38@tcp:502: 00000100:00100000:0.0:1783071363.582480:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18685450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e4e7df8-beb0-40df-a2a1-9decaa005633+8:6176:x1869685692826624:12345-192.168.204.38@tcp:502: Request processed in 1540us (4209us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071363.582515:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 186 00000100:00100000:1.0:1783071363.588830:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071363.589181:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692826752 00000100:00100000:2.0:1783071363.589197:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692826752 00000100:00100000:2.0:1783071363.589273:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 187 00000100:00100000:2.0:1783071363.589286:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18687450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e4e7df8-beb0-40df-a2a1-9decaa005633+8:6158:x1869685692826752:12345-192.168.204.38@tcp:101: 00010000:00010000:2.0:1783071363.589322:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071363.589354:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b10966a00/0x6b58994c2cbdbfc9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98c5a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071363.589891:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b10966a00/0x6b58994c2cbdbfc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98c5a expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071363.589906:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b10966a00/0x6b58994c2cbdbfc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98c5a expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071363.589918:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b10966a00, rc 0) 00000100:00100000:2.0:1783071363.590278:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18687450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e4e7df8-beb0-40df-a2a1-9decaa005633+9:6158:x1869685692826752:12345-192.168.204.38@tcp:101: Request processed in 993us (1462us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071363.590287:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 187 00000100:00100000:2.0:1783071363.598218:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071363.598886:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692826880 00000100:00100000:0.0:1783071363.598899:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692826880 00000100:00100000:0.0:1783071363.599025:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 188 00000100:00100000:0.0:1783071363.599037:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18687850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e4e7df8-beb0-40df-a2a1-9decaa005633+9:6158:x1869685692826880:12345-192.168.204.38@tcp:256: 20000000:01000000:0.0:1783071363.599066:0:6508:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1783071363.599108:0:6508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1783071363.599113:0:6508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1783071363.599116:0:6508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1783071363.599119:0:6508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1783071363.599121:0:6508:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:3.0:1783071363.604088:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18687850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e4e7df8-beb0-40df-a2a1-9decaa005633+9:6158:x1869685692826880:12345-192.168.204.38@tcp:256: Request processed in 5042us (5871us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071363.604110:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 188 00000100:00100000:1.0:1783071363.614853:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071363.615164:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692827008 00000100:00100000:2.0:1783071363.615175:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692827008 00000100:00100000:2.0:1783071363.616599:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 189 00000100:00100000:2.0:1783071363.616622:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18685850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e4e7df8-beb0-40df-a2a1-9decaa005633+9:6158:x1869685692827008:12345-192.168.204.38@tcp:101: 00010000:00010000:2.0:1783071363.616642:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071363.616664:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b10967a00/0x6b58994c2cbdbfd0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98c61 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071363.616695:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b10967a00/0x6b58994c2cbdbfd0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98c61 expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071363.616707:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b10967a00/0x6b58994c2cbdbfd0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98c61 expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071363.616717:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b10967a00, rc 0) 00000100:00100000:2.0:1783071363.617574:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18685850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e4e7df8-beb0-40df-a2a1-9decaa005633+10:6158:x1869685692827008:12345-192.168.204.38@tcp:101: Request processed in 959us (2730us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071363.617597:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 189 00000100:00100000:2.0:1783071363.621186:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071363.621270:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692827136 00000100:00100000:3.0:1783071363.621281:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692827136 00000100:00100000:3.0:1783071363.621625:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 190 00000100:00100000:3.0:1783071363.621639:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18684c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e4e7df8-beb0-40df-a2a1-9decaa005633+10:6158:x1869685692827136:12345-192.168.204.38@tcp:501: 00000100:00100000:3.0:1783071363.622210:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18684c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e4e7df8-beb0-40df-a2a1-9decaa005633+10:6158:x1869685692827136:12345-192.168.204.38@tcp:501: Request processed in 571us (1031us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071363.622221:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 190 00000100:00100000:0.0:1783071363.628256:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071363.628467:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692827264 00000100:00100000:2.0:1783071363.628479:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692827264 00000100:00100000:2.0:1783071363.628543:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 191 00000100:00100000:2.0:1783071363.628556:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18684850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e4e7df8-beb0-40df-a2a1-9decaa005633+10:6158:x1869685692827264:12345-192.168.204.38@tcp:503: 00000100:00100000:2.0:1783071363.628724:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18684850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e4e7df8-beb0-40df-a2a1-9decaa005633+10:6158:x1869685692827264:12345-192.168.204.38@tcp:503: Request processed in 172us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071363.628731:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 191 00000100:00100000:1.0:1783071363.632527:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071363.633083:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692827392 00000100:00100000:2.0:1783071363.633094:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692827392 00000100:00100000:2.0:1783071363.633160:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 192 00000100:00100000:2.0:1783071363.633171:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07695850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e4e7df8-beb0-40df-a2a1-9decaa005633+10:6181:x1869685692827392:12345-192.168.204.38@tcp:502: 00000100:00100000:2.0:1783071363.633702:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07695850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e4e7df8-beb0-40df-a2a1-9decaa005633+10:6181:x1869685692827392:12345-192.168.204.38@tcp:502: Request processed in 530us (1184us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071363.633710:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 192 00000100:00100000:3.0:1783071363.636099:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071363.636678:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692827520 00000100:00100000:2.0:1783071363.636689:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692827520 00000100:00100000:2.0:1783071363.636746:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 193 00000100:00100000:2.0:1783071363.636758:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07697850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e4e7df8-beb0-40df-a2a1-9decaa005633+10:6181:x1869685692827520:12345-192.168.204.38@tcp:502: 00000100:00100000:2.0:1783071363.637013:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07697850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e4e7df8-beb0-40df-a2a1-9decaa005633+10:6181:x1869685692827520:12345-192.168.204.38@tcp:502: Request processed in 257us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071363.637022:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 193 00000100:00100000:0.0:1783071363.640800:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071363.642563:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692827648 00000100:00100000:3.0:1783071363.642579:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692827648 00000100:00100000:3.0:1783071363.642637:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 7 00000100:00100000:3.0:1783071363.642646:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37a62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2402:x1869685692827648:12345-192.168.204.38@tcp:38: 00010000:00080000:3.0:1783071363.642677:0:6518:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from bf7532e4-6153-424a-9f4e-84941256b41f@192.168.204.38@tcp t0 exp 0000000000000000 cur 265 last 0 00000020:00000080:3.0:1783071363.642734:0:6518:0:(genops.c:1406:class_connect()) connect: client bf7532e4-6153-424a-9f4e-84941256b41f, cookie 0x6b58994c2cbdbfd7 00000004:00100000:3.0:1783071363.642761:0:6518:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1783071363.643041:0:6518:0:(import.c:65:import_set_state_nolock()) ffff8f8a03244000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783071363.643128:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37a62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+6:2402:x1869685692827648:12345-192.168.204.38@tcp:38: Request processed in 480us (2338us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071363.643136:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 7 00000100:00100000:2.0:1783071363.643628:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071363.643702:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692827904 00000100:00100000:0.0:1783071363.643708:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692827904 00000100:00100000:0.0:1783071363.643744:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 8 00000100:00100000:0.0:1783071363.643750:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c78c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2402:x1869685692827904:12345-192.168.204.38@tcp:38: 00010000:00080000:0.0:1783071363.643772:0:6517:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from bf7532e4-6153-424a-9f4e-84941256b41f@192.168.204.38@tcp t0 exp 0000000000000000 cur 265 last 0 00000020:00000080:0.0:1783071363.643812:0:6517:0:(genops.c:1406:class_connect()) connect: client bf7532e4-6153-424a-9f4e-84941256b41f, cookie 0x6b58994c2cbdbfde 00000004:00100000:0.0:1783071363.643829:0:6517:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1783071363.644005:0:6517:0:(import.c:65:import_set_state_nolock()) ffff8f8a02c74800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783071363.644077:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c78c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+6:2402:x1869685692827904:12345-192.168.204.38@tcp:38: Request processed in 326us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071363.644094:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 8 00010000:00010000:3.0:1783071364.356057:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071364.653356:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071364.653481:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071364.653618:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692828032 00000100:00100000:3.0:1783071364.653629:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692828032 00000100:00100000:3.0:1783071364.653711:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692827776 00000100:00100000:3.0:1783071364.653715:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692827776 00000100:00100000:3.0:1783071364.653738:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9 00000100:00100000:3.0:1783071364.653757:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c78ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+6:0:x1869685692828032:12345-192.168.204.38@tcp:41: 00000004:00000024:3.0:1783071364.653798:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783071364.653860:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c78ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+6:0:x1869685692828032:12345-192.168.204.38@tcp:41: Request processed in 105us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071364.653867:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9 00000100:00100000:3.0:1783071364.653884:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 10 00000100:00100000:3.0:1783071364.653891:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c78d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+6:0:x1869685692827776:12345-192.168.204.38@tcp:41: 00000004:00000024:3.0:1783071364.653922:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1783071364.653949:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c78d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+6:0:x1869685692827776:12345-192.168.204.38@tcp:41: Request processed in 58us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071364.653955:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 10 00000100:00100000:0.0:1783071364.656020:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00080000:1.0:1783071364.656095:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783071364.656101:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783071364.656330:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692828160 00000100:00100000:3.0:1783071364.656338:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692828160 00000100:00100000:3.0:1783071364.656419:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11 00000100:00100000:3.0:1783071364.656429:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37a62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+6:6158:x1869685692828160:12345-192.168.204.38@tcp:41: 00000004:00000024:3.0:1783071364.656458:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1783071364.656527:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37a62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+6:6158:x1869685692828160:12345-192.168.204.38@tcp:41: Request processed in 99us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071364.656535:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11 00000100:00100000:1.0:1783071364.660548:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071364.660683:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692828288 00000100:00100000:3.0:1783071364.660692:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692828288 00000100:00100000:3.0:1783071364.660749:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 12 00000100:00100000:3.0:1783071364.660758:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c79ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+6:6158:x1869685692828288:12345-192.168.204.38@tcp:40: 00000100:00100000:3.0:1783071364.660861:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c79ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+6:6158:x1869685692828288:12345-192.168.204.38@tcp:40: Request processed in 103us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071364.660885:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 12 00000100:00100000:1.0:1783071364.666758:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071364.666807:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071364.666840:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071364.666995:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692828672 00000100:00100000:2.0:1783071364.667005:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692828672 00000100:00100000:0.0:1783071364.667065:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692828416 00000100:00100000:2.0:1783071364.667082:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 4 00000100:00100000:0.0:1783071364.667086:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692828416 00000100:00100000:2.0:1783071364.667097:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c79d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:bf7532e4-6153-424a-9f4e-84941256b41f+6:6158:x1869685692828672:12345-192.168.204.38@tcp:900: 00000100:00100000:0.0:1783071364.667121:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 16 00000100:00100000:0.0:1783071364.667128:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c79e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2402:x1869685692828416:12345-192.168.204.38@tcp:8: 00010000:00080000:0.0:1783071364.667156:0:8432:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from bf7532e4-6153-424a-9f4e-84941256b41f@192.168.204.38@tcp t0 exp 0000000000000000 cur 266 last 0 00000100:00100000:2.0:1783071364.667182:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c79d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:bf7532e4-6153-424a-9f4e-84941256b41f+6:6158:x1869685692828672:12345-192.168.204.38@tcp:900: Request processed in 88us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071364.667191:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 4 00000020:00000080:0.0:1783071364.667241:0:8432:0:(genops.c:1406:class_connect()) connect: client bf7532e4-6153-424a-9f4e-84941256b41f, cookie 0x6b58994c2cbdbfe5 00002000:00100000:0.0:1783071364.667264:0:8432:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli bf7532e4-6153-424a-9f4e-84941256b41f/ffff8f8a02c76800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783071364.667284:0:8432:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783071364.667530:0:8432:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1783071364.667561:0:8432:0:(import.c:65:import_set_state_nolock()) ffff8f8a02c77000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783071364.667598:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c79e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf7532e4-6153-424a-9f4e-84941256b41f+6:2402:x1869685692828416:12345-192.168.204.38@tcp:8: Request processed in 469us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071364.667605:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 16 00000100:00100000:3.0:1783071364.667782:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692828800 00000100:00100000:3.0:1783071364.667788:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692828800 00000100:00100000:3.0:1783071364.667829:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 194 00000100:00100000:3.0:1783071364.667837:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07697450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e4e7df8-beb0-40df-a2a1-9decaa005633+10:2406:x1869685692828800:12345-192.168.204.38@tcp:400: 00000100:00100000:3.0:1783071364.667870:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07697450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e4e7df8-beb0-40df-a2a1-9decaa005633+10:2406:x1869685692828800:12345-192.168.204.38@tcp:400: Request processed in 34us (1062us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071364.667877:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 194 00000100:00100000:1.0:1783071364.668012:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071364.668444:0:8910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692828544 00000100:00100000:3.0:1783071364.668449:0:8910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692828544 00000100:00100000:3.0:1783071364.668479:0:8910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 17 00000100:00100000:3.0:1783071364.668485:0:8910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c79fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2402:x1869685692828544:12345-192.168.204.38@tcp:8: 00010000:00080000:3.0:1783071364.668509:0:8910:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from bf7532e4-6153-424a-9f4e-84941256b41f@192.168.204.38@tcp t0 exp 0000000000000000 cur 266 last 0 00000020:00000080:3.0:1783071364.668530:0:8910:0:(genops.c:1406:class_connect()) connect: client bf7532e4-6153-424a-9f4e-84941256b41f, cookie 0x6b58994c2cbdbfec 00002000:00100000:3.0:1783071364.668538:0:8910:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli bf7532e4-6153-424a-9f4e-84941256b41f/ffff8f8a03245800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783071364.668551:0:8910:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783071364.668681:0:8910:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1783071364.668712:0:8910:0:(import.c:65:import_set_state_nolock()) ffff8f8a03247800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783071364.668763:0:8910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c79fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf7532e4-6153-424a-9f4e-84941256b41f+6:2402:x1869685692828544:12345-192.168.204.38@tcp:8: Request processed in 275us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071364.668771:0:8910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 17 00000100:00100000:1.0:1783071364.674926:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071364.675057:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692828928 00000100:00100000:0.0:1783071364.675069:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692828928 00000100:00100000:0.0:1783071364.675128:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 0 00000100:00100000:0.0:1783071364.675139:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c79d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+6:6158:x1869685692828928:12345-192.168.204.38@tcp:33: 00000004:00080000:0.0:1783071364.704089:0:6519:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 28860us 00000004:00200000:1.0:1783071364.760684:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1783071364.760961:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c79d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+6:6158:x1869685692828928:12345-192.168.204.38@tcp:33: Request processed in 85813us (86033us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071364.760975:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 0 00000100:00100000:2.0:1783071364.930703:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071364.930883:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692829056 00000100:00100000:0.0:1783071364.930894:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692829056 00000100:00100000:0.0:1783071364.930954:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 13 00000100:00100000:0.0:1783071364.930965:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c78e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+6:6199:x1869685692829056:12345-192.168.204.38@tcp:101: 00010000:00010000:0.0:1783071364.930989:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071364.931880:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b10967800/0x6b58994c2cbdbff3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98c92 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071364.931948:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b10966200/0x6b58994c2cbdbffa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071364.931960:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b10966200/0x6b58994c2cbdbffa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071364.931970:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b10966200/0x6b58994c2cbdbffa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071364.932012:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783071364.932015:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783071364.932028:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b10966200/0x6b58994c2cbdbffa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071364.932112:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b10967800/0x6b58994c2cbdbff3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98c92 expref: 8 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071364.932133:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b10966200/0x6b58994c2cbdbffa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98c92 expref: 7 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071364.932153:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8b13c4e000) 00010000:00010000:2.0:1783071364.932156:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783071364.932159:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b10966200, rc 0) 00000100:00100000:2.0:1783071364.932336:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c78e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+7:6199:x1869685692829056:12345-192.168.204.38@tcp:101: Request processed in 1371us (1642us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071364.932344:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 13 00010000:00010000:3.0:1783071365.379485:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071366.402657:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071366.978621:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783071366.978655:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03331c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707554560:0@lo:41: 00000100:00100000:0.0:1783071366.978728:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071366.978848:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707554560 00000100:00100000:3.0:1783071366.978857:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707554560 00000100:00100000:3.0:1783071366.978930:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1783071366.978941:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0178c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707554560:12345-0@lo:41: 00000004:00000024:3.0:1783071366.978977:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1783071366.979028:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0178c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707554560:12345-0@lo:41: Request processed in 88us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071366.979044:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783071366.979174:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03331c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707554560:0@lo:41: 00000100:00100000:0.0:1783071366.981027:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869685707554816:0@lo:400: 00000100:00100000:0.0:1783071366.981109:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071366.981137:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1869685707555328:0@lo:400: 00000100:00100000:0.0:1783071366.981156:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071366.981168:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b08871880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1869685707555840:0@lo:400: 00000100:00100000:0.0:1783071366.981183:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071366.981201:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1783071366.981205:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:feaa1501-b927-4e07-baad-3200e92d7497:3646:1869685707554688:0@lo:400: 00000100:00100000:0.0:1783071366.981228:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071366.981248:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1869685707555200:0@lo:400: 00000100:00100000:0.0:1783071366.981265:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071366.981272:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1869685707555712:0@lo:400: 00000100:00100000:0.0:1783071366.981304:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071366.981329:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707554816 00000100:00100000:0.0:1783071366.981336:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707554816 00000100:00100000:0.0:1783071366.981415:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707555328 00000100:00100000:0.0:1783071366.981418:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707555328 00000100:00100000:0.0:1783071366.981438:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707555840 00000100:00100000:0.0:1783071366.981440:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707555840 00000100:00100000:0.0:1783071366.981451:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707555200 00000100:00100000:0.0:1783071366.981453:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707555200 00000100:00100000:0.0:1783071366.981463:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707555712 00000100:00100000:0.0:1783071366.981465:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707555712 00000100:00100000:0.0:1783071366.981492:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783071366.981501:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0178f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869685707554816:12345-0@lo:400: 00000100:00100000:0.0:1783071366.981567:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0178f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869685707554816:12345-0@lo:400: Request processed in 67us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071366.981574:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783071366.981593:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783071366.981600:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b2fcb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869685707555328:12345-0@lo:400: 00000100:00100000:0.0:1783071366.981626:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b2fcb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869685707555328:12345-0@lo:400: Request processed in 27us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071366.981631:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783071366.981642:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783071366.981646:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b2fcb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869685707555840:12345-0@lo:400: 00000100:00100000:0.0:1783071366.981686:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b2fcb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869685707555840:12345-0@lo:400: Request processed in 39us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071366.981692:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783071366.981703:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783071366.981709:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b2fcb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869685707555200:12345-0@lo:400: 00000100:00100000:0.0:1783071366.981733:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b2fcb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869685707555200:12345-0@lo:400: Request processed in 25us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071366.981739:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783071366.981749:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783071366.981756:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b2fcb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869685707555712:12345-0@lo:400: 00000100:00100000:0.0:1783071366.981782:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b2fcb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869685707555712:12345-0@lo:400: Request processed in 26us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071366.981787:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783071366.981840:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707555072:0@lo:400: 00000100:00100000:0.0:1783071366.981869:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071366.981896:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707555584:0@lo:400: 00000100:00100000:0.0:1783071366.981941:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071366.981966:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c5af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707556096:0@lo:400: 00000100:00100000:0.0:1783071366.981988:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071366.982006:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1783071366.982012:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869685707554944:0@lo:400: 00000100:00100000:0.0:1783071366.982032:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071366.982049:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707555456:0@lo:400: 00000100:00100000:0.0:1783071366.982068:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071366.982083:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c5ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707555968:0@lo:400: 00000100:00100000:0.0:1783071366.982101:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071366.982124:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707555072 00000100:00100000:0.0:1783071366.982128:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707555072 00000100:00100000:0.0:1783071366.982153:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783071366.982158:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b2fcb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707555072:12345-0@lo:400: 00000100:00100000:0.0:1783071366.982193:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b2fcb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707555072:12345-0@lo:400: Request processed in 34us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071366.982199:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783071366.982217:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707555584 00000100:00100000:0.0:1783071366.982220:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707555584 00000100:00100000:0.0:1783071366.982239:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707556096 00000100:00100000:0.0:1783071366.982241:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707556096 00000100:00100000:0.0:1783071366.982252:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707555456 00000100:00100000:0.0:1783071366.982254:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707555456 00000100:00100000:0.0:1783071366.982264:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707555968 00000100:00100000:0.0:1783071366.982266:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707555968 00000100:00100000:0.0:1783071366.982292:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783071366.982299:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707555584:12345-0@lo:400: 00000100:00100000:0.0:1783071366.982340:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707555584:12345-0@lo:400: Request processed in 42us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071366.982346:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783071366.982358:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783071366.982386:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1869685707556096:12345-0@lo:400: 00000100:00100000:0.0:1783071366.982414:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1869685707556096:12345-0@lo:400: Request processed in 51us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071366.982421:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783071366.982432:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783071366.982437:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707555456:12345-0@lo:400: 00000100:00100000:0.0:1783071366.982461:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707555456:12345-0@lo:400: Request processed in 24us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071366.982467:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783071366.982477:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783071366.982483:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707555968:12345-0@lo:400: 00000100:00100000:0.0:1783071366.982507:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707555968:12345-0@lo:400: Request processed in 24us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071366.982512:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1783071366.982553:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c78ed80 x1869685707555456/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071366.982567:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707555456:0@lo:400: 00010000:00080000:0.0:1783071366.982578:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c5ae680 x1869685707555968/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071366.982585:0:3648:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1783071366.982599:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c5ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707555968:0@lo:400: 00000100:00100000:0.0:1783071366.982617:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707555072:0@lo:400: 00010000:00080000:0.0:1783071366.982626:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c78f480 x1869685707555584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071366.982635:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707555584:0@lo:400: 00010000:00080000:0.0:1783071366.982644:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c5af480 x1869685707556096/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071366.982652:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c5af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707556096:0@lo:400: 00000100:00100000:0.0:1783071366.982687:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1869685707555200:0@lo:400: 00000100:00100000:0.0:1783071366.982697:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1869685707555712:0@lo:400: 00000100:00100000:0.0:1783071366.982708:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869685707554816:0@lo:400: 00010000:00080000:0.0:1783071366.982719:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c78df80 x1869685707555328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071366.982728:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1869685707555328:0@lo:400: 00010000:00080000:0.0:1783071366.982739:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b08871880 x1869685707555840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071366.982747:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b08871880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1869685707555840:0@lo:400: 00000100:00100000:0.0:1783071366.982772:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707554944 00000100:00100000:0.0:1783071366.982775:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707554944 00000100:00100000:0.0:1783071366.982794:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783071366.982799:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869685707554944:12345-0@lo:400: 00000100:00100000:0.0:1783071366.982835:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869685707554944:12345-0@lo:400: Request processed in 36us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071366.982851:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783071366.982879:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869685707554944:0@lo:400: 00000100:00100000:0.0:1783071366.982920:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707554688 00000100:00100000:0.0:1783071366.982924:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707554688 00000100:00100000:0.0:1783071366.982950:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1783071366.982956:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07695450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+24:3646:x1869685707554688:12345-0@lo:400: 00000100:00100000:0.0:1783071366.982991:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07695450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+24:3646:x1869685707554688:12345-0@lo:400: Request processed in 35us (1761us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071366.982997:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1783071366.983024:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:feaa1501-b927-4e07-baad-3200e92d7497:3646:1869685707554688:0@lo:400: 00000100:00080000:1.0:1783071366.985124:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783071366.985133:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783071366.985137:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783071366.985140:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783071367.003171:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071367.003267:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692829184 00000100:00100000:0.0:1783071367.003297:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692829184 00000100:00100000:0.0:1783071367.003598:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 14 00000100:00100000:0.0:1783071367.003624:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c5ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+7:6251:x1869685692829184:12345-192.168.204.38@tcp:41: 00000004:00000024:0.0:1783071367.003691:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1783071367.003808:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c5ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+7:6251:x1869685692829184:12345-192.168.204.38@tcp:41: Request processed in 197us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071367.003816:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 14 00000100:00100000:3.0:1783071367.007600:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071367.008077:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692829312 00000100:00100000:0.0:1783071367.008091:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692829312 00000100:00080000:1.0:1783071367.008396:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783071367.008401:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783071367.008690:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 15 00000100:00100000:0.0:1783071367.008707:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03330700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+6:6251:x1869685692829312:12345-192.168.204.38@tcp:41: 00000004:00000024:0.0:1783071367.008767:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783071367.008883:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03330700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+6:6251:x1869685692829312:12345-192.168.204.38@tcp:41: Request processed in 180us (1297us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071367.008912:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 15 00000100:00100000:3.0:1783071367.013781:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071367.014023:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692829440 00000100:00100000:2.0:1783071367.014036:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692829440 00000100:00100000:2.0:1783071367.014130:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 12 00000100:00100000:2.0:1783071367.014143:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03333800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bf7532e4-6153-424a-9f4e-84941256b41f+6:6251:x1869685692829440:12345-192.168.204.38@tcp:13: 00002000:00000024:2.0:1783071367.014189:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783071367.014283:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03333800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bf7532e4-6153-424a-9f4e-84941256b41f+6:6251:x1869685692829440:12345-192.168.204.38@tcp:13: Request processed in 135us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071367.014292:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 12 00000100:00080000:1.0:1783071367.014402:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783071367.017648:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071367.017970:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692829568 00000100:00100000:2.0:1783071367.017983:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692829568 00000100:00100000:2.0:1783071367.018075:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 13 00000100:00100000:2.0:1783071367.018087:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03330e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bf7532e4-6153-424a-9f4e-84941256b41f+6:6251:x1869685692829568:12345-192.168.204.38@tcp:13: 00002000:00000024:2.0:1783071367.018136:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783071367.018243:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03330e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bf7532e4-6153-424a-9f4e-84941256b41f+6:6251:x1869685692829568:12345-192.168.204.38@tcp:13: Request processed in 158us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071367.018252:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 13 00000100:00080000:1.0:1783071367.018344:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1783071367.426626:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071367.490750:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03333100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707556224:0@lo:13: 00000100:00100000:1.0:1783071367.490866:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071367.491017:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707556224 00000100:00100000:3.0:1783071367.491028:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707556224 00000100:00100000:3.0:1783071367.491113:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783071367.491125:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c79ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707556224:12345-0@lo:13: 00002000:00000024:3.0:1783071367.491160:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783071367.491227:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c79ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707556224:12345-0@lo:13: Request processed in 104us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071367.491235:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1783071367.491454:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a03333100 x1869685707556224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071383 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071367.491477:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03333100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707556224:0@lo:13: 00000100:00100000:3.0:1783071367.491782:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783071367.491796:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03333480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707556480:0@lo:13: 00000100:00100000:3.0:1783071367.491836:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071367.492018:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707556352:0@lo:13: 00000100:00100000:1.0:1783071367.492045:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071367.492150:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707556480 00000100:00100000:3.0:1783071367.492156:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707556480 00000100:00100000:3.0:1783071367.492179:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707556352 00000100:00100000:3.0:1783071367.492181:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707556352 00000100:00100000:3.0:1783071367.492193:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783071367.492199:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03330000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1869685707556480:12345-0@lo:13: 00002000:00000024:3.0:1783071367.492227:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783071367.492279:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03330000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1869685707556480:12345-0@lo:13: Request processed in 79us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071367.492285:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783071367.492299:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783071367.492305:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c79d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707556352:12345-0@lo:13: 00002000:00000024:3.0:1783071367.492316:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783071367.492343:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c79d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707556352:12345-0@lo:13: Request processed in 39us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071367.492350:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783071367.492390:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c79c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707556608:0@lo:13: 00000100:00100000:3.0:1783071367.492425:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1783071367.492459:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a03333480 x1869685707556480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071383 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071367.492476:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03333480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707556480:0@lo:13: 00000100:00100000:3.0:1783071367.492497:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707556608 00000100:00100000:3.0:1783071367.492500:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707556608 00000100:00100000:3.0:1783071367.492515:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783071367.492521:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03333100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707556608:12345-0@lo:13: 00002000:00000024:3.0:1783071367.492531:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783071367.492556:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03333100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707556608:12345-0@lo:13: Request processed in 35us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071367.492562:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1783071367.492582:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c79c380 x1869685707556608/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071383 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071367.492595:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c79c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707556608:0@lo:13: 00010000:00080000:1.0:1783071367.492788:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a03332680 x1869685707556352/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071383 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071367.492801:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707556352:0@lo:13: 00000001:00100000:1.0:1783071368.014059:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bf7532e4-6153-424a-9f4e-84941256b41f 00000001:00080000:1.0:1783071368.014080:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00010000:00010000:3.0:1783071368.450888:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071368.515323:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783071368.515352:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03333480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707556736:0@lo:41: 00000100:00100000:2.0:1783071368.515484:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071368.515720:0:9413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707556736 00000100:00100000:0.0:1783071368.515732:0:9413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707556736 00000100:00100000:0.0:1783071368.515796:0:9413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783071368.515808:0:9413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c5aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707556736:12345-0@lo:41: 00000004:00000024:0.0:1783071368.515849:0:9413:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783071368.515917:0:9413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c5aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707556736:12345-0@lo:41: Request processed in 111us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071368.515925:0:9413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783071368.516297:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03333480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707556736:0@lo:41: 00000001:00100000:1.0:1783071369.042269:0:6495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bf7532e4-6153-424a-9f4e-84941256b41f 00000001:00100000:3.0:1783071369.050129:0:7447:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of bf7532e4-6153-424a-9f4e-84941256b41f 00010000:00010000:3.0:1783071369.476300:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783071369.549293:0:10179:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1783071370.008652:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071370.008748:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071370.008791:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071370.008831:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071370.008885:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071370.008968:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692830208 00000100:00100000:3.0:1783071370.008980:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692830208 00000100:00100000:3.0:1783071370.009053:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692830080 00000100:00100000:3.0:1783071370.009055:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692830080 00000100:00100000:3.0:1783071370.009082:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 14 00000100:00100000:3.0:1783071370.009094:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03331c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf7532e4-6153-424a-9f4e-84941256b41f+5:2404:x1869685692830208:12345-192.168.204.38@tcp:400: 00000100:00100000:3.0:1783071370.009191:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03331c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf7532e4-6153-424a-9f4e-84941256b41f+5:2404:x1869685692830208:12345-192.168.204.38@tcp:400: Request processed in 98us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071370.009204:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 14 00000100:00100000:3.0:1783071370.009232:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 15 00000100:00100000:3.0:1783071370.009239:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03330380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf7532e4-6153-424a-9f4e-84941256b41f+6:2404:x1869685692830080:12345-192.168.204.38@tcp:400: 00000100:00100000:3.0:1783071370.009266:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03330380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf7532e4-6153-424a-9f4e-84941256b41f+6:2404:x1869685692830080:12345-192.168.204.38@tcp:400: Request processed in 29us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071370.009273:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 15 00000100:00080000:1.0:1783071370.009796:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783071370.009803:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783071370.009921:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692829952 00000100:00100000:2.0:1783071370.009928:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692829952 00000100:00100000:2.0:1783071370.009996:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692829824 00000100:00100000:2.0:1783071370.010000:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692829824 00000100:00100000:2.0:1783071370.010021:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 48 00000100:00100000:2.0:1783071370.010028:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03333480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+5:2404:x1869685692829952:12345-192.168.204.38@tcp:400: 00000100:00100000:2.0:1783071370.010081:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03333480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+5:2404:x1869685692829952:12345-192.168.204.38@tcp:400: Request processed in 54us (1333us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071370.010088:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 48 00000100:00100000:2.0:1783071370.010103:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 49 00000100:00100000:2.0:1783071370.010110:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03331f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+6:2404:x1869685692829824:12345-192.168.204.38@tcp:400: 00000100:00100000:2.0:1783071370.010136:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03331f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+6:2404:x1869685692829824:12345-192.168.204.38@tcp:400: Request processed in 26us (1304us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071370.010143:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 49 00000100:00080000:1.0:1783071370.010387:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783071370.010390:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783071370.011077:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692829696 00000100:00100000:0.0:1783071370.011087:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692829696 00000100:00100000:0.0:1783071370.011141:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 196 00000100:00100000:0.0:1783071370.011149:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07697c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e4e7df8-beb0-40df-a2a1-9decaa005633+10:2404:x1869685692829696:12345-192.168.204.38@tcp:400: 00000100:00100000:0.0:1783071370.011264:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07697c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e4e7df8-beb0-40df-a2a1-9decaa005633+10:2404:x1869685692829696:12345-192.168.204.38@tcp:400: Request processed in 115us (2748us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071370.011271:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 196 00000001:00100000:2.0:1783071370.055938:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bf7532e4-6153-424a-9f4e-84941256b41f 00010000:00010000:0.0:1783071370.501751:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071371.522832:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071372.101871:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783071372.101913:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c5ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869685707557248:0@lo:400: 00000100:00100000:2.0:1783071372.101977:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c5ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869685707556992:0@lo:400: 00000100:00100000:1.0:1783071372.102018:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071372.102072:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707557248 00000100:00100000:2.0:1783071372.102082:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707557248 00000100:00100000:1.0:1783071372.102093:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c5adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707557760:0@lo:400: 00000100:00100000:1.0:1783071372.102130:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071372.102151:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783071372.102164:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c79df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1869685707557248:12345-0@lo:400: 00000100:00100000:1.0:1783071372.102166:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c5ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:feaa1501-b927-4e07-baad-3200e92d7497:3645:1869685707556864:0@lo:400: 00000100:00100000:1.0:1783071372.102215:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071372.102266:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c79df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1869685707557248:12345-0@lo:400: Request processed in 103us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071372.102277:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783071372.102277:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c5af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707558272:0@lo:400: 00000100:00100000:1.0:1783071372.102315:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071372.102436:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071372.102441:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c5ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869685707557248:0@lo:400: 00000100:00100000:1.0:1783071372.102463:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1783071372.102469:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c5aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707557376:0@lo:400: 00000100:00100000:1.0:1783071372.102495:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071372.102516:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c5aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707557888:0@lo:400: 00000100:00100000:2.0:1783071372.102530:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c5ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1869685707557504:0@lo:400: 00000100:00100000:1.0:1783071372.102543:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071372.102559:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c5ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707558400:0@lo:400: 00000100:00100000:1.0:1783071372.102583:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071372.102609:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707557760 00000100:00100000:1.0:1783071372.102612:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707557760 00000100:00100000:1.0:1783071372.102657:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707558272 00000100:00100000:1.0:1783071372.102660:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707558272 00000100:00100000:1.0:1783071372.102674:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707557888 00000100:00100000:1.0:1783071372.102676:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707557888 00000100:00100000:1.0:1783071372.102688:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707558400 00000100:00100000:1.0:1783071372.102690:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707558400 00000100:00100000:1.0:1783071372.102703:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783071372.102710:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c79c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707557760:12345-0@lo:400: 00000100:00100000:1.0:1783071372.102749:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c79c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707557760:12345-0@lo:400: Request processed in 39us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071372.102755:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783071372.102770:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783071372.102776:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c79e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707558272:12345-0@lo:400: 00000100:00100000:1.0:1783071372.102802:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c79e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707558272:12345-0@lo:400: Request processed in 27us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071372.102818:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783071372.102831:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783071372.102837:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c79f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707557888:12345-0@lo:400: 00000100:00100000:1.0:1783071372.102864:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c79f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707557888:12345-0@lo:400: Request processed in 28us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071372.102870:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783071372.102880:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783071372.102886:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c79ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707558400:12345-0@lo:400: 00000100:00100000:1.0:1783071372.102911:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c79ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707558400:12345-0@lo:400: Request processed in 25us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071372.102916:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783071372.102935:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707556864 00000100:00100000:1.0:1783071372.102939:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707556864 00000100:00100000:1.0:1783071372.102969:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1783071372.102975:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07696050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+24:3645:x1869685707556864:12345-0@lo:400: 00000100:00100000:1.0:1783071372.103004:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07696050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+24:3645:x1869685707556864:12345-0@lo:400: Request processed in 29us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071372.103010:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00080000:1.0:1783071372.103046:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783071372.103050:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783071372.103080:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c5aed80 x1869685707557888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071372.103092:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c5aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707557888:0@lo:400: 00010000:00080000:1.0:1783071372.103101:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c5ace00 x1869685707558400/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071372.103121:0:3645:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1783071372.103134:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c5ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707558400:0@lo:400: 00010000:00080000:1.0:1783071372.103147:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c5af800 x1869685707558272/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071372.103155:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c5af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707558272:0@lo:400: 00010000:00080000:1.0:1783071372.103165:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c5adf80 x1869685707557760/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071372.103172:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c5adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707557760:0@lo:400: 00000100:00100000:1.0:1783071372.103197:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c5ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:feaa1501-b927-4e07-baad-3200e92d7497:3645:1869685707556864:0@lo:400: 00000100:00100000:3.0:1783071372.104445:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c5afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707557120:0@lo:400: 00000100:00100000:3.0:1783071372.104519:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071372.104557:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c5ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1869685707557632:0@lo:400: 00000100:00100000:3.0:1783071372.104587:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071372.104623:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c5ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1869685707558144:0@lo:400: 00000100:00100000:3.0:1783071372.104679:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071372.104707:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783071372.104714:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c5af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707558528:0@lo:41: 00000100:00100000:3.0:1783071372.104737:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071372.104777:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707557376 00000100:00100000:3.0:1783071372.104786:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707557376 00000100:00100000:2.0:1783071372.104822:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071372.104832:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707557120 00000100:00100000:3.0:1783071372.104837:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707557120 00000100:00100000:2.0:1783071372.104847:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c5adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1869685707558016:0@lo:400: 00000100:00100000:3.0:1783071372.104863:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707558528 00000100:00100000:3.0:1783071372.104868:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707558528 00000100:00100000:3.0:1783071372.104888:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783071372.104894:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071372.104900:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c79c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707557376:12345-0@lo:400: 00000100:00100000:2.0:1783071372.104929:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707556992 00000100:00100000:2.0:1783071372.104935:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707556992 00000100:00100000:2.0:1783071372.104964:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707557632 00000100:00100000:3.0:1783071372.104969:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c79c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707557376:12345-0@lo:400: Request processed in 70us (2469us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071372.104969:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707557632 00000100:00100000:3.0:1783071372.104979:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783071372.104999:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707558144 00000100:00100000:2.0:1783071372.105003:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707558144 00000100:00100000:3.0:1783071372.105007:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1783071372.105016:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03333b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3648:x1869685707557120:12345-0@lo:400: 00000100:00100000:2.0:1783071372.105025:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707557504 00000100:00100000:2.0:1783071372.105029:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707557504 00000100:00100000:2.0:1783071372.105044:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707558016 00000100:00100000:2.0:1783071372.105047:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707558016 00000100:00100000:2.0:1783071372.105073:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1783071372.105076:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03333b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3648:x1869685707557120:12345-0@lo:400: Request processed in 60us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071372.105084:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c5af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869685707556992:12345-0@lo:400: 00000100:00100000:3.0:1783071372.105088:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1783071372.105107:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783071372.105116:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707558528:12345-0@lo:41: 00000100:00100000:2.0:1783071372.105136:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c5af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869685707556992:12345-0@lo:400: Request processed in 53us (2700us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071372.105145:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000004:00000024:3.0:1783071372.105149:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1783071372.105164:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783071372.105173:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03332680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869685707557632:12345-0@lo:400: 00000100:00100000:3.0:1783071372.105200:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707558528:12345-0@lo:41: Request processed in 85us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071372.105206:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783071372.105230:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03332680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869685707557632:12345-0@lo:400: Request processed in 57us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071372.105237:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783071372.105249:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783071372.105541:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c5af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707558528:0@lo:41: 00000100:00100000:1.0:1783071372.105554:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c5afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707557120:0@lo:400: 00010000:00080000:1.0:1783071372.105567:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c5ad500 x1869685707557632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071372.105578:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c5ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1869685707557632:0@lo:400: 00000100:00100000:3.0:1783071372.105911:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869685707558144:12345-0@lo:400: 00000100:00100000:2.0:1783071372.105925:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783071372.105939:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c5ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869685707557504:12345-0@lo:400: 00000100:00100000:3.0:1783071372.105968:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869685707558144:12345-0@lo:400: Request processed in 59us (1287us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071372.105977:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783071372.105988:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c5ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869685707557504:12345-0@lo:400: Request processed in 52us (1164us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071372.105996:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783071372.105997:0:6516:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1783071372.106006:0:6516:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1783071372.106027:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783071372.106035:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c5ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869685707558016:12345-0@lo:400: 00000100:00100000:2.0:1783071372.106071:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c5ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869685707558016:12345-0@lo:400: Request processed in 37us (1177us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071372.106078:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:2.0:1783071372.106100:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783071372.106105:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783071372.106133:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c5ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869685707556992:0@lo:400: 00010000:00080000:3.0:1783071372.106148:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c5ac700 x1869685707558144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071372.106154:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c5ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1869685707557504:0@lo:400: 00000100:00100000:3.0:1783071372.106167:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c5ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1869685707558144:0@lo:400: 00000100:00100000:2.0:1783071372.106174:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c5adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1869685707558016:0@lo:400: 00000100:00100000:2.0:1783071372.108202:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c5aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707557376:0@lo:400: 00010000:00010000:0.0:1783071372.548178:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071372.612589:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707558656:0@lo:13: 00000100:00100000:1.0:1783071372.612687:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071372.612771:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707558656 00000100:00100000:1.0:1783071372.612778:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707558656 00000100:00100000:1.0:1783071372.612852:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783071372.612864:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c79f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707558656:12345-0@lo:13: 00002000:00000024:1.0:1783071372.612903:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783071372.612954:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c79f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707558656:12345-0@lo:13: Request processed in 91us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071372.612970:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1783071372.613017:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c6aaa00 x1869685707558656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071388 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071372.613037:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707558656:0@lo:13: 00000100:00100000:1.0:1783071372.614933:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783071372.615955:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707559040:0@lo:13: 00000100:00100000:1.0:1783071372.616028:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071372.616191:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707559040 00000100:00100000:0.0:1783071372.616200:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707559040 00000100:00100000:0.0:1783071372.616248:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783071372.616258:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02c09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707559040:12345-0@lo:13: 00002000:00000024:0.0:1783071372.616281:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783071372.616342:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02c09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707559040:12345-0@lo:13: Request processed in 85us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071372.616380:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783071372.616922:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707558784:0@lo:13: 00000100:00100000:2.0:1783071372.616963:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071372.617001:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783071372.617008:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c79dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707558912:0@lo:13: 00000100:00100000:2.0:1783071372.617031:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071372.617055:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707558784 00000100:00100000:2.0:1783071372.617059:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707558784 00000100:00100000:2.0:1783071372.617080:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707558912 00000100:00100000:2.0:1783071372.617083:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707558912 00000100:00100000:2.0:1783071372.617096:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783071372.617102:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c5aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707558784:12345-0@lo:13: 00002000:00000024:2.0:1783071372.617128:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783071372.617162:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c5aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707558784:12345-0@lo:13: Request processed in 60us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071372.617180:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783071372.617201:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783071372.617206:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c5adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707558912:12345-0@lo:13: 00002000:00000024:2.0:1783071372.617215:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783071372.617238:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c5adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707558912:12345-0@lo:13: Request processed in 32us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071372.617244:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1783071372.617274:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c79dc00 x1869685707558912/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071388 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071372.617293:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c79dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707558912:0@lo:13: 00010000:00080000:2.0:1783071372.617303:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c6a8380 x1869685707558784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071388 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071372.617314:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707558784:0@lo:13: 00010000:00080000:1.0:1783071372.617514:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c6a0380 x1869685707559040/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071388 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071372.617530:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707559040:0@lo:13: 00000020:00000080:0.0:1783071372.827782:0:10328:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd3c327f10 20000000:00000080:0.0:1783071372.827802:0:10328:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f8a02e75c00 uarg=0000000000000000 20000000:01000000:0.0:1783071372.827861:0:10328:0:(mgs_llog.c:2004:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1783071372.827865:0:10328:0:(mgs_llog.c:6054:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1783071372.827868:0:10328:0:(mgs_llog.c:6085:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1783071372.827873:0:10328:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1783071372.827878:0:10328:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1783071372.827941:0:10328:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1783071372.827944:0:10328:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1783071372.829009:0:10329:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:0.0:1783071372.829302:0:10328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:0.0:1783071372.829332:0:10328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:0.0:1783071372.829346:0:10328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:0.0:1783071372.829359:0:10328:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1783071372.829480:0:10328:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1783071372.830021:0:10330:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:0.0:1783071372.830495:0:10328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:0.0:1783071372.830525:0:10328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:0.0:1783071372.830543:0:10328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:0.0:1783071372.830555:0:10328:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1783071372.830557:0:10328:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1783071372.831003:0:10331:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:0.0:1783071372.831182:0:10328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:0.0:1783071372.831205:0:10328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:0.0:1783071372.831220:0:10328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:0.0:1783071372.831230:0:10328:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1783071372.831232:0:10328:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1783071372.839260:0:10332:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:0.0:1783071372.839968:0:10328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:0.0:1783071372.840000:0:10328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:0.0:1783071372.840014:0:10328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:0.0:1783071372.840023:0:10328:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1783071372.840027:0:10328:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1783071372.841878:0:10333:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:0.0:1783071372.842892:0:10328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:0.0:1783071372.842946:0:10328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:0.0:1783071372.842963:0:10328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 10000000:01000000:0.0:1783071372.842978:0:10328:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1783071372.842997:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f8b3c461200/0x6b58994c2cbdc001 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071372.843016:0:10328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8b10966400/0x6b58994c2cbdbe9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbe95 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071372.843024:0:10328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8b3c460600/0x6b58994c2cbdbec6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbebf expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071372.843031:0:10328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8b3c460e00/0x6b58994c2cbdbf05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbefe expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071372.843038:0:10328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8b10967600/0x6b58994c2cbdbf13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbf0c expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071372.843045:0:10328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8b421d9e00/0x6b58994c2cbdbf21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbf1a expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071372.843052:0:10328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8a01748800/0x6b58994c2cbdbf3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbf36 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071372.843060:0:10328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8b014b9000/0x6b58994c2cbdbf67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbf60 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071372.843067:0:10328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8b10966800/0x6b58994c2cbdbf83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbf7c expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071372.843073:0:10328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8b10967000/0x6b58994c2cbdbfad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbfa6 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071372.843095:0:10328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8b014b8800/0x6b58994c2cbdbfbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98c22 expref: 9 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071372.843104:0:10328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8b014b9a00/0x6b58994c2cbdbfc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98c29 expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071372.843111:0:10328:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f8b3c461200/0x6b58994c2cbdc001 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071372.843152:0:10328:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8b014b9a00/0x6b58994c2cbdbfc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98c29 expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071372.843186:0:10328:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f8b014b9a00/0x6b58994c2cbdbfc2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98c29 expref: 9 pid: 6511 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071372.843202:0:10328:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1869685707559168:192.168.204.38@tcp:104: 00010000:00010000:0.0:1783071372.843342:0:10328:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8b014b8800/0x6b58994c2cbdbfbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98c22 expref: 9 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071372.843350:0:10328:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f8b014b8800/0x6b58994c2cbdbfbb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98c22 expref: 9 pid: 6508 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071372.843360:0:10328:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1869685707559296:192.168.204.38@tcp:104: 00010000:00010000:0.0:1783071372.843427:0:10328:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8b10967000/0x6b58994c2cbdbfad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6b58994c2cbdbfa6 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071372.843436:0:10328:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8b10967000/0x6b58994c2cbdbfad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6b58994c2cbdbfa6 expref: 23 pid: 6510 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071372.843458:0:10328:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6aad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1869685707559424:0@lo:104: 00000100:00100000:0.0:1783071372.843505:0:10328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783071372.843535:0:10328:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8b10966800/0x6b58994c2cbdbf83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6b58994c2cbdbf7c expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071372.843544:0:10328:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8b10966800/0x6b58994c2cbdbf83 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6b58994c2cbdbf7c expref: 23 pid: 6510 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071372.843552:0:10328:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1869685707559552:0@lo:104: 00000100:00100000:0.0:1783071372.843574:0:10328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783071372.845715:0:10328:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8b014b9000/0x6b58994c2cbdbf67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6b58994c2cbdbf60 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071372.845732:0:10328:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8b014b9000/0x6b58994c2cbdbf67 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6b58994c2cbdbf60 expref: 23 pid: 6510 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071372.845747:0:10328:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1869685707559680:0@lo:104: 00000100:00100000:0.0:1783071372.845796:0:10328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783071372.846038:0:10328:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8a01748800/0x6b58994c2cbdbf3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6b58994c2cbdbf36 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071372.846047:0:10328:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8a01748800/0x6b58994c2cbdbf3d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6b58994c2cbdbf36 expref: 23 pid: 6510 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071372.846057:0:10328:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6aa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1869685707559808:0@lo:104: 00000100:00100000:0.0:1783071372.846085:0:10328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071372.848580:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707559424 00000100:00100000:1.0:1783071372.848664:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707559424 00000100:00100000:1.0:1783071372.848818:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707559552 00000100:00100000:1.0:1783071372.848822:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707559552 00000100:00100000:1.0:1783071372.848835:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707559680 00000100:00100000:1.0:1783071372.848838:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707559680 00000100:00100000:1.0:1783071372.848856:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783071372.848866:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:feaa1501-b927-4e07-baad-3200e92d7497+5:10328:x1869685707559424:12345-0@lo:104: 00010000:00010000:1.0:1783071372.848887:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8f8b10967200/0x6b58994c2cbdbfa6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbfad expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071372.849187:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783071372.849195:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:feaa1501-b927-4e07-baad-3200e92d7497+5:10328:x1869685707559424:12345-0@lo:104: Request processed in 330us (5690us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071372.849202:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783071372.849224:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783071372.849231:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:feaa1501-b927-4e07-baad-3200e92d7497+4:10328:x1869685707559552:12345-0@lo:104: 00010000:00010000:1.0:1783071372.849258:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8000/0x6b58994c2cbdbf7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbf83 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071372.849459:0:10328:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8b421d9e00/0x6b58994c2cbdbf21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6b58994c2cbdbf1a expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071372.849485:0:10328:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8b421d9e00/0x6b58994c2cbdbf21 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6b58994c2cbdbf1a expref: 23 pid: 6510 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071372.849501:0:10328:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6ab480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1869685707559936:0@lo:104: 00010000:00010000:0.0:1783071372.849543:0:10328:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8b10967600/0x6b58994c2cbdbf13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6b58994c2cbdbf0c expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071372.849552:0:10328:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8b10967600/0x6b58994c2cbdbf13 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6b58994c2cbdbf0c expref: 23 pid: 6511 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071372.849560:0:10328:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1869685707560064:0@lo:104: 00010000:00010000:0.0:1783071372.849599:0:10328:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8b3c460e00/0x6b58994c2cbdbf05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6b58994c2cbdbefe expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071372.849607:0:10328:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8b3c460e00/0x6b58994c2cbdbf05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6b58994c2cbdbefe expref: 23 pid: 6511 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071372.849616:0:10328:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1869685707560192:0@lo:104: 00010000:00010000:0.0:1783071372.849661:0:10328:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8b3c460600/0x6b58994c2cbdbec6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6b58994c2cbdbebf expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071372.849669:0:10328:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8b3c460600/0x6b58994c2cbdbec6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6b58994c2cbdbebf expref: 23 pid: 6508 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071372.849676:0:10328:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6aaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1869685707560320:0@lo:104: 00010000:00010000:0.0:1783071372.849699:0:10328:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8b10966400/0x6b58994c2cbdbe9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6b58994c2cbdbe95 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071372.849729:0:10328:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8b10966400/0x6b58994c2cbdbe9c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6b58994c2cbdbe95 expref: 23 pid: 6511 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071372.849736:0:10328:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b08871880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1869685707560448:0@lo:104: 00000100:00100000:0.0:1783071372.849757:0:10328:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b03fefb40 going to sleep for 11 seconds 00000100:00100000:0.0:1783071372.849779:0:10328:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6aad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1869685707559424:0@lo:104: 00000100:00100000:0.0:1783071372.849788:0:10328:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1869685707559552:0@lo:104: 00010000:00010000:3.0:1783071372.850126:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783071372.850136:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8b10967200/0x6b58994c2cbdbfa6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbfad expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071372.850144:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b10967200 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:3.0:1783071372.850148:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8b10967200/0x6b58994c2cbdbfa6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x6b58994c2cbdbfad expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071372.850157:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8b10967200/0x6b58994c2cbdbfa6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x6b58994c2cbdbfad expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783071372.850175:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8b10967200/0x6b58994c2cbdbfa6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x6b58994c2cbdbfad expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783071372.850181:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783071372.850223:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8f8b10967200/0x6b58994c2cbdbfa6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbfad expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071372.850229:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783071372.850259:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8b10967200/0x6b58994c2cbdbfa6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbfad expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071372.850266:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8b10967200/0x6b58994c2cbdbfa6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbfad expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071372.850280:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783071372.850283:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8000/0x6b58994c2cbdbf7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbf83 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071372.850288:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b014b8000 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:3.0:1783071372.850291:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8000/0x6b58994c2cbdbf7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x6b58994c2cbdbf83 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071372.850299:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8000/0x6b58994c2cbdbf7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x6b58994c2cbdbf83 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783071372.850305:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8000/0x6b58994c2cbdbf7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x6b58994c2cbdbf83 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783071372.850309:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783071372.850324:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8000/0x6b58994c2cbdbf7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbf83 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071372.850329:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783071372.850344:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8000/0x6b58994c2cbdbf7c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbf83 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071372.850351:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8000/0x6b58994c2cbdbf7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbf83 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071372.850360:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071372.850388:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071372.850390:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071372.850405:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:feaa1501-b927-4e07-baad-3200e92d7497:3648:1869685707560576:0@lo:103: 00000100:00100000:3.0:1783071372.850445:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071372.850488:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:feaa1501-b927-4e07-baad-3200e92d7497:3645:1869685707560704:0@lo:103: 00000100:00100000:3.0:1783071372.850511:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071372.850544:0:7923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707560576 00000100:00100000:3.0:1783071372.850550:0:7923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707560576 00010000:00010000:3.0:1783071372.850574:0:7923:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8b10967000/0x6b58994c2cbdbfad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbfa6 expref: 24 pid: 6510 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071372.850608:0:7923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707560704 00000100:00100000:3.0:1783071372.850612:0:7923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707560704 00010000:00010000:3.0:1783071372.850624:0:7923:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8b10966800/0x6b58994c2cbdbf83 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbf7c expref: 25 pid: 6510 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071372.850642:0:7923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783071372.850649:0:7923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:feaa1501-b927-4e07-baad-3200e92d7497+25:3648:x1869685707560576:12345-0@lo:103: 00010000:00010000:3.0:1783071372.850659:0:7923:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071372.850664:0:7923:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8b10967000/0x6b58994c2cbdbfad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbfa6 expref: 25 pid: 6510 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071372.850673:0:7923:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8b10967000/0x6b58994c2cbdbfad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6b58994c2cbdbfa6 expref: 25 pid: 6510 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071372.850686:0:7923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b10967000/0x6b58994c2cbdbfad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6b58994c2cbdbfa6 expref: 25 pid: 6510 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071372.850699:0:7923:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783071372.850740:0:7923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:feaa1501-b927-4e07-baad-3200e92d7497+24:3648:x1869685707560576:12345-0@lo:103: Request processed in 92us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071372.850752:0:7923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783071372.850795:0:7923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783071372.850801:0:7923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:feaa1501-b927-4e07-baad-3200e92d7497+23:3645:x1869685707560704:12345-0@lo:103: 00010000:00010000:3.0:1783071372.850808:0:7923:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071372.850813:0:7923:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8b10966800/0x6b58994c2cbdbf83 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbf7c expref: 23 pid: 6510 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071372.850821:0:7923:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8b10966800/0x6b58994c2cbdbf83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6b58994c2cbdbf7c expref: 23 pid: 6510 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071372.850831:0:7923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b10966800/0x6b58994c2cbdbf83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6b58994c2cbdbf7c expref: 23 pid: 6510 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071372.850840:0:7923:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783071372.850867:0:7923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:feaa1501-b927-4e07-baad-3200e92d7497+22:3645:x1869685707560704:12345-0@lo:103: Request processed in 65us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071372.850874:0:7923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783071372.850912:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:feaa1501-b927-4e07-baad-3200e92d7497:3645:1869685707560704:0@lo:103: 00000100:00100000:3.0:1783071372.850936:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:feaa1501-b927-4e07-baad-3200e92d7497:3648:1869685707560576:0@lo:103: 00000100:00100000:0.0:1783071372.857317:0:10328:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1869685707559168:192.168.204.38@tcp:104: 00000100:00100000:0.0:1783071372.857903:0:10328:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1869685707559296:192.168.204.38@tcp:104: 00010000:00010000:1.0:1783071372.858042:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1783071372.858053:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:feaa1501-b927-4e07-baad-3200e92d7497+4:10328:x1869685707559552:12345-0@lo:104: Request processed in 8821us (14476us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071372.858064:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783071372.858134:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1783071372.858176:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071372.858197:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071372.858207:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071372.858217:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071372.858227:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071372.858235:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707559808 00000100:00100000:1.0:1783071372.858242:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707559808 00000100:00100000:1.0:1783071372.858273:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707559936 00000100:00100000:1.0:1783071372.858276:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707559936 00000100:00100000:1.0:1783071372.858285:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707560064 00000100:00100000:1.0:1783071372.858288:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707560064 00000100:00100000:1.0:1783071372.858297:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707560192 00000100:00100000:1.0:1783071372.858299:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707560192 00000100:00100000:1.0:1783071372.858309:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707560320 00000100:00100000:1.0:1783071372.858311:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707560320 00000100:00100000:1.0:1783071372.858320:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707560448 00000100:00100000:1.0:1783071372.858322:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707560448 00000100:00100000:1.0:1783071372.858334:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783071372.858342:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:feaa1501-b927-4e07-baad-3200e92d7497+9:10328:x1869685707559680:12345-0@lo:104: 00010000:00010000:1.0:1783071372.858358:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8f8b10966000/0x6b58994c2cbdbf60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbf67 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071372.858594:0:10328:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1869685707559680:0@lo:104: 00000100:00100000:3.0:1783071372.862977:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071372.863012:0:7923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692830464 00000100:00100000:3.0:1783071372.863022:0:7923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692830464 00010000:00010000:3.0:1783071372.863064:0:7923:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8b014b8800/0x6b58994c2cbdbfbb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98c22 expref: 10 pid: 6508 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071372.863102:0:7923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 26 00000100:00100000:3.0:1783071372.863128:0:7923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e4e7df8-beb0-40df-a2a1-9decaa005633+10:2405:x1869685692830464:12345-192.168.204.38@tcp:103: 00010000:00010000:3.0:1783071372.863143:0:7923:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071372.863150:0:7923:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8b014b8800/0x6b58994c2cbdbfbb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98c22 expref: 10 pid: 6508 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071372.863176:0:7923:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8b014b8800/0x6b58994c2cbdbfbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98c22 expref: 10 pid: 6508 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071372.863195:0:7923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b014b8800/0x6b58994c2cbdbfbb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98c22 expref: 10 pid: 6508 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071372.863212:0:7923:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783071372.863270:0:7923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e4e7df8-beb0-40df-a2a1-9decaa005633+9:2405:x1869685692830464:12345-192.168.204.38@tcp:103: Request processed in 145us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071372.863278:0:7923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 26 00010000:00010000:0.0:1783071372.864203:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783071372.864215:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8b10966000/0x6b58994c2cbdbf60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbf67 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071372.864225:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b10966000 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:0.0:1783071372.864229:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8b10966000/0x6b58994c2cbdbf60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x6b58994c2cbdbf67 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071372.864238:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8b10966000/0x6b58994c2cbdbf60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x6b58994c2cbdbf67 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783071372.864245:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8b10966000/0x6b58994c2cbdbf60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x6b58994c2cbdbf67 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783071372.864251:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783071372.864305:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8f8b10966000/0x6b58994c2cbdbf60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbf67 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071372.864327:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783071372.864361:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8b10966000/0x6b58994c2cbdbf60 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbf67 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071372.864387:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8b10966000/0x6b58994c2cbdbf60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbf67 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071372.864405:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071372.864407:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071372.864410:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071372.864428:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:feaa1501-b927-4e07-baad-3200e92d7497:3646:1869685707560832:0@lo:103: 00000100:00100000:0.0:1783071372.864482:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071372.864544:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707560832 00000100:00100000:3.0:1783071372.864568:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707560832 00010000:00010000:3.0:1783071372.864616:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8b014b9000/0x6b58994c2cbdbf67 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbf60 expref: 22 pid: 6510 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071372.864672:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783071372.864684:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c78fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:feaa1501-b927-4e07-baad-3200e92d7497+22:3646:x1869685707560832:12345-0@lo:103: 00010000:00010000:3.0:1783071372.864701:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071372.864707:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8b014b9000/0x6b58994c2cbdbf67 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbf60 expref: 22 pid: 6510 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071372.864719:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8b014b9000/0x6b58994c2cbdbf67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6b58994c2cbdbf60 expref: 22 pid: 6510 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071372.864757:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b014b9000/0x6b58994c2cbdbf67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6b58994c2cbdbf60 expref: 22 pid: 6510 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071372.864777:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783071372.864805:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1783071372.864827:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:feaa1501-b927-4e07-baad-3200e92d7497+9:10328:x1869685707559680:12345-0@lo:104: Request processed in 6483us (19028us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071372.864854:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c78fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:feaa1501-b927-4e07-baad-3200e92d7497+21:3646:x1869685707560832:12345-0@lo:103: Request processed in 171us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071372.864865:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783071372.864897:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:feaa1501-b927-4e07-baad-3200e92d7497:3646:1869685707560832:0@lo:103: 00000100:00100000:1.0:1783071372.864946:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783071372.864979:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783071372.864990:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c654c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:feaa1501-b927-4e07-baad-3200e92d7497+8:10328:x1869685707559808:12345-0@lo:104: 00010000:00010000:1.0:1783071372.865001:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461400/0x6b58994c2cbdbf36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbf3d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071372.865105:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783071372.865111:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c654c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:feaa1501-b927-4e07-baad-3200e92d7497+8:10328:x1869685707559808:12345-0@lo:104: Request processed in 126us (19027us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071372.865121:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783071372.865129:0:10328:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6aa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1869685707559808:0@lo:104: 00000100:00100000:1.0:1783071372.865188:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783071372.865197:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02c09f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:feaa1501-b927-4e07-baad-3200e92d7497+7:10328:x1869685707559936:12345-0@lo:104: 00010000:00010000:1.0:1783071372.865204:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8f8b421d8600/0x6b58994c2cbdbf1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbf21 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071372.865392:0:10328:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6ab480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1869685707559936:0@lo:104: 00010000:00010000:0.0:1783071372.868063:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783071372.868078:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461400/0x6b58994c2cbdbf36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbf3d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071372.868090:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b3c461400 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:0.0:1783071372.868095:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461400/0x6b58994c2cbdbf36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x6b58994c2cbdbf3d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071372.868105:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461400/0x6b58994c2cbdbf36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x6b58994c2cbdbf3d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783071372.868113:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461400/0x6b58994c2cbdbf36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x6b58994c2cbdbf3d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783071372.868119:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783071372.868205:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461400/0x6b58994c2cbdbf36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbf3d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071372.868212:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783071372.868246:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461400/0x6b58994c2cbdbf36 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbf3d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071372.868252:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461400/0x6b58994c2cbdbf36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbf3d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071372.868269:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783071372.868272:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8b421d8600/0x6b58994c2cbdbf1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbf21 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071372.868277:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b421d8600 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:0.0:1783071372.868280:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8b421d8600/0x6b58994c2cbdbf1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x6b58994c2cbdbf21 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071372.868285:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8b421d8600/0x6b58994c2cbdbf1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x6b58994c2cbdbf21 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783071372.868291:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8b421d8600/0x6b58994c2cbdbf1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x6b58994c2cbdbf21 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783071372.868296:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783071372.868312:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8f8b421d8600/0x6b58994c2cbdbf1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbf21 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071372.868317:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783071372.868321:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8b421d8600/0x6b58994c2cbdbf1a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbf21 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071372.868338:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8b421d8600/0x6b58994c2cbdbf1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbf21 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071372.868352:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071372.868354:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071372.868359:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071372.868393:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:feaa1501-b927-4e07-baad-3200e92d7497:3647:1869685707560960:0@lo:103: 00000100:00100000:0.0:1783071372.868413:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:feaa1501-b927-4e07-baad-3200e92d7497:3648:1869685707561088:0@lo:103: 00000100:00100000:0.0:1783071372.868683:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071372.868845:0:7923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707561088 00000100:00100000:0.0:1783071372.868854:0:7923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707561088 00010000:00010000:0.0:1783071372.868885:0:7923:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8b421d9e00/0x6b58994c2cbdbf21 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbf1a expref: 21 pid: 6510 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071372.868918:0:7923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783071372.868927:0:7923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c78df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:feaa1501-b927-4e07-baad-3200e92d7497+21:3648:x1869685707561088:12345-0@lo:103: 00010000:00010000:0.0:1783071372.868942:0:7923:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071372.868948:0:7923:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8b421d9e00/0x6b58994c2cbdbf21 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbf1a expref: 21 pid: 6510 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071372.868959:0:7923:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8b421d9e00/0x6b58994c2cbdbf21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6b58994c2cbdbf1a expref: 21 pid: 6510 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071372.868975:0:7923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b421d9e00/0x6b58994c2cbdbf21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6b58994c2cbdbf1a expref: 21 pid: 6510 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071372.868992:0:7923:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071372.869028:0:7923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c78df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:feaa1501-b927-4e07-baad-3200e92d7497+20:3648:x1869685707561088:12345-0@lo:103: Request processed in 102us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071372.869046:0:7923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783071372.869089:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:feaa1501-b927-4e07-baad-3200e92d7497:3648:1869685707561088:0@lo:103: 00010000:00010000:1.0:1783071372.869183:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1783071372.869192:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02c09f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:feaa1501-b927-4e07-baad-3200e92d7497+7:10328:x1869685707559936:12345-0@lo:104: Request processed in 3995us (11027us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071372.869201:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783071372.869221:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783071372.869228:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02c08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:feaa1501-b927-4e07-baad-3200e92d7497+6:10328:x1869685707560064:12345-0@lo:104: 00010000:00010000:1.0:1783071372.869238:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460800/0x6b58994c2cbdbf0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbf13 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071372.869281:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783071372.869293:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02c08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:feaa1501-b927-4e07-baad-3200e92d7497+6:10328:x1869685707560064:12345-0@lo:104: Request processed in 66us (11095us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071372.869299:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783071372.869314:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783071372.869320:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02c0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:feaa1501-b927-4e07-baad-3200e92d7497+5:10328:x1869685707560192:12345-0@lo:104: 00010000:00010000:1.0:1783071372.869330:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461c00/0x6b58994c2cbdbefe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbf05 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071372.869489:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071372.870559:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071372.870608:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707560960 00000100:00100000:3.0:1783071372.870618:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707560960 00010000:00010000:3.0:1783071372.870667:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8a01748800/0x6b58994c2cbdbf3d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbf36 expref: 20 pid: 6510 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071372.870700:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692830336 00000100:00100000:3.0:1783071372.870704:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692830336 00010000:00010000:3.0:1783071372.870718:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8b014b9a00/0x6b58994c2cbdbfc2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98c29 expref: 9 pid: 6511 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071372.870736:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783071372.870744:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:feaa1501-b927-4e07-baad-3200e92d7497+20:3647:x1869685707560960:12345-0@lo:103: 00010000:00010000:3.0:1783071372.870761:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071372.870766:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8a01748800/0x6b58994c2cbdbf3d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbf36 expref: 20 pid: 6510 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071372.870797:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8a01748800/0x6b58994c2cbdbf3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6b58994c2cbdbf36 expref: 20 pid: 6510 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071372.870817:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8a01748800/0x6b58994c2cbdbf3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6b58994c2cbdbf36 expref: 20 pid: 6510 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071372.870835:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783071372.870899:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:feaa1501-b927-4e07-baad-3200e92d7497+19:3647:x1869685707560960:12345-0@lo:103: Request processed in 155us (1412us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071372.870907:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783071372.870926:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30 00000100:00100000:3.0:1783071372.870933:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e4e7df8-beb0-40df-a2a1-9decaa005633+9:2406:x1869685692830336:12345-192.168.204.38@tcp:103: 00010000:00010000:3.0:1783071372.870942:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071372.870947:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8b014b9a00/0x6b58994c2cbdbfc2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98c29 expref: 9 pid: 6511 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071372.870957:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8b014b9a00/0x6b58994c2cbdbfc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98c29 expref: 9 pid: 6511 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071372.870969:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b014b9a00/0x6b58994c2cbdbfc2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98c29 expref: 9 pid: 6511 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071372.871086:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783071372.871135:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e4e7df8-beb0-40df-a2a1-9decaa005633+8:2406:x1869685692830336:12345-192.168.204.38@tcp:103: Request processed in 201us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071372.871143:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30 00000100:00100000:3.0:1783071372.871335:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:feaa1501-b927-4e07-baad-3200e92d7497:3647:1869685707560960:0@lo:103: 00000100:00100000:3.0:1783071372.871482:0:10328:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1869685707560064:0@lo:104: 00000100:00100000:3.0:1783071372.871492:0:10328:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1869685707560192:0@lo:104: 00010000:00010000:0.0:1783071372.872812:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783071372.872828:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460800/0x6b58994c2cbdbf0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbf13 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071372.872840:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b3c460800 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:0.0:1783071372.872845:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460800/0x6b58994c2cbdbf0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x6b58994c2cbdbf13 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071372.872856:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460800/0x6b58994c2cbdbf0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x6b58994c2cbdbf13 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783071372.872864:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460800/0x6b58994c2cbdbf0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x6b58994c2cbdbf13 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783071372.872869:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783071372.872931:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460800/0x6b58994c2cbdbf0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbf13 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071372.872937:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783071372.872968:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460800/0x6b58994c2cbdbf0c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbf13 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071372.872975:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460800/0x6b58994c2cbdbf0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbf13 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071372.872997:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071372.872999:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071372.873017:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071372.873036:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783071372.873059:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:feaa1501-b927-4e07-baad-3200e92d7497:3646:1869685707561216:0@lo:103: 00000100:00100000:0.0:1783071372.873130:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071372.873198:0:7923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707561216 00000100:00100000:0.0:1783071372.873204:0:7923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707561216 00010000:00010000:0.0:1783071372.873236:0:7923:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8b10967600/0x6b58994c2cbdbf13 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbf0c expref: 19 pid: 6511 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071372.873269:0:7923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783071372.873277:0:7923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab8e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:feaa1501-b927-4e07-baad-3200e92d7497+19:3646:x1869685707561216:12345-0@lo:103: 00010000:00010000:0.0:1783071372.873291:0:7923:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071372.873296:0:7923:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8b10967600/0x6b58994c2cbdbf13 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbf0c expref: 19 pid: 6511 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071372.873307:0:7923:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8b10967600/0x6b58994c2cbdbf13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6b58994c2cbdbf0c expref: 19 pid: 6511 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071372.873320:0:7923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b10967600/0x6b58994c2cbdbf13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6b58994c2cbdbf0c expref: 19 pid: 6511 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071372.873334:0:7923:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071372.873387:0:7923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab8e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:feaa1501-b927-4e07-baad-3200e92d7497+18:3646:x1869685707561216:12345-0@lo:103: Request processed in 110us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071372.873395:0:7923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783071372.873462:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:feaa1501-b927-4e07-baad-3200e92d7497:3646:1869685707561216:0@lo:103: 00010000:00010000:1.0:1783071372.873549:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783071372.873558:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02c0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:feaa1501-b927-4e07-baad-3200e92d7497+5:10328:x1869685707560192:12345-0@lo:104: Request processed in 4237us (15349us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071372.873566:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783071372.873599:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783071372.873607:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02c09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:feaa1501-b927-4e07-baad-3200e92d7497+4:10328:x1869685707560320:12345-0@lo:104: 00010000:00010000:1.0:1783071372.873617:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8f8b10966e00/0x6b58994c2cbdbebf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbec6 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071372.873666:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783071372.873671:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02c09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:feaa1501-b927-4e07-baad-3200e92d7497+4:10328:x1869685707560320:12345-0@lo:104: Request processed in 67us (15454us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071372.873677:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783071372.873690:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783071372.873695:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02c0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:feaa1501-b927-4e07-baad-3200e92d7497+3:10328:x1869685707560448:12345-0@lo:104: 00010000:00010000:1.0:1783071372.873713:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8f8b421d8400/0x6b58994c2cbdbe95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbe9c expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071372.873742:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1783071372.873754:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02c0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:feaa1501-b927-4e07-baad-3200e92d7497+3:10328:x1869685707560448:12345-0@lo:104: Request processed in 59us (15526us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071372.873760:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:1.0:1783071372.873778:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783071372.873784:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461c00/0x6b58994c2cbdbefe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbf05 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071372.873790:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b3c461c00 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:1.0:1783071372.873793:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461c00/0x6b58994c2cbdbefe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6b58994c2cbdbf05 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071372.873800:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461c00/0x6b58994c2cbdbefe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6b58994c2cbdbf05 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783071372.873807:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461c00/0x6b58994c2cbdbefe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6b58994c2cbdbf05 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783071372.873812:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783071372.873834:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461c00/0x6b58994c2cbdbefe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbf05 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071372.873839:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783071372.873850:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461c00/0x6b58994c2cbdbefe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbf05 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071372.873858:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461c00/0x6b58994c2cbdbefe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbf05 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071372.873869:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783071372.873872:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8b10966e00/0x6b58994c2cbdbebf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbec6 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071372.873889:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b10966e00 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:1.0:1783071372.873891:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8b10966e00/0x6b58994c2cbdbebf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6b58994c2cbdbec6 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071372.873898:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8b10966e00/0x6b58994c2cbdbebf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6b58994c2cbdbec6 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783071372.873905:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8b10966e00/0x6b58994c2cbdbebf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6b58994c2cbdbec6 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783071372.873909:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783071372.873923:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8f8b10966e00/0x6b58994c2cbdbebf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbec6 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071372.873929:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783071372.873944:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8b10966e00/0x6b58994c2cbdbebf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbec6 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071372.873950:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8b10966e00/0x6b58994c2cbdbebf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbec6 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071372.873961:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783071372.873964:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8b421d8400/0x6b58994c2cbdbe95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbe9c expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071372.873969:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b421d8400 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:1.0:1783071372.873972:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8b421d8400/0x6b58994c2cbdbe95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6b58994c2cbdbe9c expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071372.873988:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8b421d8400/0x6b58994c2cbdbe95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6b58994c2cbdbe9c expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783071372.873994:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8b421d8400/0x6b58994c2cbdbe95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6b58994c2cbdbe9c expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783071372.873999:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1783071372.874006:0:10328:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6aaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1869685707560320:0@lo:104: 00010000:00010000:1.0:1783071372.874011:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8f8b421d8400/0x6b58994c2cbdbe95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbe9c expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071372.874016:0:10328:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b08871880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1869685707560448:0@lo:104: 00010000:00010000:1.0:1783071372.874016:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783071372.874021:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8b421d8400/0x6b58994c2cbdbe95 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbe9c expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071372.874027:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8b421d8400/0x6b58994c2cbdbe95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbe9c expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071372.874041:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071372.874042:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071372.874044:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071372.874052:0:10328:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f8b3c461200/0x6b58994c2cbdc001 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071372.874054:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02c0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:feaa1501-b927-4e07-baad-3200e92d7497:3648:1869685707561600:0@lo:103: 00000100:00100000:1.0:1783071372.874081:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071372.874122:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783071372.874127:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02c0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:feaa1501-b927-4e07-baad-3200e92d7497:3648:1869685707561472:0@lo:103: 00000100:00100000:1.0:1783071372.874149:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071372.874187:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783071372.874195:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02c08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:feaa1501-b927-4e07-baad-3200e92d7497:3645:1869685707561344:0@lo:103: 00000100:00100000:2.0:1783071372.874198:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707561600 00000100:00100000:2.0:1783071372.874203:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707561600 00000100:00100000:1.0:1783071372.874217:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783071372.874222:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8b10966400/0x6b58994c2cbdbe9c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbe95 expref: 18 pid: 6511 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071372.874240:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707561472 00000100:00100000:1.0:1783071372.874247:0:7923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707561344 00000100:00100000:2.0:1783071372.874248:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707561472 00000100:00100000:1.0:1783071372.874250:0:7923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707561344 00010000:00010000:2.0:1783071372.874262:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8b3c460600/0x6b58994c2cbdbec6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbebf expref: 20 pid: 6508 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071372.874262:0:7923:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8b3c460e00/0x6b58994c2cbdbf05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbefe expref: 20 pid: 6511 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071372.874279:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783071372.874288:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02c09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:feaa1501-b927-4e07-baad-3200e92d7497+20:3648:x1869685707561600:12345-0@lo:103: 00010000:00010000:2.0:1783071372.874298:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071372.874302:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8b10966400/0x6b58994c2cbdbe9c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbe95 expref: 20 pid: 6511 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071372.874313:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8b10966400/0x6b58994c2cbdbe9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6b58994c2cbdbe95 expref: 20 pid: 6511 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071372.874328:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b10966400/0x6b58994c2cbdbe9c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6b58994c2cbdbe95 expref: 20 pid: 6511 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071372.874339:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071372.874403:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02c09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:feaa1501-b927-4e07-baad-3200e92d7497+19:3648:x1869685707561600:12345-0@lo:103: Request processed in 117us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071372.876269:0:7923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783071372.876291:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783071372.876293:0:7923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37a61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:feaa1501-b927-4e07-baad-3200e92d7497+19:3648:x1869685707561472:12345-0@lo:103: 00010000:00010000:1.0:1783071372.876320:0:7923:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1783071372.876326:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37a61c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:feaa1501-b927-4e07-baad-3200e92d7497+19:3645:x1869685707561344:12345-0@lo:103: 00010000:00010000:1.0:1783071372.876338:0:7923:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8b3c460600/0x6b58994c2cbdbec6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbebf expref: 19 pid: 6508 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071372.876352:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071372.876354:0:7923:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8b3c460600/0x6b58994c2cbdbec6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6b58994c2cbdbebf expref: 19 pid: 6508 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071372.876390:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8b3c460e00/0x6b58994c2cbdbf05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbefe expref: 19 pid: 6511 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071372.876400:0:7923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b3c460600/0x6b58994c2cbdbec6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6b58994c2cbdbebf expref: 19 pid: 6508 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071372.876423:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8b3c460e00/0x6b58994c2cbdbf05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6b58994c2cbdbefe expref: 18 pid: 6511 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071372.877132:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071372.877176:0:7923:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071372.877245:0:7923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37a61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:feaa1501-b927-4e07-baad-3200e92d7497+18:3648:x1869685707561472:12345-0@lo:103: Request processed in 963us (3093us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071372.877255:0:7923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:3.0:1783071372.877297:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b3c460e00/0x6b58994c2cbdbf05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6b58994c2cbdbefe expref: 17 pid: 6511 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071372.877323:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02c0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:feaa1501-b927-4e07-baad-3200e92d7497:3648:1869685707561472:0@lo:103: 00010000:00010000:3.0:1783071372.877326:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f8b3c461200/0x6b58994c2cbdc001 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071372.877339:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02c0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:feaa1501-b927-4e07-baad-3200e92d7497:3648:1869685707561600:0@lo:103: 00010000:00010000:3.0:1783071372.877340:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b3c461200/0x6b58994c2cbdc001 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071372.877411:0:6501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f8b3c461200/0x6b58994c2cbdc001 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071372.877421:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f8b3c461200/0x6b58994c2cbdc001 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071372.877544:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f8b3c461200/0x6b58994c2cbdc001 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071372.877552:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f8b3c461200/0x6b58994c2cbdc001 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071372.877577:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b3c461200 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:3.0:1783071372.877582:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f8b3c461200/0x6b58994c2cbdc001 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071372.877591:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f8b3c461200/0x6b58994c2cbdc001 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071372.877623:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f8b3c461200/0x6b58994c2cbdc001 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071372.877636:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783071372.877697:0:10328:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f8b3c461200/0x6b58994c2cbdc001 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071372.877720:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37a61c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:feaa1501-b927-4e07-baad-3200e92d7497+16:3645:x1869685707561344:12345-0@lo:103: Request processed in 1406us (3496us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071372.877733:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:0.0:1783071372.877753:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f8b3c461200/0x6b58994c2cbdc001 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071372.877762:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b3c461200/0x6b58994c2cbdc001 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071372.878594:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02c08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:feaa1501-b927-4e07-baad-3200e92d7497:3645:1869685707561344:0@lo:103: 00000100:00100000:2.0:1783071372.881154:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:1.0:1783071373.573879:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071373.634686:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707561728:0@lo:41: 00000100:00100000:1.0:1783071373.634875:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071373.638888:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707561728 00000100:00100000:3.0:1783071373.638910:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707561728 00000100:00100000:3.0:1783071373.639075:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783071373.640220:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707561728:12345-0@lo:41: 00000004:00000024:3.0:1783071373.640350:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783071373.640554:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707561728:12345-0@lo:41: Request processed in 1465us (5677us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071373.640564:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783071373.640697:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707561728:0@lo:41: 10000000:01000000:1.0:1783071373.954825:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783071373.954852:0:6513:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8f8b34e49800 from 48 10000000:01000000:1.0:1783071373.954858:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783071373.954908:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8a01748e00/0x6b58994c2cbdc008 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071373.954921:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8a01748e00/0x6b58994c2cbdc008 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071373.955047:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8a01748e00/0x6b58994c2cbdc008 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071373.955076:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707561856:0@lo:101: 00000100:00100000:1.0:1783071373.955760:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071373.955832:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b06d07240 going to sleep for 11 seconds 00000100:00100000:2.0:1783071373.956232:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707561856 00000100:00100000:2.0:1783071373.956241:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707561856 00000100:00100000:2.0:1783071373.956306:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1783071373.956326:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07695c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+15:6513:x1869685707561856:12345-0@lo:101: 00010000:00010000:2.0:1783071373.956339:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071373.956357:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b10966400/0x6b58994c2cbdc00f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdc008 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071373.956422:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b10966400/0x6b58994c2cbdc00f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdc008 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071373.956448:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b10966400/0x6b58994c2cbdc00f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdc008 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071373.956456:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b10966400, rc 0) 00000100:00100000:2.0:1783071373.956516:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07695c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+16:6513:x1869685707561856:12345-0@lo:101: Request processed in 201us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071373.956522:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1783071373.957275:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707561856:0@lo:101: 00010000:00010000:3.0:1783071373.957310:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8a01748e00/0x6b58994c2cbdc008 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc00f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071373.957346:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8a01748e00/0x6b58994c2cbdc008 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdc00f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071373.957500:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707561984:0@lo:501: 00000100:00100000:3.0:1783071373.957571:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071373.957624:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b18027540 going to sleep for 11 seconds 00000100:00100000:1.0:1783071373.958230:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707561984 00000100:00100000:1.0:1783071373.958240:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707561984 00000100:00100000:1.0:1783071373.958307:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1783071373.958320:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07696450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+16:6513:x1869685707561984:12345-0@lo:501: 00000100:00100000:1.0:1783071373.958590:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07696450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+16:6513:x1869685707561984:12345-0@lo:501: Request processed in 271us (1017us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071373.958598:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1783071373.962042:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707561984:0@lo:501: 00000100:00100000:3.0:1783071373.962138:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707562112:0@lo:503: 00000100:00100000:3.0:1783071373.962255:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071373.962394:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b18027540 going to sleep for 11 seconds 00000100:00100000:1.0:1783071373.966056:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707562112 00000100:00100000:1.0:1783071373.966083:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707562112 00000100:00100000:1.0:1783071373.966339:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1783071373.966355:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07697050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+16:6513:x1869685707562112:12345-0@lo:503: 00000100:00100000:1.0:1783071373.966626:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07697050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+16:6513:x1869685707562112:12345-0@lo:503: Request processed in 273us (4369us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071373.966635:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1783071373.966780:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707562112:0@lo:503: 00000100:00100000:0.0:1783071373.969886:0:10345:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:10345:1869685707562240:0@lo:502: 00000100:00100000:0.0:1783071373.970019:0:10345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071373.970118:0:10345:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b03fef6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783071373.970174:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707562240 00000100:00100000:2.0:1783071373.970184:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707562240 00000100:00100000:2.0:1783071373.970538:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1783071373.970550:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07694450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+16:10345:x1869685707562240:12345-0@lo:502: 00000100:00100000:2.0:1783071373.970741:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07694450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+16:10345:x1869685707562240:12345-0@lo:502: Request processed in 193us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071373.970750:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1783071373.971639:0:10345:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:10345:1869685707562240:0@lo:502: 00000100:00100000:3.0:1783071373.971722:0:10345:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:10345:1869685707562368:0@lo:502: 00000100:00100000:3.0:1783071373.972351:0:10345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071373.975624:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707562368 00000100:00100000:2.0:1783071373.975643:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707562368 00000100:00100000:3.0:1783071373.975677:0:10345:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b18027540 going to sleep for 11 seconds 00000100:00100000:2.0:1783071373.975714:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1783071373.975726:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07694050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+16:10345:x1869685707562368:12345-0@lo:502: 00000100:00100000:2.0:1783071373.975965:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07694050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+16:10345:x1869685707562368:12345-0@lo:502: Request processed in 240us (3616us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071373.975973:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1783071373.976331:0:10345:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:10345:1869685707562368:0@lo:502: 00000040:00080000:3.0:1783071373.976398:0:10345:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1783071373.980258:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1783071373.980308:0:6513:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783071373.980324:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8a01748e00/0x6b58994c2cbdc008 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc00f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071373.980339:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8a01748e00/0x6b58994c2cbdc008 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc00f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071373.980961:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1783071373.980965:0:6513:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1783071373.980969:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1783071373.981022:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b10967800/0x6b58994c2cbdc016 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071373.981032:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8b10967800/0x6b58994c2cbdc016 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071373.981045:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8b10967800/0x6b58994c2cbdc016 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071373.981077:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c5ac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707562496:0@lo:101: 00000100:00100000:2.0:1783071373.982323:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071373.982460:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b0729be40 going to sleep for 11 seconds 00000100:00100000:0.0:1783071373.982566:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707562496 00000100:00100000:0.0:1783071373.982576:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707562496 00000100:00100000:0.0:1783071373.982639:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1783071373.982651:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07696850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+16:6513:x1869685707562496:12345-0@lo:101: 00010000:00010000:0.0:1783071373.982670:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071373.982692:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b3c461200/0x6b58994c2cbdc01d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdc016 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071373.982846:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b3c461200/0x6b58994c2cbdc01d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdc016 expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071373.982863:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b3c461200/0x6b58994c2cbdc01d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdc016 expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071373.982873:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b3c461200, rc 0) 00000100:00100000:0.0:1783071373.983000:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07696850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+17:6513:x1869685707562496:12345-0@lo:101: Request processed in 350us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071373.983008:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1783071373.984006:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c5ac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707562496:0@lo:101: 00010000:00010000:2.0:1783071373.984036:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8b10967800/0x6b58994c2cbdc016 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc01d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071373.984049:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8b10967800/0x6b58994c2cbdc016 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdc01d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071373.984164:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c5ac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707562624:0@lo:501: 00000100:00100000:2.0:1783071373.984215:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071373.984265:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b0729be40 going to sleep for 11 seconds 00000100:00100000:0.0:1783071373.984339:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707562624 00000100:00100000:0.0:1783071373.985009:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707562624 00000100:00100000:0.0:1783071373.985084:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1783071373.985094:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07695050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+17:6513:x1869685707562624:12345-0@lo:501: 00000100:00100000:0.0:1783071373.985645:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07695050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+17:6513:x1869685707562624:12345-0@lo:501: Request processed in 549us (1427us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071373.985656:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1783071373.986417:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c5ac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707562624:0@lo:501: 00000100:00100000:1.0:1783071373.986496:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707562752:0@lo:503: 00000100:00100000:1.0:1783071373.986562:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071373.986603:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b3c766f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783071373.986741:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707562752 00000100:00100000:2.0:1783071373.986751:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707562752 00000100:00100000:2.0:1783071373.986802:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1783071373.986818:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+17:6513:x1869685707562752:12345-0@lo:503: 00000100:00100000:2.0:1783071373.987181:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+17:6513:x1869685707562752:12345-0@lo:503: Request processed in 363us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071373.987190:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1783071373.987320:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707562752:0@lo:503: 00000100:00100000:1.0:1783071373.990071:0:10346:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:10346:1869685707562880:0@lo:502: 00000100:00100000:1.0:1783071373.990479:0:10346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071373.990530:0:10346:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b3c766d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783071373.990678:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707562880 00000100:00100000:0.0:1783071373.990689:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707562880 00000100:00100000:0.0:1783071373.990877:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1783071373.990959:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+17:10346:x1869685707562880:12345-0@lo:502: 00000100:00100000:0.0:1783071373.991271:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+17:10346:x1869685707562880:12345-0@lo:502: Request processed in 384us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071373.991281:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1783071373.991514:0:10346:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:10346:1869685707562880:0@lo:502: 00000020:01000000:1.0:1783071373.991557:0:10346:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783071373.991569:0:10346:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783071373.991572:0:10346:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1783071373.991579:0:10346:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1783071373.991615:0:10346:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:10346:1869685707563008:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783071373.991661:0:10346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071373.991753:0:10346:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b419cd000 going to sleep for 11 seconds 00000100:00100000:0.0:1783071373.992242:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707563008 00000100:00100000:0.0:1783071373.992251:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707563008 00000100:00100000:0.0:1783071373.992300:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1783071373.992308:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+17:10346:x1869685707563008:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783071373.992576:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+17:10346:x1869685707563008:12345-0@lo:502:llog_process_th.0 Request processed in 268us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071373.992584:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1783071373.992682:0:10346:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:10346:1869685707563008:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783071373.992711:0:10346:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783071373.992718:0:10346:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783071373.992720:0:10346:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1783071373.992724:0:10346:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:2.0:1783071373.993257:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1783071373.993290:0:6513:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1783071373.993306:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b10967800/0x6b58994c2cbdc016 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc01d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071373.993318:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8b10967800/0x6b58994c2cbdc016 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc01d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071373.993330:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783071373.993333:0:6513:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8f8b069b2000 from 48 10000000:01000000:2.0:1783071373.993336:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783071373.995013:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b10967c00/0x6b58994c2cbdc024 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071373.995035:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8b10967c00/0x6b58994c2cbdc024 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071373.995050:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8b10967c00/0x6b58994c2cbdc024 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071373.995085:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c5ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707563136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783071373.997397:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071373.997468:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b0729bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783071373.997593:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707563136 00000100:00100000:0.0:1783071373.997605:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707563136 00000100:00100000:0.0:1783071373.997676:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1783071373.997688:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+17:6513:x1869685707563136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783071373.997708:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071373.997951:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b3c460800/0x6b58994c2cbdc02b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdc024 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071373.998015:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b3c460800/0x6b58994c2cbdc02b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdc024 expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071373.998028:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b3c460800/0x6b58994c2cbdc02b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdc024 expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071373.998041:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b3c460800, rc 0) 00000100:00100000:0.0:1783071373.998095:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+18:6513:x1869685707563136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 409us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071373.998103:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1783071373.999347:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c5ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707563136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783071373.999408:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8b10967c00/0x6b58994c2cbdc024 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc02b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071373.999434:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8b10967c00/0x6b58994c2cbdc024 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdc02b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071373.999536:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c5ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707563264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783071373.999592:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071373.999636:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b0729bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783071373.999870:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707563264 00000100:00100000:0.0:1783071373.999878:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707563264 00000100:00100000:0.0:1783071373.999938:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1783071373.999947:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+18:6513:x1869685707563264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783071374.000105:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+18:6513:x1869685707563264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 158us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071374.000291:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1783071374.000427:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c5ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707563264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783071374.000472:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c5ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707563392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783071374.000526:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071374.000550:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b0729bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783071374.000642:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707563392 00000100:00100000:0.0:1783071374.000648:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707563392 00000100:00100000:0.0:1783071374.000682:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1783071374.000690:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+18:6513:x1869685707563392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783071374.000799:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+18:6513:x1869685707563392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 110us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071374.000807:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1783071374.001244:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c5ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707563392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783071374.001853:0:10347:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c5ae300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:10347:1869685707563520:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783071374.002077:0:10347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071374.002283:0:10347:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b0729be40 going to sleep for 11 seconds 00000100:00100000:0.0:1783071374.002350:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707563520 00000100:00100000:0.0:1783071374.002358:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707563520 00000100:00100000:0.0:1783071374.002450:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1783071374.002458:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+18:10347:x1869685707563520:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783071374.002603:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+18:10347:x1869685707563520:12345-0@lo:502:llog_process_th.0 Request processed in 145us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071374.002611:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1783071374.002712:0:10347:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c5ae300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:10347:1869685707563520:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783071374.002780:0:10347:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:10347:1869685707563648:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783071374.002819:0:10347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071374.002839:0:10347:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b419cd000 going to sleep for 11 seconds 00000100:00100000:0.0:1783071374.003103:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707563648 00000100:00100000:0.0:1783071374.003192:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707563648 00000100:00100000:0.0:1783071374.003230:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1783071374.003237:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+18:10347:x1869685707563648:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783071374.003447:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+18:10347:x1869685707563648:12345-0@lo:502:llog_process_th.0 Request processed in 209us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071374.003454:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1783071374.011584:0:10347:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:10347:1869685707563648:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1783071374.011687:0:10347:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1783071374.016336:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1783071374.016454:0:6513:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783071374.016473:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b10967c00/0x6b58994c2cbdc024 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc02b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071374.016490:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8b10967c00/0x6b58994c2cbdc024 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc02b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783071374.016649:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1783071374.016654:0:6513:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1783071374.016658:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1783071374.016713:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461400/0x6b58994c2cbdc032 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071374.016724:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461400/0x6b58994c2cbdc032 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071374.016751:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461400/0x6b58994c2cbdc032 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071374.016785:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707563776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783071374.016879:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071374.016948:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0179e300 going to sleep for 11 seconds 00000100:00100000:2.0:1783071374.017082:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707563776 00000100:00100000:2.0:1783071374.017092:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707563776 00000100:00100000:2.0:1783071374.017179:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1783071374.017191:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+18:6513:x1869685707563776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783071374.017210:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071374.017227:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b10967e00/0x6b58994c2cbdc039 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdc032 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071374.017258:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b10967e00/0x6b58994c2cbdc039 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdc032 expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071374.017287:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b10967e00/0x6b58994c2cbdc039 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdc032 expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071374.017297:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b10967e00, rc 0) 00000100:00100000:2.0:1783071374.017360:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+19:6513:x1869685707563776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071374.017391:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1783071374.017958:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707563776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783071374.017980:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461400/0x6b58994c2cbdc032 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc039 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071374.017991:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461400/0x6b58994c2cbdc032 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdc039 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071374.018073:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707563904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783071374.018189:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071374.018220:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b419cdf00 going to sleep for 11 seconds 00000100:00100000:0.0:1783071374.018272:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707563904 00000100:00100000:0.0:1783071374.018289:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707563904 00000100:00100000:0.0:1783071374.018328:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1783071374.018335:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+19:6513:x1869685707563904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783071374.018498:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+19:6513:x1869685707563904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 163us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071374.018506:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1783071374.018674:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707563904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783071374.018709:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707564032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783071374.018866:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071374.018954:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b419cdf00 going to sleep for 11 seconds 00000100:00100000:0.0:1783071374.019010:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707564032 00000100:00100000:0.0:1783071374.019016:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707564032 00000100:00100000:0.0:1783071374.019055:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1783071374.019063:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+19:6513:x1869685707564032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783071374.019639:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+19:6513:x1869685707564032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 575us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071374.019648:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1783071374.019920:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707564032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783071374.020636:0:10348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:10348:1869685707564160:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783071374.020708:0:10348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071374.021009:0:10348:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b180276c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783071374.027010:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707564160 00000100:00100000:2.0:1783071374.027032:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707564160 00000100:00100000:2.0:1783071374.029990:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1783071374.030015:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+19:10348:x1869685707564160:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783071374.030260:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+19:10348:x1869685707564160:12345-0@lo:502:llog_process_th.0 Request processed in 256us (9552us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071374.030269:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1783071374.030510:0:10348:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:10348:1869685707564160:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783071374.030552:0:10348:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783071374.030563:0:10348:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783071374.030565:0:10348:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1783071374.030571:0:10348:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1783071374.030613:0:10348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6aa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:10348:1869685707564288:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783071374.030672:0:10348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071374.030713:0:10348:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b419cd900 going to sleep for 11 seconds 00000100:00100000:0.0:1783071374.030983:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707564288 00000100:00100000:0.0:1783071374.030991:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707564288 00000100:00100000:0.0:1783071374.031041:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1783071374.031049:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+19:10348:x1869685707564288:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783071374.031155:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+19:10348:x1869685707564288:12345-0@lo:502:llog_process_th.0 Request processed in 106us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071374.031162:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1783071374.031294:0:10348:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6aa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:10348:1869685707564288:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783071374.031316:0:10348:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783071374.031321:0:10348:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783071374.031322:0:10348:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1783071374.031327:0:10348:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:0.0:1783071374.031587:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1783071374.031612:0:6513:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1783071374.031624:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461400/0x6b58994c2cbdc032 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc039 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071374.031637:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461400/0x6b58994c2cbdc032 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc039 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783071374.031659:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783071374.031663:0:6513:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8f8b3447b000 from 48 10000000:01000000:0.0:1783071374.031666:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783071374.031697:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461e00/0x6b58994c2cbdc040 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071374.031706:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461e00/0x6b58994c2cbdc040 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071374.031716:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461e00/0x6b58994c2cbdc040 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071374.031743:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707564416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783071374.031775:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071374.031802:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b1edea3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783071374.031915:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707564416 00000100:00100000:1.0:1783071374.031921:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707564416 00000100:00100000:1.0:1783071374.031954:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1783071374.031962:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+19:6513:x1869685707564416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783071374.031974:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071374.031988:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8a01748400/0x6b58994c2cbdc047 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdc040 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071374.032012:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8a01748400/0x6b58994c2cbdc047 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdc040 expref: 20 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071374.032022:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8a01748400/0x6b58994c2cbdc047 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdc040 expref: 20 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071374.032032:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a01748400, rc 0) 00000100:00100000:1.0:1783071374.032071:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+20:6513:x1869685707564416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071374.032077:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1783071374.032318:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707564416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783071374.032334:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461e00/0x6b58994c2cbdc040 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc047 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071374.032343:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461e00/0x6b58994c2cbdc040 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdc047 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071374.032448:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707564544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783071374.032475:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071374.032485:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b1edea3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783071374.032539:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707564544 00000100:00100000:2.0:1783071374.032544:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707564544 00000100:00100000:2.0:1783071374.032570:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1783071374.032577:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+20:6513:x1869685707564544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783071374.032723:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+20:6513:x1869685707564544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 145us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071374.032739:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1783071374.032867:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707564544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783071374.032910:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707564672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783071374.032961:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071374.032991:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b1edea3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783071374.033041:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707564672 00000100:00100000:2.0:1783071374.033046:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707564672 00000100:00100000:2.0:1783071374.033077:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1783071374.033084:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+20:6513:x1869685707564672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783071374.033195:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+20:6513:x1869685707564672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 111us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071374.033203:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1783071374.033418:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707564672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783071374.034211:0:10349:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:10349:1869685707564800:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783071374.034276:0:10349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071374.034318:0:10349:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b1edea240 going to sleep for 11 seconds 00000100:00100000:2.0:1783071374.034876:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707564800 00000100:00100000:2.0:1783071374.034883:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707564800 00000100:00100000:2.0:1783071374.034944:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1783071374.034955:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+20:10349:x1869685707564800:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783071374.035101:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+20:10349:x1869685707564800:12345-0@lo:502:llog_process_th.0 Request processed in 148us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071374.035190:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1783071374.035274:0:10349:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:10349:1869685707564800:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783071374.035336:0:10349:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6aa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:10349:1869685707564928:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783071374.035565:0:10349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071374.035600:0:10349:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b419cdf00 going to sleep for 11 seconds 00000100:00100000:0.0:1783071374.039993:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707564928 00000100:00100000:0.0:1783071374.040016:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707564928 00000100:00100000:0.0:1783071374.040117:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1783071374.040131:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+20:10349:x1869685707564928:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783071374.040404:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+20:10349:x1869685707564928:12345-0@lo:502:llog_process_th.0 Request processed in 275us (4837us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071374.040414:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1783071374.040765:0:10349:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6aa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:10349:1869685707564928:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1783071374.040873:0:10349:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1783071374.041846:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1783071374.041875:0:6513:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783071374.041891:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461e00/0x6b58994c2cbdc040 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc047 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071374.041904:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461e00/0x6b58994c2cbdc040 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc047 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783071374.041916:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1783071374.041919:0:6513:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:0.0:1783071374.041922:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1783071374.041971:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461800/0x6b58994c2cbdc04e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071374.041981:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461800/0x6b58994c2cbdc04e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071374.042008:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461800/0x6b58994c2cbdc04e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071374.042037:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707565056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783071374.042168:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071374.042277:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b1edea480 going to sleep for 11 seconds 00000100:00100000:2.0:1783071374.044895:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707565056 00000100:00100000:2.0:1783071374.044914:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707565056 00000100:00100000:2.0:1783071374.045050:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1783071374.045063:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+20:6513:x1869685707565056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783071374.045084:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071374.045119:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b10967600/0x6b58994c2cbdc055 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdc04e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071374.045166:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b10967600/0x6b58994c2cbdc055 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdc04e expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071374.045179:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b10967600/0x6b58994c2cbdc055 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdc04e expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071374.045190:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b10967600, rc 0) 00000100:00100000:2.0:1783071374.045301:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+21:6513:x1869685707565056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 241us (3193us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071374.045329:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1783071374.045509:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707565056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783071374.045530:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461800/0x6b58994c2cbdc04e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc055 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071374.045540:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461800/0x6b58994c2cbdc04e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdc055 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071374.045653:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707565184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783071374.045693:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071374.046996:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b18027540 going to sleep for 11 seconds 00000100:00100000:0.0:1783071374.047427:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707565184 00000100:00100000:0.0:1783071374.047436:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707565184 00000100:00100000:0.0:1783071374.047491:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1783071374.047499:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+21:6513:x1869685707565184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783071374.047682:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+21:6513:x1869685707565184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 183us (1989us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071374.047690:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1783071374.048081:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707565184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783071374.048157:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707565312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783071374.048224:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071374.048250:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b18027540 going to sleep for 11 seconds 00000100:00100000:0.0:1783071374.048392:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707565312 00000100:00100000:0.0:1783071374.048398:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707565312 00000100:00100000:0.0:1783071374.048424:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1783071374.048431:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+21:6513:x1869685707565312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783071374.048530:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+21:6513:x1869685707565312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 98us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071374.048537:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1783071374.048637:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707565312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783071374.049314:0:10350:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6aa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:10350:1869685707565440:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783071374.049483:0:10350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071374.049554:0:10350:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b419cdd80 going to sleep for 11 seconds 00000100:00100000:0.0:1783071374.049589:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707565440 00000100:00100000:0.0:1783071374.049595:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707565440 00000100:00100000:0.0:1783071374.049676:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1783071374.049684:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+21:10350:x1869685707565440:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783071374.049910:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+21:10350:x1869685707565440:12345-0@lo:502:llog_process_th.0 Request processed in 225us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071374.049924:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1783071374.050016:0:10350:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6aa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:10350:1869685707565440:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783071374.050047:0:10350:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783071374.050058:0:10350:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783071374.050060:0:10350:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1783071374.050067:0:10350:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1783071374.050094:0:10350:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6aa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:10350:1869685707565568:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783071374.050194:0:10350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071374.050255:0:10350:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b419cdd80 going to sleep for 11 seconds 00000100:00100000:0.0:1783071374.050288:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707565568 00000100:00100000:0.0:1783071374.050292:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707565568 00000100:00100000:0.0:1783071374.050329:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1783071374.050336:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+21:10350:x1869685707565568:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783071374.050439:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+21:10350:x1869685707565568:12345-0@lo:502:llog_process_th.0 Request processed in 103us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071374.050446:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1783071374.050527:0:10350:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6aa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:10350:1869685707565568:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783071374.050546:0:10350:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783071374.050550:0:10350:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783071374.050552:0:10350:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1783071374.050555:0:10350:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:0.0:1783071374.050923:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:0.0:1783071374.050948:0:6513:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1783071374.050961:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461800/0x6b58994c2cbdc04e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc055 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071374.050974:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461800/0x6b58994c2cbdc04e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc055 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783071374.050986:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783071374.050989:0:6513:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8f8b10f7e000 from 48 10000000:01000000:0.0:1783071374.050992:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783071374.051025:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461a00/0x6b58994c2cbdc05c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071374.051034:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461a00/0x6b58994c2cbdc05c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071374.051045:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461a00/0x6b58994c2cbdc05c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071374.051065:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707565696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783071374.051176:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071374.051212:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b05e0b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783071374.051262:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707565696 00000100:00100000:1.0:1783071374.051267:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707565696 00000100:00100000:1.0:1783071374.051304:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1783071374.051312:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+21:6513:x1869685707565696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783071374.051323:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071374.051338:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8a01749800/0x6b58994c2cbdc063 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdc05c expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071374.051398:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8a01749800/0x6b58994c2cbdc063 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdc05c expref: 22 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071374.051410:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8a01749800/0x6b58994c2cbdc063 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdc05c expref: 22 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071374.051421:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a01749800, rc 0) 00000100:00100000:1.0:1783071374.051468:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+22:6513:x1869685707565696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071374.051474:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1783071374.051639:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707565696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783071374.051655:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461a00/0x6b58994c2cbdc05c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc063 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071374.051665:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461a00/0x6b58994c2cbdc05c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdc063 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071374.051793:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707565824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783071374.051825:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071374.051852:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b05e0b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783071374.051897:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707565824 00000100:00100000:1.0:1783071374.051901:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707565824 00000100:00100000:1.0:1783071374.051932:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1783071374.051939:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+22:6513:x1869685707565824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783071374.052069:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+22:6513:x1869685707565824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 130us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071374.052076:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1783071374.052242:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707565824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783071374.052280:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707565952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783071374.052323:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071374.052343:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b05e0b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783071374.052438:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707565952 00000100:00100000:1.0:1783071374.052443:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707565952 00000100:00100000:1.0:1783071374.052474:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1783071374.052482:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+22:6513:x1869685707565952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783071374.052561:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+22:6513:x1869685707565952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071374.052568:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1783071374.052652:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707565952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783071374.053496:0:10351:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c5adf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:10351:1869685707566080:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783071374.053560:0:10351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071374.053627:0:10351:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b1805a840 going to sleep for 11 seconds 00000100:00100000:1.0:1783071374.053668:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707566080 00000100:00100000:1.0:1783071374.053675:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707566080 00000100:00100000:1.0:1783071374.053826:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1783071374.053836:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+22:10351:x1869685707566080:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783071374.053962:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+22:10351:x1869685707566080:12345-0@lo:502:llog_process_th.0 Request processed in 127us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071374.053970:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1783071374.054048:0:10351:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c5adf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:10351:1869685707566080:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783071374.054092:0:10351:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c5adf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:10351:1869685707566208:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783071374.054136:0:10351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071374.054534:0:10351:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b1805a840 going to sleep for 11 seconds 00000100:00100000:3.0:1783071374.054620:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707566208 00000100:00100000:3.0:1783071374.054626:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707566208 00000100:00100000:3.0:1783071374.054657:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1783071374.054665:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+22:10351:x1869685707566208:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783071374.054832:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+22:10351:x1869685707566208:12345-0@lo:502:llog_process_th.0 Request processed in 168us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071374.054840:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1783071374.054922:0:10351:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c5adf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:10351:1869685707566208:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1783071374.054946:0:10351:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1783071374.055170:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1783071374.055200:0:6513:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783071374.055213:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461a00/0x6b58994c2cbdc05c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc063 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071374.055232:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461a00/0x6b58994c2cbdc05c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc063 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783071374.055244:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1783071374.055246:0:6513:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:3.0:1783071374.055250:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1783071374.055283:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8a00/0x6b58994c2cbdc06a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071374.055293:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8a00/0x6b58994c2cbdc06a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071374.055303:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8a00/0x6b58994c2cbdc06a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071374.055320:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707566336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783071374.055355:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071374.055404:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b180276c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783071374.055497:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707566336 00000100:00100000:2.0:1783071374.055502:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707566336 00000100:00100000:2.0:1783071374.055535:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1783071374.055543:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+22:6513:x1869685707566336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783071374.055554:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071374.055568:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b10966000/0x6b58994c2cbdc071 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdc06a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071374.055596:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b10966000/0x6b58994c2cbdc071 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdc06a expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071374.055608:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b10966000/0x6b58994c2cbdc071 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdc06a expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071374.055617:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b10966000, rc 0) 00000100:00100000:2.0:1783071374.055649:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+23:6513:x1869685707566336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071374.055661:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1783071374.055823:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707566336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783071374.055836:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8a00/0x6b58994c2cbdc06a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc071 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071374.055846:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8a00/0x6b58994c2cbdc06a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdc071 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071374.055903:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707566464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783071374.055931:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071374.055967:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b180276c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783071374.056016:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707566464 00000100:00100000:2.0:1783071374.056021:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707566464 00000100:00100000:2.0:1783071374.056082:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1783071374.056089:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+23:6513:x1869685707566464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783071374.056234:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+23:6513:x1869685707566464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 145us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071374.056241:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1783071374.056299:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707566464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783071374.056328:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707566592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783071374.056388:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071374.056544:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b180276c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783071374.056598:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707566592 00000100:00100000:0.0:1783071374.056603:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707566592 00000100:00100000:0.0:1783071374.056630:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1783071374.056637:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+23:6513:x1869685707566592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783071374.056743:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+23:6513:x1869685707566592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 106us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071374.056750:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1783071374.056881:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707566592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783071374.057297:0:10352:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:10352:1869685707566720:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783071374.057334:0:10352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071374.057354:0:10352:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b180279c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783071374.057425:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707566720 00000100:00100000:0.0:1783071374.057434:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707566720 00000100:00100000:0.0:1783071374.057453:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1783071374.057458:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+23:10352:x1869685707566720:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783071374.057539:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+23:10352:x1869685707566720:12345-0@lo:502:llog_process_th.0 Request processed in 80us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071374.057545:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1783071374.057607:0:10352:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:10352:1869685707566720:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783071374.057628:0:10352:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783071374.057638:0:10352:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071374.057641:0:10352:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1783071374.057648:0:10352:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1783071374.057669:0:10352:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:10352:1869685707566848:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783071374.057698:0:10352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071374.057725:0:10352:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b04ec2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783071374.057818:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707566848 00000100:00100000:0.0:1783071374.057822:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707566848 00000100:00100000:0.0:1783071374.057839:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1783071374.057844:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0d1cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+23:10352:x1869685707566848:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783071374.057908:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0d1cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+23:10352:x1869685707566848:12345-0@lo:502:llog_process_th.0 Request processed in 62us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071374.057914:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1783071374.057978:0:10352:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:10352:1869685707566848:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783071374.057995:0:10352:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783071374.057999:0:10352:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071374.058001:0:10352:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1783071374.058004:0:10352:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1783071374.058156:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:0.0:1783071374.058176:0:6513:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1783071374.058186:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8a00/0x6b58994c2cbdc06a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc071 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071374.058197:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8a00/0x6b58994c2cbdc06a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc071 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783071374.058208:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1783071374.058210:0:6513:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff8f8b06c74d40 from 1 10000000:01000000:0.0:1783071374.058213:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1783071374.058237:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460600/0x6b58994c2cbdc078 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071374.058245:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460600/0x6b58994c2cbdc078 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071374.058261:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460600/0x6b58994c2cbdc078 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071374.058275:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707566976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783071374.058302:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071374.058352:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b34e1ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783071374.058709:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707566976 00000100:00100000:2.0:1783071374.058715:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707566976 00000100:00100000:3.0:1783071374.058837:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1783071374.058903:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b13f99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+23:6513:x1869685707566976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783071374.058915:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071374.058931:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b3c461600/0x6b58994c2cbdc07f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdc078 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071374.058959:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b3c461600/0x6b58994c2cbdc07f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdc078 expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071374.058970:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b3c461600/0x6b58994c2cbdc07f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdc078 expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071374.058981:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b3c461600, rc 0) 00000100:00100000:0.0:1783071374.059025:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b13f99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+24:6513:x1869685707566976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 181us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071374.059031:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1783071374.059117:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707566976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783071374.059132:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460600/0x6b58994c2cbdc078 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc07f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071374.059158:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460600/0x6b58994c2cbdc078 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdc07f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071374.059215:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707567104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783071374.059242:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071374.059272:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b04ec2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783071374.059316:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707567104 00000100:00100000:0.0:1783071374.059320:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707567104 00000100:00100000:0.0:1783071374.059337:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1783071374.059343:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b02bf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+24:6513:x1869685707567104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783071374.059436:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b02bf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+24:6513:x1869685707567104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 93us (193us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783071374.059450:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1783071374.059522:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707567104:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1783071374.059544:0:6513:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1783071374.059550:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460600/0x6b58994c2cbdc078 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc07f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071374.059559:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460600/0x6b58994c2cbdc078 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc07f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071374.595098:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071375.125107:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071375.125167:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071375.125228:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071375.125266:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071375.125294:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071375.125325:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692830848 00000100:00100000:3.0:1783071375.125334:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692830848 00000100:00100000:3.0:1783071375.125445:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692830720 00000100:00100000:3.0:1783071375.125449:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692830720 00000100:00100000:3.0:1783071375.125474:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 56 00000100:00100000:3.0:1783071375.125485:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+5:2403:x1869685692830848:12345-192.168.204.38@tcp:400: 00000100:00100000:3.0:1783071375.125566:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+5:2403:x1869685692830848:12345-192.168.204.38@tcp:400: Request processed in 82us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071375.125588:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 56 00000100:00100000:3.0:1783071375.125606:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 57 00000100:00100000:3.0:1783071375.125612:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+6:2403:x1869685692830720:12345-192.168.204.38@tcp:400: 00000100:00100000:3.0:1783071375.125637:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+6:2403:x1869685692830720:12345-192.168.204.38@tcp:400: Request processed in 26us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071375.125643:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 57 00000100:00100000:3.0:1783071375.125663:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692831104 00000100:00100000:3.0:1783071375.125666:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692831104 00000100:00100000:3.0:1783071375.125694:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692830976 00000100:00100000:3.0:1783071375.125697:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692830976 00000100:00100000:3.0:1783071375.125717:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 20 00000100:00100000:3.0:1783071375.125723:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf7532e4-6153-424a-9f4e-84941256b41f+5:2403:x1869685692831104:12345-192.168.204.38@tcp:400: 00000100:00100000:3.0:1783071375.125749:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf7532e4-6153-424a-9f4e-84941256b41f+5:2403:x1869685692831104:12345-192.168.204.38@tcp:400: Request processed in 26us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071375.125755:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 20 00000100:00100000:3.0:1783071375.125765:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 21 00000100:00100000:3.0:1783071375.125771:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf7532e4-6153-424a-9f4e-84941256b41f+5:2403:x1869685692830976:12345-192.168.204.38@tcp:400: 00000100:00100000:3.0:1783071375.125790:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf7532e4-6153-424a-9f4e-84941256b41f+5:2403:x1869685692830976:12345-192.168.204.38@tcp:400: Request processed in 20us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071375.125796:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 21 00000100:00080000:2.0:1783071375.127310:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783071375.127319:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783071375.127322:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783071375.127326:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783071375.127342:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692830592 00000100:00100000:2.0:1783071375.127349:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692830592 00000100:00100000:2.0:1783071375.127447:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 240 00000100:00100000:2.0:1783071375.127456:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b06199c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e4e7df8-beb0-40df-a2a1-9decaa005633+8:2403:x1869685692830592:12345-192.168.204.38@tcp:400: 00000100:00100000:2.0:1783071375.127537:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b06199c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e4e7df8-beb0-40df-a2a1-9decaa005633+8:2403:x1869685692830592:12345-192.168.204.38@tcp:400: Request processed in 82us (2441us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071375.127545:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 240 00010000:00010000:3.0:1783071375.619159:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071376.642732:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071377.219485:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c5adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707567232:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783071377.219597:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071377.219616:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707567616:0@lo:400:kworker.0 00000100:00100000:1.0:1783071377.219688:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869685707567744:0@lo:400:kworker.0 00000100:00100000:0.0:1783071377.219704:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071377.219767:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869685707567488:0@lo:400:kworker.0 00000100:00100000:2.0:1783071377.219790:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:feaa1501-b927-4e07-baad-3200e92d7497:3647:1869685707567360:0@lo:400:kworker.0 00000100:00100000:0.0:1783071377.223423:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1869685707568128:0@lo:400:kworker.0 00000100:00100000:2.0:1783071377.223750:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071377.223796:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707567872:0@lo:400:kworker.0 00000100:00100000:2.0:1783071377.223830:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071377.223851:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707568384:0@lo:400:kworker.0 00000100:00100000:2.0:1783071377.223890:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071377.223912:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c668700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707568896:0@lo:400:kworker.0 00000100:00100000:2.0:1783071377.223933:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071377.223982:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707568384 00000100:00100000:2.0:1783071377.224140:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707568384 00000100:00100000:2.0:1783071377.224215:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707568896 00000100:00100000:2.0:1783071377.224220:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707568896 00000100:00100000:2.0:1783071377.224245:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783071377.224254:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c5ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707568384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071377.224326:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c5ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707568384:12345-0@lo:400:kworker.0 Request processed in 72us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071377.224334:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783071377.224351:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783071377.224357:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c5aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707568896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071377.224406:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c5aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707568896:12345-0@lo:400:kworker.0 Request processed in 49us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071377.224412:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1783071377.224436:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783071377.224441:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783071377.224487:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c78ea00 x1869685707568384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071377.224502:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707568384:0@lo:400:kworker.0 00010000:00080000:2.0:1783071377.224515:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c668700 x1869685707568896/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071377.224523:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c668700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707568896:0@lo:400:kworker.0 00000100:00100000:2.0:1783071377.224566:0:9413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707567232 00000100:00100000:2.0:1783071377.224576:0:9413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707567232 00000100:00100000:2.0:1783071377.224594:0:9413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707567616 00000100:00100000:2.0:1783071377.224597:0:9413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707567616 00000100:00100000:2.0:1783071377.224604:0:9413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707567872 00000100:00100000:2.0:1783071377.224607:0:9413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707567872 00000100:00100000:2.0:1783071377.224618:0:9413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783071377.224623:0:9413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3646:x1869685707567232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783071377.224651:0:9413:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1783071377.224686:0:9413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3646:x1869685707567232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 62us (5090us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071377.224693:0:9413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783071377.224705:0:9413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783071377.224710:0:9413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c66b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707567616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071377.224739:0:9413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c66b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707567616:12345-0@lo:400:kworker.0 Request processed in 29us (5040us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071377.224745:0:9413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783071377.224755:0:9413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783071377.224760:0:9413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c5af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707567872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071377.224790:0:9413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c5af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707567872:12345-0@lo:400:kworker.0 Request processed in 30us (958us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071377.224796:0:9413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783071377.224818:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707567872:0@lo:400:kworker.0 00000100:00100000:2.0:1783071377.224860:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707567360 00000100:00100000:2.0:1783071377.224863:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707567360 00000100:00100000:2.0:1783071377.224886:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1783071377.224892:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b06198c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+24:3647:x1869685707567360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071377.224925:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b06198c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+24:3647:x1869685707567360:12345-0@lo:400:kworker.0 Request processed in 33us (1176us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071377.224936:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1783071377.224969:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:feaa1501-b927-4e07-baad-3200e92d7497:3647:1869685707567360:0@lo:400:kworker.0 00000100:00100000:1.0:1783071377.226044:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071377.226140:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707568256:0@lo:400:kworker.0 00000100:00100000:1.0:1783071377.226203:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071377.226245:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707568256 00000100:00100000:1.0:1783071377.226252:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707568256 00000100:00100000:1.0:1783071377.226320:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783071377.226329:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707568256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071377.226401:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707568256:12345-0@lo:400:kworker.0 Request processed in 73us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071377.226410:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1783071377.226436:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783071377.226633:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707567744 00000100:00100000:2.0:1783071377.226644:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707567744 00000100:00100000:2.0:1783071377.226692:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783071377.226698:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869685707567744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071377.226764:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869685707567744:12345-0@lo:400:kworker.0 Request processed in 66us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071377.226770:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783071377.227711:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071377.227746:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c66ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1869685707568640:0@lo:400:kworker.0 00000100:00100000:0.0:1783071377.227774:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071377.227818:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707567616:0@lo:400:kworker.0 00000100:00100000:0.0:1783071377.227852:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707568128 00000100:00100000:0.0:1783071377.227856:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707568128 00000100:00100000:0.0:1783071377.227901:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707568640 00000100:00100000:0.0:1783071377.227906:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707568640 00010000:00080000:1.0:1783071377.227949:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c78fb80 x1869685707568256/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071377.227969:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707568256:0@lo:400:kworker.0 00000100:00100000:1.0:1783071377.227979:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c669c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707568768:0@lo:400:kworker.0 00000100:00100000:1.0:1783071377.228020:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071377.228053:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707568768 00000100:00100000:1.0:1783071377.228074:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707568768 00000100:00100000:1.0:1783071377.228131:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783071377.228138:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707568768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071377.228188:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707568768:12345-0@lo:400:kworker.0 Request processed in 50us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071377.228195:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1783071377.228340:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c669c00 x1869685707568768/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071377.228350:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c669c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707568768:0@lo:400:kworker.0 00000100:00100000:1.0:1783071377.228389:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c5adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707567232:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783071377.228428:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869685707567744:0@lo:400:kworker.0 00000100:00080000:1.0:1783071377.228769:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783071377.228776:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783071377.230417:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783071377.230447:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c668e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1869685707568128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071377.230541:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783071377.230553:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c66b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1869685707568640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071377.230641:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c66b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1869685707568640:12345-0@lo:400:kworker.0 Request processed in 90us (2865us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071377.230649:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:0.0:1783071377.230710:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c66ad80 x1869685707568640/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071377.230725:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c66ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1869685707568640:0@lo:400:kworker.0 00000100:00100000:2.0:1783071377.230876:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c668e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1869685707568128:12345-0@lo:400:kworker.0 Request processed in 445us (3168us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071377.230884:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:0.0:1783071377.231187:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c78df80 x1869685707568128/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071377.231217:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1869685707568128:0@lo:400:kworker.0 00000100:00100000:3.0:1783071377.232358:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071377.232455:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1869685707568000:0@lo:400:kworker.0 00000100:00100000:3.0:1783071377.232531:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071377.232558:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1869685707568512:0@lo:400:kworker.0 00000100:00100000:3.0:1783071377.232578:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071377.232647:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707567488 00000100:00100000:0.0:1783071377.232660:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707567488 00000100:00100000:0.0:1783071377.232778:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707568000 00000100:00100000:0.0:1783071377.232783:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707568000 00000100:00100000:2.0:1783071377.236172:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707568512 00000100:00100000:2.0:1783071377.236187:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707568512 00000100:00100000:2.0:1783071377.236247:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783071377.236258:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869685707567488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071377.236453:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869685707567488:12345-0@lo:400:kworker.0 Request processed in 196us (4104us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071377.236461:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783071377.236496:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1783071377.236505:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869685707568000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071377.236569:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869685707568000:12345-0@lo:400:kworker.0 Request processed in 66us (4037us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071377.236586:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1783071377.236598:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1783071377.236604:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869685707568512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071377.236632:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869685707568512:12345-0@lo:400:kworker.0 Request processed in 29us (4053us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071377.236637:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1783071377.236704:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869685707567488:0@lo:400:kworker.0 00000100:00100000:2.0:1783071377.236716:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1869685707568000:0@lo:400:kworker.0 00000100:00100000:2.0:1783071377.236726:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1869685707568512:0@lo:400:kworker.0 00000100:00080000:2.0:1783071377.236766:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783071377.666771:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071377.731158:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c66ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707569024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783071377.731271:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071377.731552:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707569024 00000100:00100000:0.0:1783071377.731564:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707569024 00000100:00100000:0.0:1783071377.731633:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783071377.731644:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707569024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783071377.731687:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783071377.731753:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707569024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071377.731761:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783071377.731846:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c66a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707569152:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783071377.731884:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1783071377.731924:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c66ad80 x1869685707569024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071393 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071377.731928:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707569152 00000100:00100000:0.0:1783071377.731934:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707569152 00000100:00100000:2.0:1783071377.731961:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c66ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707569024:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783071377.731982:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783071377.731991:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c66b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707569152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783071377.732016:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783071377.732062:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c66b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707569152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071377.732069:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783071377.732153:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707569280:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783071377.732232:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071377.732331:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707569408:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1783071377.733062:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c66a680 x1869685707569152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071393 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071377.733918:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c66a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707569152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783071377.734394:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071377.736463:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707569280 00000100:00100000:0.0:1783071377.736504:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707569280 00000100:00100000:0.0:1783071377.736616:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783071377.736629:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707569280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783071377.736665:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783071377.736788:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707569280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 161us (4556us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071377.736795:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1783071377.736917:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c6a8700 x1869685707569280/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071393 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071377.736945:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707569280:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783071377.737395:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707569408 00000100:00100000:0.0:1783071377.737403:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707569408 00000100:00100000:0.0:1783071377.737447:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783071377.737455:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707569408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783071377.737474:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783071377.737529:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707569408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (3166us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071377.737535:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1783071377.737614:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c6a3b80 x1869685707569408/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071393 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071377.737635:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707569408:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783071378.194612:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071378.194880:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692831232 00000100:00100000:0.0:1783071378.194895:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692831232 00000100:00100000:0.0:1783071378.194975:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 242 00000100:00100000:0.0:1783071378.194987:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18686850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e4e7df8-beb0-40df-a2a1-9decaa005633+8:6172:x1869685692831232:12345-192.168.204.38@tcp:101: 00010000:00010000:0.0:1783071378.195011:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071378.195035:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b3c460e00/0x6b58994c2cbdc086 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98c99 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071378.195083:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b3c460e00/0x6b58994c2cbdc086 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98c99 expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071378.195096:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b3c460e00/0x6b58994c2cbdc086 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98c99 expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071378.195129:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b3c460e00, rc 0) 00000100:00100000:0.0:1783071378.195215:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18686850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e4e7df8-beb0-40df-a2a1-9decaa005633+9:6172:x1869685692831232:12345-192.168.204.38@tcp:101: Request processed in 230us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071378.195223:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 242 00000100:00100000:3.0:1783071378.199225:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071378.199453:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692831360 00000100:00100000:2.0:1783071378.199464:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692831360 00000100:00100000:2.0:1783071378.199532:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 243 00000100:00100000:2.0:1783071378.199557:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18684050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e4e7df8-beb0-40df-a2a1-9decaa005633+9:6172:x1869685692831360:12345-192.168.204.38@tcp:501: 00000100:00100000:2.0:1783071378.199769:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18684050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e4e7df8-beb0-40df-a2a1-9decaa005633+9:6172:x1869685692831360:12345-192.168.204.38@tcp:501: Request processed in 213us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071378.199778:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 243 00000100:00100000:3.0:1783071378.204403:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071378.204748:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692831488 00000100:00100000:2.0:1783071378.204759:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692831488 00000100:00100000:2.0:1783071378.204825:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 244 00000100:00100000:2.0:1783071378.204837:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18684450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e4e7df8-beb0-40df-a2a1-9decaa005633+9:6172:x1869685692831488:12345-192.168.204.38@tcp:503: 00000100:00100000:2.0:1783071378.205014:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18684450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e4e7df8-beb0-40df-a2a1-9decaa005633+9:6172:x1869685692831488:12345-192.168.204.38@tcp:503: Request processed in 178us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071378.205022:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 244 00000100:00100000:3.0:1783071378.218010:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071378.218130:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692831616 00000100:00100000:0.0:1783071378.218147:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692831616 00000100:00100000:0.0:1783071378.218204:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 245 00000100:00100000:0.0:1783071378.218213:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18687050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e4e7df8-beb0-40df-a2a1-9decaa005633+9:6671:x1869685692831616:12345-192.168.204.38@tcp:502: 00000100:00100000:0.0:1783071378.218406:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18687050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e4e7df8-beb0-40df-a2a1-9decaa005633+9:6671:x1869685692831616:12345-192.168.204.38@tcp:502: Request processed in 192us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071378.218415:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 245 00000100:00100000:1.0:1783071378.221413:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071378.221796:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692831744 00000100:00100000:0.0:1783071378.221809:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692831744 00000100:00100000:0.0:1783071378.221895:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 246 00000100:00100000:0.0:1783071378.221906:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18686450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e4e7df8-beb0-40df-a2a1-9decaa005633+9:6671:x1869685692831744:12345-192.168.204.38@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783071378.222114:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18686450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e4e7df8-beb0-40df-a2a1-9decaa005633+9:6671:x1869685692831744:12345-192.168.204.38@tcp:502:llog_process_th.0 Request processed in 209us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071378.222124:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 246 00000100:00100000:3.0:1783071378.226939:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071378.227480:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692831872 00000100:00100000:2.0:1783071378.227491:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692831872 00000100:00100000:2.0:1783071378.227548:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 247 00000100:00100000:2.0:1783071378.227557:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18685c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e4e7df8-beb0-40df-a2a1-9decaa005633+9:6172:x1869685692831872:12345-192.168.204.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783071378.227573:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071378.227592:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b10966e00/0x6b58994c2cbdc08d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98ca0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071378.227620:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b10966e00/0x6b58994c2cbdc08d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ca0 expref: 10 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071378.227632:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b10966e00/0x6b58994c2cbdc08d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ca0 expref: 10 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071378.227643:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b10966e00, rc 0) 00000100:00100000:2.0:1783071378.227714:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18685c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e4e7df8-beb0-40df-a2a1-9decaa005633+10:6172:x1869685692831872:12345-192.168.204.38@tcp:101:ll_cfg_requeue.0 Request processed in 157us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071378.227733:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 247 00000100:00100000:3.0:1783071378.235687:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071378.235814:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692832000 00000100:00100000:0.0:1783071378.235827:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692832000 00000100:00100000:0.0:1783071378.235901:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 248 00000100:00100000:0.0:1783071378.235913:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18686050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e4e7df8-beb0-40df-a2a1-9decaa005633+10:6172:x1869685692832000:12345-192.168.204.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783071378.236081:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18686050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e4e7df8-beb0-40df-a2a1-9decaa005633+10:6172:x1869685692832000:12345-192.168.204.38@tcp:501:ll_cfg_requeue.0 Request processed in 169us (408us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783071378.236116:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 248 00010000:00010000:3.0:1783071378.696549:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071378.757936:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707569536:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783071378.758036:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071378.758163:0:9413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707569536 00000100:00100000:3.0:1783071378.758173:0:9413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707569536 00000100:00100000:3.0:1783071378.758239:0:9413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1783071378.758249:0:9413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707569536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783071378.758299:0:9413:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783071378.758353:0:9413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707569536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071378.758583:0:9413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1783071378.758646:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707569536:0@lo:41:osp-pre-1-0.0 00000020:00000080:3.0:1783071379.285159:0:10390:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff4dc1cab0 20000000:00000080:3.0:1783071379.285185:0:10390:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f8b3c6a4400 uarg=0000000000000000 20000000:01000000:3.0:1783071379.285246:0:10390:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1783071379.285254:0:10390:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1783071379.285260:0:10390:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1783071379.286195:0:10391:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1783071379.286621:0:10390:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1783071379.292865:0:10390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1783071379.292913:0:10390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1783071379.292928:0:10390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1783071379.292948:0:10390:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1783071379.292976:0:10390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f8b10967200/0x6b58994c2cbdc094 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071379.292999:0:10390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8b10966c00/0x6b58994c2cbdbd30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbd29 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071379.293007:0:10390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8b10967400/0x6b58994c2cbdbd3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbd37 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071379.293014:0:10390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8b3c460400/0x6b58994c2cbdbd92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbd8b expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071379.293020:0:10390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8b421d9000/0x6b58994c2cbdbeb8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdbeb1 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071379.293031:0:10390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8b10967a00/0x6b58994c2cbdbfd0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98c61 expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071379.293039:0:10390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f8b10967200/0x6b58994c2cbdc094 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071379.293112:0:10390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8b10967a00/0x6b58994c2cbdbfd0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98c61 expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071379.293229:0:10390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f8b10967a00/0x6b58994c2cbdbfd0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98c61 expref: 9 pid: 6510 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071379.293251:0:10390:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c5ad880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1869685707569664:192.168.204.38@tcp:104: 00010000:00010000:2.0:1783071379.293674:0:10390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8b421d9000/0x6b58994c2cbdbeb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6b58994c2cbdbeb1 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071379.293683:0:10390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8b421d9000/0x6b58994c2cbdbeb8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6b58994c2cbdbeb1 expref: 23 pid: 6510 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071379.293694:0:10390:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c5adf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1869685707569792:0@lo:104: 00000100:00100000:2.0:1783071379.293747:0:10390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783071379.293797:0:10390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8b3c460400/0x6b58994c2cbdbd92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6b58994c2cbdbd8b expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071379.293805:0:10390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8b3c460400/0x6b58994c2cbdbd92 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6b58994c2cbdbd8b expref: 23 pid: 6510 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071379.293814:0:10390:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c5ac380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1869685707569920:0@lo:104: 00000100:00100000:2.0:1783071379.293841:0:10390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783071379.293864:0:10390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8b10967400/0x6b58994c2cbdbd3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6b58994c2cbdbd37 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071379.293872:0:10390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8b10967400/0x6b58994c2cbdbd3e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6b58994c2cbdbd37 expref: 23 pid: 6508 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071379.293880:0:10390:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c5ac700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1869685707570048:0@lo:104: 00010000:00010000:2.0:1783071379.293904:0:10390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8b10966c00/0x6b58994c2cbdbd30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6b58994c2cbdbd29 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071379.293922:0:10390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8b10966c00/0x6b58994c2cbdbd30 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6b58994c2cbdbd29 expref: 23 pid: 6510 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071379.293930:0:10390:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c5ad500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1869685707570176:0@lo:104: 00000100:00100000:2.0:1783071379.293955:0:10390:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b064efa80 going to sleep for 11 seconds 00000100:00100000:0.0:1783071379.294135:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1783071379.294157:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071379.294169:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071379.294179:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707569792 00000100:00100000:0.0:1783071379.294188:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707569792 00000100:00100000:0.0:1783071379.294237:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707569920 00000100:00100000:0.0:1783071379.294239:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707569920 00000100:00100000:0.0:1783071379.294248:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707570048 00000100:00100000:0.0:1783071379.294250:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707570048 00000100:00100000:0.0:1783071379.294259:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707570176 00000100:00100000:0.0:1783071379.294261:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707570176 00000100:00100000:0.0:1783071379.294275:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783071379.294285:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c5ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:feaa1501-b927-4e07-baad-3200e92d7497+6:10390:x1869685707569792:12345-0@lo:104: 00010000:00010000:0.0:1783071379.294299:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460200/0x6b58994c2cbdbeb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbeb8 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071379.294388:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783071379.294395:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c5ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:feaa1501-b927-4e07-baad-3200e92d7497+6:10390:x1869685707569792:12345-0@lo:104: Request processed in 111us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071379.294402:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783071379.294425:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783071379.294431:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03150850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:feaa1501-b927-4e07-baad-3200e92d7497+5:10390:x1869685707569920:12345-0@lo:104: 00010000:00010000:0.0:1783071379.294440:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9c00/0x6b58994c2cbdbd8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbd92 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071379.294639:0:10390:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c5adf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1869685707569792:0@lo:104: 00010000:00010000:3.0:1783071379.294704:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783071379.294713:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460200/0x6b58994c2cbdbeb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbeb8 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071379.294721:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b3c460200 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:3.0:1783071379.294726:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460200/0x6b58994c2cbdbeb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x6b58994c2cbdbeb8 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071379.294736:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460200/0x6b58994c2cbdbeb1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x6b58994c2cbdbeb8 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783071379.294744:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460200/0x6b58994c2cbdbeb1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x6b58994c2cbdbeb8 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783071379.294749:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783071379.294793:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460200/0x6b58994c2cbdbeb1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbeb8 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071379.294801:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783071379.294826:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460200/0x6b58994c2cbdbeb1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbeb8 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071379.294849:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460200/0x6b58994c2cbdbeb1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbeb8 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071379.294864:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071379.294865:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071379.294867:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071379.294881:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:feaa1501-b927-4e07-baad-3200e92d7497:3645:1869685707570304:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783071379.300696:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783071379.300719:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03150850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:feaa1501-b927-4e07-baad-3200e92d7497+5:10390:x1869685707569920:12345-0@lo:104: Request processed in 6280us (6869us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071379.300752:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783071379.300832:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783071379.300844:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c668000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:feaa1501-b927-4e07-baad-3200e92d7497+4:10390:x1869685707570048:12345-0@lo:104: 00010000:00010000:0.0:1783071379.300867:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9a00/0x6b58994c2cbdbd37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbd3e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071379.300921:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783071379.300926:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c668000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:feaa1501-b927-4e07-baad-3200e92d7497+4:10390:x1869685707570048:12345-0@lo:104: Request processed in 87us (6769us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071379.300932:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783071379.300943:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783071379.300949:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c668a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:feaa1501-b927-4e07-baad-3200e92d7497+3:10390:x1869685707570176:12345-0@lo:104: 00010000:00010000:0.0:1783071379.300957:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8200/0x6b58994c2cbdbd29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbd30 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071379.300979:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1783071379.300983:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c668a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:feaa1501-b927-4e07-baad-3200e92d7497+3:10390:x1869685707570176:12345-0@lo:104: Request processed in 34us (6813us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071379.300989:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:0.0:1783071379.301014:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783071379.301021:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9c00/0x6b58994c2cbdbd8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbd92 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071379.301030:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b421d9c00 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:0.0:1783071379.301034:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9c00/0x6b58994c2cbdbd8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6b58994c2cbdbd92 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071379.301067:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9c00/0x6b58994c2cbdbd8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6b58994c2cbdbd92 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783071379.301075:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9c00/0x6b58994c2cbdbd8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6b58994c2cbdbd92 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783071379.301081:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783071379.301129:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9c00/0x6b58994c2cbdbd8b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbd92 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071379.301136:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783071379.301157:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9c00/0x6b58994c2cbdbd8b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbd92 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071379.301165:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9c00/0x6b58994c2cbdbd8b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbd92 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071379.301182:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783071379.301184:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9a00/0x6b58994c2cbdbd37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbd3e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071379.301189:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b421d9a00 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:0.0:1783071379.301192:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9a00/0x6b58994c2cbdbd37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6b58994c2cbdbd3e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071379.301199:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9a00/0x6b58994c2cbdbd37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6b58994c2cbdbd3e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783071379.301205:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9a00/0x6b58994c2cbdbd37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6b58994c2cbdbd3e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783071379.301215:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783071379.301227:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9a00/0x6b58994c2cbdbd37 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbd3e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071379.301233:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783071379.301248:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9a00/0x6b58994c2cbdbd37 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbd3e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071379.301255:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8b421d9a00/0x6b58994c2cbdbd37 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbd3e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071379.301263:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783071379.301266:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8200/0x6b58994c2cbdbd29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdbd30 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071379.301271:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b014b8200 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:0.0:1783071379.301273:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8200/0x6b58994c2cbdbd29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6b58994c2cbdbd30 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071379.301280:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8200/0x6b58994c2cbdbd29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6b58994c2cbdbd30 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783071379.301286:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8200/0x6b58994c2cbdbd29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6b58994c2cbdbd30 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783071379.301291:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783071379.301299:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8200/0x6b58994c2cbdbd29 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbd30 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071379.301304:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783071379.301313:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8200/0x6b58994c2cbdbd29 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbd30 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071379.301320:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8200/0x6b58994c2cbdbd29 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdbd30 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071379.301334:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071379.301336:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071379.301337:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071379.301354:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c66a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:feaa1501-b927-4e07-baad-3200e92d7497:3647:1869685707570560:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783071379.301423:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071379.301467:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783071379.301472:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c66bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:feaa1501-b927-4e07-baad-3200e92d7497:3647:1869685707570688:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783071379.301490:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071379.301522:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707570560 00000100:00100000:0.0:1783071379.301532:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707570560 00010000:00010000:0.0:1783071379.301564:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8b10967400/0x6b58994c2cbdbd3e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbd37 expref: 24 pid: 6508 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071379.301591:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707570688 00000100:00100000:0.0:1783071379.301593:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707570688 00010000:00010000:0.0:1783071379.301602:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8b10966c00/0x6b58994c2cbdbd30 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbd29 expref: 25 pid: 6510 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071379.301617:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783071379.301623:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c669880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:feaa1501-b927-4e07-baad-3200e92d7497+25:3647:x1869685707570560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783071379.301635:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071379.301640:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8b10967400/0x6b58994c2cbdbd3e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbd37 expref: 25 pid: 6508 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071379.301661:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8b10967400/0x6b58994c2cbdbd3e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6b58994c2cbdbd37 expref: 25 pid: 6508 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071379.301683:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071379.301708:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c669880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:feaa1501-b927-4e07-baad-3200e92d7497+25:3647:x1869685707570560:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071379.301715:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783071379.301728:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783071379.301733:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c66aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:feaa1501-b927-4e07-baad-3200e92d7497+24:3647:x1869685707570688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783071379.301740:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071379.301744:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8b10966c00/0x6b58994c2cbdbd30 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbd29 expref: 24 pid: 6510 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071379.301752:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8b10966c00/0x6b58994c2cbdbd30 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6b58994c2cbdbd29 expref: 24 pid: 6510 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071379.301760:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071379.301775:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c66aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:feaa1501-b927-4e07-baad-3200e92d7497+24:3647:x1869685707570688:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071379.301781:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783071379.301805:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c669180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:feaa1501-b927-4e07-baad-3200e92d7497:3646:1869685707570432:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783071379.301825:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071379.301864:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c66bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:feaa1501-b927-4e07-baad-3200e92d7497:3647:1869685707570688:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783071379.301872:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c66a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:feaa1501-b927-4e07-baad-3200e92d7497:3647:1869685707570560:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783071379.301894:0:7923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707570432 00000100:00100000:0.0:1783071379.301897:0:7923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707570432 00010000:00010000:0.0:1783071379.301913:0:7923:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8b3c460400/0x6b58994c2cbdbd92 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbd8b expref: 24 pid: 6510 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071379.301931:0:7923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783071379.301936:0:7923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c668380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:feaa1501-b927-4e07-baad-3200e92d7497+24:3646:x1869685707570432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783071379.301942:0:7923:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071379.301946:0:7923:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8b3c460400/0x6b58994c2cbdbd92 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbd8b expref: 24 pid: 6510 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071379.301954:0:7923:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8b3c460400/0x6b58994c2cbdbd92 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6b58994c2cbdbd8b expref: 24 pid: 6510 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071379.301963:0:7923:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071379.301985:0:7923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c668380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:feaa1501-b927-4e07-baad-3200e92d7497+24:3646:x1869685707570432:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071379.301991:0:7923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783071379.302010:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c669180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:feaa1501-b927-4e07-baad-3200e92d7497:3646:1869685707570432:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783071379.302022:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071379.302917:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071379.303855:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707570304 00000100:00100000:0.0:1783071379.303868:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707570304 00010000:00010000:0.0:1783071379.303912:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8b421d9000/0x6b58994c2cbdbeb8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbeb1 expref: 24 pid: 6510 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071379.303939:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071379.303946:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783071379.303953:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:feaa1501-b927-4e07-baad-3200e92d7497+24:3645:x1869685707570304:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783071379.303970:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692832128 00010000:00010000:0.0:1783071379.303971:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1783071379.303973:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692832128 00010000:00010000:0.0:1783071379.303976:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8b421d9000/0x6b58994c2cbdbeb8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdbeb1 expref: 24 pid: 6510 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071379.303991:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8b10967a00/0x6b58994c2cbdbfd0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98c61 expref: 10 pid: 6510 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071379.304008:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8b421d9000/0x6b58994c2cbdbeb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6b58994c2cbdbeb1 expref: 24 pid: 6510 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071379.304010:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 39 00000100:00100000:1.0:1783071379.304016:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e4e7df8-beb0-40df-a2a1-9decaa005633+10:2406:x1869685692832128:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783071379.304024:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071379.304027:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8b10967a00/0x6b58994c2cbdbfd0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98c61 expref: 10 pid: 6510 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071379.304029:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b421d9000/0x6b58994c2cbdbeb8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6b58994c2cbdbeb1 expref: 24 pid: 6510 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071379.304056:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8b10967a00/0x6b58994c2cbdbfd0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98c61 expref: 10 pid: 6510 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071379.304066:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071379.304123:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:feaa1501-b927-4e07-baad-3200e92d7497+23:3645:x1869685707570304:12345-0@lo:103:ldlm_bl.0 Request processed in 170us (1210us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071379.304131:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783071379.304133:0:10390:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c5ad880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1869685707569664:192.168.204.38@tcp:104: 00010000:00010000:3.0:1783071379.304146:0:10390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b3c460400/0x6b58994c2cbdbd92 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6b58994c2cbdbd8b expref: 22 pid: 6510 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071379.304156:0:10390:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c5ac380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1869685707569920:0@lo:104: 00010000:00010000:3.0:1783071379.304165:0:10390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b10967400/0x6b58994c2cbdbd3e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6b58994c2cbdbd37 expref: 21 pid: 6508 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071379.304173:0:10390:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c5ac700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1869685707570048:0@lo:104: 00010000:00010000:3.0:1783071379.304183:0:10390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b10966c00/0x6b58994c2cbdbd30 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6b58994c2cbdbd29 expref: 20 pid: 6510 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071379.304191:0:10390:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c5ad500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1869685707570176:0@lo:104: 00000100:00100000:0.0:1783071379.304198:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:feaa1501-b927-4e07-baad-3200e92d7497:3645:1869685707570304:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783071379.304662:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b10967a00/0x6b58994c2cbdbfd0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98c61 expref: 10 pid: 6510 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071379.304679:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f8b10967200/0x6b58994c2cbdc094 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071379.304689:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b10967200/0x6b58994c2cbdc094 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071379.304709:0:6501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f8b10967200/0x6b58994c2cbdc094 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071379.304718:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f8b10967200/0x6b58994c2cbdc094 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071379.304725:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f8b10967200/0x6b58994c2cbdc094 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071379.304732:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f8b10967200/0x6b58994c2cbdc094 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071379.304739:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b10967200 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:1.0:1783071379.304744:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f8b10967200/0x6b58994c2cbdc094 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071379.304753:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f8b10967200/0x6b58994c2cbdc094 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071379.304775:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f8b10967200/0x6b58994c2cbdc094 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071379.304787:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071379.304883:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e4e7df8-beb0-40df-a2a1-9decaa005633+9:2406:x1869685692832128:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 865us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071379.304890:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 39 00010000:00010000:3.0:1783071379.305112:0:10390:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f8b10967200/0x6b58994c2cbdc094 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071379.306478:0:10390:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f8b10967200/0x6b58994c2cbdc094 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071379.306494:0:10390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f8b10967200/0x6b58994c2cbdc094 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071379.306502:0:10390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b10967200/0x6b58994c2cbdc094 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071379.715737:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071380.053468:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071380.053561:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692832256 00000100:00100000:0.0:1783071380.053572:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692832256 00000100:00100000:0.0:1783071380.053642:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 249 00000100:00100000:0.0:1783071380.053652:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18687c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e4e7df8-beb0-40df-a2a1-9decaa005633+9:6172:x1869685692832256:12345-192.168.204.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783071380.053670:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071380.053691:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b3c460200/0x6b58994c2cbdc09b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98ca7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071380.053743:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b3c460200/0x6b58994c2cbdc09b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ca7 expref: 10 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071380.053755:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b3c460200/0x6b58994c2cbdc09b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ca7 expref: 10 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071380.053764:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b3c460200, rc 0) 00000100:00100000:0.0:1783071380.053830:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18687c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e4e7df8-beb0-40df-a2a1-9decaa005633+10:6172:x1869685692832256:12345-192.168.204.38@tcp:101:ll_cfg_requeue.0 Request processed in 179us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071380.053837:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 249 00000100:00100000:1.0:1783071380.065427:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071380.065532:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692832384 00000100:00100000:2.0:1783071380.065542:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692832384 00000100:00100000:2.0:1783071380.065600:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 250 00000100:00100000:2.0:1783071380.065612:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18685450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e4e7df8-beb0-40df-a2a1-9decaa005633+10:6172:x1869685692832384:12345-192.168.204.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783071380.066043:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18685450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e4e7df8-beb0-40df-a2a1-9decaa005633+10:6172:x1869685692832384:12345-192.168.204.38@tcp:501:ll_cfg_requeue.0 Request processed in 432us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071380.066052:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 250 00000100:00100000:0.0:1783071380.069830:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071380.069976:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692832512 00000100:00100000:2.0:1783071380.069986:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692832512 00000100:00100000:2.0:1783071380.070094:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 251 00000100:00100000:2.0:1783071380.070105:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18687450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e4e7df8-beb0-40df-a2a1-9decaa005633+10:6172:x1869685692832512:12345-192.168.204.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783071380.070275:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18687450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e4e7df8-beb0-40df-a2a1-9decaa005633+10:6172:x1869685692832512:12345-192.168.204.38@tcp:503:ll_cfg_requeue.0 Request processed in 171us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071380.070283:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 251 00000100:00100000:3.0:1783071380.074962:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071380.075060:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692832640 00000100:00100000:2.0:1783071380.075071:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692832640 00000100:00100000:2.0:1783071380.075141:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 252 00000100:00100000:2.0:1783071380.075152:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18687850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e4e7df8-beb0-40df-a2a1-9decaa005633+10:6728:x1869685692832640:12345-192.168.204.38@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783071380.075325:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18687850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e4e7df8-beb0-40df-a2a1-9decaa005633+10:6728:x1869685692832640:12345-192.168.204.38@tcp:502:llog_process_th.0 Request processed in 175us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071380.075334:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 252 00000100:00100000:3.0:1783071380.078237:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071380.078348:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692832768 00000100:00100000:2.0:1783071380.078357:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692832768 00000100:00100000:2.0:1783071380.078436:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 253 00000100:00100000:2.0:1783071380.078446:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18685850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e4e7df8-beb0-40df-a2a1-9decaa005633+10:6728:x1869685692832768:12345-192.168.204.38@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783071380.078601:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18685850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e4e7df8-beb0-40df-a2a1-9decaa005633+10:6728:x1869685692832768:12345-192.168.204.38@tcp:502:llog_process_th.0 Request processed in 155us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071380.078610:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 253 00000100:00100000:2.0:1783071380.244072:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071380.244151:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071380.244183:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071380.244221:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692833152 00000100:00100000:0.0:1783071380.244230:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692833152 00000100:00100000:0.0:1783071380.244292:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 26 00000100:00100000:0.0:1783071380.244303:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c5af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf7532e4-6153-424a-9f4e-84941256b41f+5:2406:x1869685692833152:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1783071380.244404:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c5af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf7532e4-6153-424a-9f4e-84941256b41f+5:2406:x1869685692833152:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 102us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071380.244412:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 26 00000100:00080000:1.0:1783071380.247430:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783071380.248618:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071380.248645:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692833280 00000100:00100000:2.0:1783071380.248655:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692833280 00000100:00100000:2.0:1783071380.248719:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 27 00000100:00100000:2.0:1783071380.248732:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c5ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf7532e4-6153-424a-9f4e-84941256b41f+5:2406:x1869685692833280:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1783071380.248811:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c5ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf7532e4-6153-424a-9f4e-84941256b41f+5:2406:x1869685692833280:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 83us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071380.248819:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 27 00000100:00080000:2.0:1783071380.248860:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783071380.255687:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692832896 00000100:00100000:3.0:1783071380.255702:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692832896 00000100:00100000:3.0:1783071380.255782:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692833024 00000100:00100000:3.0:1783071380.255785:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692833024 00000100:00100000:3.0:1783071380.255811:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 64 00000100:00100000:3.0:1783071380.255821:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c5afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+6:2406:x1869685692832896:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1783071380.255900:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c5afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+6:2406:x1869685692832896:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 81us (11836us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071380.255908:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 64 00000100:00100000:3.0:1783071380.255923:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 65 00000100:00100000:3.0:1783071380.255929:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c5ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+5:2406:x1869685692833024:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1783071380.255948:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c5ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+5:2406:x1869685692833024:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 20us (11765us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071380.255954:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 65 00000100:00080000:0.0:1783071380.256168:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783071380.256172:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:2.0:1783071380.738714:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783071380.738724:0:6513:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8f8b34e49800 from 4 10000000:01000000:2.0:1783071380.738731:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783071380.738788:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b10967a00/0x6b58994c2cbdc0a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071380.738811:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8b10967a00/0x6b58994c2cbdc0a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071380.738826:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8b10967a00/0x6b58994c2cbdc0a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071380.738859:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c5ac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707570816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783071380.738954:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071380.739011:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0208b240 going to sleep for 11 seconds 00000100:00100000:0.0:1783071380.748192:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707570816 00000100:00100000:0.0:1783071380.748212:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707570816 00000100:00100000:0.0:1783071380.748301:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1783071380.748315:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18684c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+20:6513:x1869685707570816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783071380.748341:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071380.748423:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071380.748730:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b3c460400/0x6b58994c2cbdc0a9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdc0a2 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071380.748796:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b3c460400/0x6b58994c2cbdc0a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdc0a2 expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071380.748810:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b3c460400/0x6b58994c2cbdc0a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdc0a2 expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071380.748822:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b3c460400, rc 0) 00000100:00100000:0.0:1783071380.748994:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18684c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+21:6513:x1869685707570816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 682us (10039us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071380.749003:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1783071380.752257:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c5ac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707570816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783071380.752298:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8b10967a00/0x6b58994c2cbdc0a2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc0a9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071380.752314:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8b10967a00/0x6b58994c2cbdc0a2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdc0a9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071380.753183:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6ab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707570944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783071380.753271:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071380.753390:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b3c766600 going to sleep for 11 seconds 00000100:00100000:0.0:1783071380.757763:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707570944 00000100:00100000:0.0:1783071380.757784:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707570944 00000100:00100000:0.0:1783071380.757855:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1783071380.757867:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18684850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+21:6513:x1869685707570944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783071380.758833:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18684850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+21:6513:x1869685707570944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 962us (5556us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071380.758846:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1783071380.758945:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6ab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707570944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783071380.759032:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c669880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707571072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783071380.759098:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071380.759134:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b0511dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1783071380.759152:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707571072 00000100:00100000:0.0:1783071380.759158:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707571072 00000100:00100000:0.0:1783071380.759195:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1783071380.759205:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07695850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+21:6513:x1869685707571072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783071380.759335:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07695850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+21:6513:x1869685707571072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 132us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071380.759342:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1783071380.759748:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c669880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707571072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783071380.760176:0:10455:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:10455:1869685707571200:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783071380.760233:0:10455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071380.760307:0:10455:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b34471d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783071380.760343:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707571200 00000100:00100000:0.0:1783071380.760349:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707571200 00000100:00100000:0.0:1783071380.760702:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1783071380.760711:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07697850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+21:10455:x1869685707571200:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783071380.760888:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07697850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+21:10455:x1869685707571200:12345-0@lo:502:llog_process_th.0 Request processed in 178us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071380.760896:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1783071380.760974:0:10455:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:10455:1869685707571200:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783071380.761006:0:10455:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783071380.761031:0:10455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071380.761034:0:10455:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1783071380.761043:0:10455:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f8b34e49800 00000020:00000080:3.0:1783071380.761046:0:10455:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783071380.761179:0:10455:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:10455:1869685707571328:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783071380.761219:0:10455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071380.761245:0:10455:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b34471d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783071380.764698:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707571328 00000100:00100000:0.0:1783071380.764716:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707571328 00000100:00100000:0.0:1783071380.764781:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1783071380.764791:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07697450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+21:10455:x1869685707571328:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783071380.764997:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07697450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+21:10455:x1869685707571328:12345-0@lo:502:llog_process_th.0 Request processed in 207us (3777us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071380.765004:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1783071380.769268:0:10455:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:10455:1869685707571328:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783071380.769332:0:10455:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783071380.769342:0:10455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071380.769345:0:10455:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1783071380.769351:0:10455:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1783071380.775226:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1783071380.775276:0:6513:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783071380.775293:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b10967a00/0x6b58994c2cbdc0a2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc0a9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071380.775310:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8b10967a00/0x6b58994c2cbdc0a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc0a9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783071380.775335:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783071380.775338:0:6513:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8f8b069b2000 from 4 10000000:01000000:0.0:1783071380.775341:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783071380.776177:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461c00/0x6b58994c2cbdc0b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071380.776192:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461c00/0x6b58994c2cbdc0b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071380.776207:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461c00/0x6b58994c2cbdc0b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071380.776240:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c669880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707571456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783071380.776337:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071380.776521:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707571456 00000100:00100000:0.0:1783071380.776527:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b3c6026c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783071380.776531:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707571456 00000100:00100000:2.0:1783071380.776594:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1783071380.776604:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07695450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+21:6513:x1869685707571456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783071380.776621:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071380.776637:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b10967400/0x6b58994c2cbdc0b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdc0b0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071380.776668:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b10967400/0x6b58994c2cbdc0b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdc0b0 expref: 22 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071380.776681:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b10967400/0x6b58994c2cbdc0b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdc0b0 expref: 22 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071380.776693:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b10967400, rc 0) 00000100:00100000:2.0:1783071380.776750:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07695450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+22:6513:x1869685707571456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071380.776758:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1783071380.777522:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c669880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707571456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783071380.777543:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461c00/0x6b58994c2cbdc0b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc0b7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071380.777553:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461c00/0x6b58994c2cbdc0b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdc0b7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071380.777720:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c5ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707571584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783071380.777761:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071380.777789:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0208b900 going to sleep for 11 seconds 00000100:00100000:0.0:1783071380.778201:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707571584 00000100:00100000:0.0:1783071380.778208:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707571584 00000100:00100000:0.0:1783071380.778256:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1783071380.778264:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07697c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+22:6513:x1869685707571584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783071380.778569:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07697c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+22:6513:x1869685707571584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 305us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071380.778578:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1783071380.778597:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c5ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707571584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783071380.778631:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c5ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707571712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783071380.778679:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071380.778713:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0208b900 going to sleep for 11 seconds 00000100:00100000:3.0:1783071380.779053:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707571712 00000100:00100000:3.0:1783071380.779059:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707571712 00000100:00100000:3.0:1783071380.779478:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1783071380.779489:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07696050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+22:6513:x1869685707571712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783071380.779620:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07696050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+22:6513:x1869685707571712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 133us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071380.779738:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1783071380.781932:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c5ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707571712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783071380.783188:0:10459:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:10459:1869685707571840:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783071380.783309:0:10459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071380.783395:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707571840 00000100:00100000:3.0:1783071380.783403:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707571840 00000100:00100000:3.0:1783071380.783457:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1783071380.783466:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07695c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+22:10459:x1869685707571840:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783071380.783619:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07695c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+22:10459:x1869685707571840:12345-0@lo:502:llog_process_th.0 Request processed in 153us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071380.783642:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1783071380.783717:0:10459:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b344716c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071380.784353:0:10459:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:10459:1869685707571840:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783071380.784531:0:10459:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783071380.784545:0:10459:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071380.784548:0:10459:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1783071380.784556:0:10459:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f8b069b2000 00000020:00000080:3.0:1783071380.784560:0:10459:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783071380.784829:0:10459:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:10459:1869685707571968:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783071380.784900:0:10459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071380.784938:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707571968 00000100:00100000:3.0:1783071380.784945:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707571968 00000100:00100000:3.0:1783071380.784988:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1783071380.785080:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07696450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+22:10459:x1869685707571968:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783071380.785519:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07696450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+22:10459:x1869685707571968:12345-0@lo:502:llog_process_th.0 Request processed in 522us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071380.785530:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1783071380.785557:0:10459:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b06c48f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783071380.785584:0:10459:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:10459:1869685707571968:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783071380.785618:0:10459:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783071380.785637:0:10459:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071380.785639:0:10459:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1783071380.785649:0:10459:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1783071380.785827:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1783071380.785853:0:6513:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783071380.785867:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461c00/0x6b58994c2cbdc0b0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc0b7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071380.785881:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461c00/0x6b58994c2cbdc0b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc0b7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783071380.785907:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783071380.785910:0:6513:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8f8b3447b000 from 4 10000000:01000000:3.0:1783071380.785914:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783071380.785950:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b014b9a00/0x6b58994c2cbdc0be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071380.785960:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8b014b9a00/0x6b58994c2cbdc0be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071380.785972:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8b014b9a00/0x6b58994c2cbdc0be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071380.786077:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707572096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783071380.786118:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071380.786150:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b06c48780 going to sleep for 11 seconds 00000100:00100000:2.0:1783071380.786505:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707572096 00000100:00100000:2.0:1783071380.786513:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707572096 00000100:00100000:2.0:1783071380.786569:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1783071380.786579:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07697050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+22:6513:x1869685707572096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783071380.786594:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071380.786611:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b10967000/0x6b58994c2cbdc0c5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdc0be expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071380.786714:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b10967000/0x6b58994c2cbdc0c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdc0be expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071380.786728:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b10967000/0x6b58994c2cbdc0c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdc0be expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071380.786740:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b10967000, rc 0) 00000100:00100000:2.0:1783071380.786803:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07697050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+23:6513:x1869685707572096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 225us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071380.786810:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1783071380.787433:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707572096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783071380.787456:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8b014b9a00/0x6b58994c2cbdc0be lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc0c5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071380.787468:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8b014b9a00/0x6b58994c2cbdc0be lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdc0c5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071380.787550:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707572224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783071380.787595:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071380.787647:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b06c48780 going to sleep for 11 seconds 00000100:00100000:2.0:1783071380.787903:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707572224 00000100:00100000:2.0:1783071380.787910:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707572224 00000100:00100000:2.0:1783071380.787953:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1783071380.787961:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07694450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+23:6513:x1869685707572224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783071380.788147:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07694450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+23:6513:x1869685707572224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 187us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071380.788155:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1783071380.788855:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707572224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783071380.788908:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707572352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783071380.788977:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071380.789031:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b06c48780 going to sleep for 11 seconds 00000100:00100000:2.0:1783071380.789761:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707572352 00000100:00100000:2.0:1783071380.789771:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707572352 00000100:00100000:2.0:1783071380.789823:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1783071380.789831:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07694050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+23:6513:x1869685707572352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783071380.789979:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07694050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+23:6513:x1869685707572352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 147us (1001us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071380.789987:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1783071380.791241:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707572352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783071380.795330:0:10460:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:10460:1869685707572480:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783071380.795498:0:10460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071380.795557:0:10460:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b06c48900 going to sleep for 11 seconds 00000100:00100000:2.0:1783071380.795716:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707572480 00000100:00100000:2.0:1783071380.795726:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707572480 00000100:00100000:2.0:1783071380.795792:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1783071380.795803:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07696850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+23:10460:x1869685707572480:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783071380.795967:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07696850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+23:10460:x1869685707572480:12345-0@lo:502:llog_process_th.0 Request processed in 166us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071380.795976:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1783071380.797789:0:10460:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:10460:1869685707572480:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783071380.797855:0:10460:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783071380.797868:0:10460:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783071380.797871:0:10460:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1783071380.797881:0:10460:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f8b3447b000 00000020:00000080:0.0:1783071380.797891:0:10460:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1783071380.798282:0:10460:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c66aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:10460:1869685707572608:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783071380.798394:0:10460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071380.798445:0:10460:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b3c6026c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071380.798464:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707572608 00000100:00100000:3.0:1783071380.798474:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707572608 00000100:00100000:3.0:1783071380.798543:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1783071380.798563:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07695050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+23:10460:x1869685707572608:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783071380.798718:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07695050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+23:10460:x1869685707572608:12345-0@lo:502:llog_process_th.0 Request processed in 156us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071380.798740:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1783071380.798804:0:10460:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c66aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:10460:1869685707572608:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783071380.798832:0:10460:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783071380.798837:0:10460:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783071380.798839:0:10460:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1783071380.798843:0:10460:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1783071380.799048:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1783071380.799076:0:6513:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783071380.799155:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b014b9a00/0x6b58994c2cbdc0be lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc0c5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071380.799176:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8b014b9a00/0x6b58994c2cbdc0be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc0c5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071380.799190:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783071380.799194:0:6513:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8f8b10f7e000 from 4 10000000:01000000:2.0:1783071380.799197:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783071380.799229:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b10966c00/0x6b58994c2cbdc0cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071380.799237:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8b10966c00/0x6b58994c2cbdc0cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071380.799247:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8b10966c00/0x6b58994c2cbdc0cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071380.799264:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c5adf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707572736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783071380.799305:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071380.799338:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707572736 00000100:00100000:2.0:1783071380.799342:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707572736 00000100:00100000:2.0:1783071380.799528:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1783071380.799538:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+23:6513:x1869685707572736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783071380.799550:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071380.799565:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b10966800/0x6b58994c2cbdc0d3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdc0cc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071380.799592:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b10966800/0x6b58994c2cbdc0d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdc0cc expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071380.799604:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b10966800/0x6b58994c2cbdc0d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdc0cc expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071380.801182:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b10966800, rc 0) 00000100:00100000:2.0:1783071380.801280:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+24:6513:x1869685707572736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1739us (1970us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071380.801292:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1783071380.801381:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0208b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783071380.801711:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c5adf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707572736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783071380.801740:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8b10966c00/0x6b58994c2cbdc0cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc0d3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071380.801755:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8b10966c00/0x6b58994c2cbdc0cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdc0d3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071380.801849:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c5adf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707572864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783071380.801893:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071380.801921:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0208b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071380.805036:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707572864 00000100:00100000:3.0:1783071380.805055:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707572864 00000100:00100000:3.0:1783071380.805137:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1783071380.805150:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+24:6513:x1869685707572864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783071380.806936:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+24:6513:x1869685707572864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1776us (5029us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071380.806953:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1783071380.807580:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c5adf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707572864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783071380.807673:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c5adf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707572992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783071380.807737:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071380.807777:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707572992 00000100:00100000:2.0:1783071380.807785:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707572992 00000100:00100000:2.0:1783071380.807830:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1783071380.807838:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+24:6513:x1869685707572992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783071380.807941:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+24:6513:x1869685707572992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 103us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071380.807957:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1783071380.808008:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0208b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783071380.808032:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c5adf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707572992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783071380.809673:0:10463:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:10463:1869685707573120:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783071380.809779:0:10463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071380.809824:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707573120 00000100:00100000:3.0:1783071380.809831:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707573120 00000100:00100000:2.0:1783071380.813753:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1783071380.813780:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+24:10463:x1869685707573120:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783071380.814004:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+24:10463:x1869685707573120:12345-0@lo:502:llog_process_th.0 Request processed in 235us (4225us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071380.814025:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1783071380.814772:0:10463:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b03fef0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783071380.814813:0:10463:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:10463:1869685707573120:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783071380.814865:0:10463:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783071380.814879:0:10463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783071380.814882:0:10463:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1783071380.814891:0:10463:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f8b10f7e000 00000020:00000080:1.0:1783071380.814894:0:10463:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1783071380.815030:0:10463:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6ab100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:10463:1869685707573248:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783071380.816746:0:10463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071380.816822:0:10463:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b3c766480 going to sleep for 11 seconds 00000100:00100000:2.0:1783071380.816961:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707573248 00000100:00100000:2.0:1783071380.816973:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707573248 00000100:00100000:2.0:1783071380.817060:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1783071380.817072:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+24:10463:x1869685707573248:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783071380.817273:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+24:10463:x1869685707573248:12345-0@lo:502:llog_process_th.0 Request processed in 203us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071380.817283:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1783071380.818339:0:10463:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6ab100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:10463:1869685707573248:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783071380.818429:0:10463:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783071380.818440:0:10463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783071380.818443:0:10463:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1783071380.818449:0:10463:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1783071380.818780:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1783071380.818819:0:6513:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783071380.818837:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b10966c00/0x6b58994c2cbdc0cc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc0d3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071380.818851:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8b10966c00/0x6b58994c2cbdc0cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc0d3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071381.765986:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071382.339145:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707573376:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783071382.339255:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071382.340564:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707573376 00000100:00100000:3.0:1783071382.340583:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707573376 00000100:00100000:3.0:1783071382.340672:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1783071382.340686:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707573376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783071382.340737:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783071382.342066:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707573376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1376us (2804us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071382.342081:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1783071382.342125:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c5adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:feaa1501-b927-4e07-baad-3200e92d7497:3646:1869685707573504:0@lo:400:kworker.0 00000100:00100000:3.0:1783071382.342194:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071382.342264:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707573504 00000100:00100000:3.0:1783071382.342271:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707573504 00000100:00100000:3.0:1783071382.342318:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1783071382.342326:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+24:3646:x1869685707573504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071382.342978:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+24:3646:x1869685707573504:12345-0@lo:400:kworker.0 Request processed in 650us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071382.343049:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1783071382.343120:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c5adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:feaa1501-b927-4e07-baad-3200e92d7497:3646:1869685707573504:0@lo:400:kworker.0 00000100:00100000:2.0:1783071382.343852:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c5ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869685707573632:0@lo:400:kworker.0 00000100:00100000:1.0:1783071382.343893:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707573376:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783071382.343911:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071382.343915:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c5ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707573888:0@lo:400:kworker.0 00000100:00100000:2.0:1783071382.343944:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1869685707574144:0@lo:400:kworker.0 00000100:00100000:1.0:1783071382.343948:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071382.343964:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071382.343964:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707574400:0@lo:400:kworker.0 00000100:00100000:2.0:1783071382.343980:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1869685707574656:0@lo:400:kworker.0 00000100:00100000:1.0:1783071382.344000:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071382.344015:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071382.344019:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707574912:0@lo:400:kworker.0 00000100:00100000:2.0:1783071382.344035:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1783071382.344040:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c5adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869685707573760:0@lo:400:kworker.0 00000100:00100000:1.0:1783071382.344040:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071382.344055:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1783071382.344059:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c5ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1869685707574016:0@lo:400:kworker.0 00000100:00100000:2.0:1783071382.344072:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071382.344089:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707574400 00000100:00100000:1.0:1783071382.344099:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707574400 00000100:00100000:1.0:1783071382.344155:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707574912 00000100:00100000:1.0:1783071382.344159:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707574912 00000100:00100000:1.0:1783071382.344183:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783071382.344192:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707574400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071382.344326:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707573632 00000100:00100000:3.0:1783071382.344330:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707573632 00000100:00100000:3.0:1783071382.345111:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707574144 00000100:00100000:3.0:1783071382.345119:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707574144 00000100:00100000:3.0:1783071382.345149:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707574656 00000100:00100000:3.0:1783071382.345151:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707574656 00000100:00100000:3.0:1783071382.345163:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707573760 00000100:00100000:3.0:1783071382.345166:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707573760 00000100:00100000:3.0:1783071382.345179:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1783071382.345187:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c78d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869685707573632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071382.345421:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707574400:12345-0@lo:400:kworker.0 Request processed in 1229us (1418us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071382.345441:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783071382.345465:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783071382.345473:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707574912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071382.345508:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707574912:12345-0@lo:400:kworker.0 Request processed in 37us (1467us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071382.345515:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783071382.345819:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783071382.345830:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c78c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869685707574144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071382.345870:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c78c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869685707574144:12345-0@lo:400:kworker.0 Request processed in 43us (1905us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071382.345876:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783071382.345891:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1783071382.345910:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c78ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869685707574656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071382.345940:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c78ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869685707574656:12345-0@lo:400:kworker.0 Request processed in 43us (1923us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071382.345946:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1783071382.345957:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1783071382.345964:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b08871880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869685707573760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071382.346006:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b08871880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869685707573760:12345-0@lo:400:kworker.0 Request processed in 42us (1932us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071382.346012:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:1.0:1783071382.346036:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783071382.346043:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783071382.346047:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783071382.346067:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071382.346117:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1869685707574528:0@lo:400:kworker.0 00000100:00100000:1.0:1783071382.346161:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1783071382.346195:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c78f480 x1869685707574400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071382.346212:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707574400:0@lo:400:kworker.0 00010000:00080000:1.0:1783071382.346227:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c78c380 x1869685707574912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071382.346237:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707574912:0@lo:400:kworker.0 00000100:00100000:1.0:1783071382.346272:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707574016 00000100:00100000:1.0:1783071382.346278:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707574016 00000100:00100000:1.0:1783071382.346920:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707574528 00000100:00100000:1.0:1783071382.346927:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707574528 00000100:00100000:1.0:1783071382.346949:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783071382.346956:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1869685707574016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071382.347029:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1869685707574016:12345-0@lo:400:kworker.0 Request processed in 72us (961us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071382.347035:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783071382.347051:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1783071382.347058:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1869685707574528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071382.347086:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c5adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869685707573760:0@lo:400:kworker.0 00000100:00100000:1.0:1783071382.347090:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1869685707574528:12345-0@lo:400:kworker.0 Request processed in 34us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071382.347095:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783071382.347097:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707574272:0@lo:400:kworker.0 00000100:00080000:1.0:1783071382.347114:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783071382.347130:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071382.347134:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c5ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1869685707574016:0@lo:400:kworker.0 00000100:00100000:1.0:1783071382.347144:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1869685707574528:0@lo:400:kworker.0 00000100:00100000:2.0:1783071382.347152:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707574784:0@lo:400:kworker.0 00000100:00100000:1.0:1783071382.347176:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707574272 00000100:00100000:1.0:1783071382.347180:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707574272 00000100:00100000:2.0:1783071382.347192:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071382.347206:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707574784 00000100:00100000:1.0:1783071382.347209:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707574784 00010000:00080000:2.0:1783071382.347222:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c78f100 x1869685707574144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071382.347226:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783071382.347232:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c79dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707574272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071382.347233:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1869685707574144:0@lo:400:kworker.0 00010000:00080000:2.0:1783071382.347247:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c78ed80 x1869685707574656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071382.347256:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1869685707574656:0@lo:400:kworker.0 00010000:00080000:2.0:1783071382.347283:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c78d880 x1869685707574272/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071382.347292:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707574272:0@lo:400:kworker.0 00000100:00100000:2.0:1783071382.347441:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707573888 00000100:00100000:1.0:1783071382.347445:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c79dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707574272:12345-0@lo:400:kworker.0 Request processed in 212us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071382.347446:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707573888 00000100:00100000:1.0:1783071382.347451:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783071382.347464:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783071382.347470:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707574784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071382.347475:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783071382.347481:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707573888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071382.347506:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707574784:12345-0@lo:400:kworker.0 Request processed in 37us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071382.347513:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783071382.347518:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707573888:12345-0@lo:400:kworker.0 Request processed in 38us (3570us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071382.347524:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:1.0:1783071382.347527:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783071382.347529:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783071382.347811:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c78fb80 x1869685707574784/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071382.347823:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707574784:0@lo:400:kworker.0 00000100:00100000:1.0:1783071382.347852:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c5ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707573888:0@lo:400:kworker.0 00000100:00100000:3.0:1783071382.348035:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c78d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869685707573632:12345-0@lo:400:kworker.0 Request processed in 2846us (4120us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071382.348045:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783071382.348140:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c5ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869685707573632:0@lo:400:kworker.0 00010000:00010000:2.0:1783071382.791240:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071382.850553:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783071382.850574:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707575040:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783071382.850641:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071382.850728:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707575040 00000100:00100000:3.0:1783071382.850734:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707575040 00000100:00100000:3.0:1783071382.850780:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783071382.850789:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c5ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707575040:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783071382.850817:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783071382.850861:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c5ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707575040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071382.850868:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1783071382.850901:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c6a0380 x1869685707575040/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071398 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071382.850917:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707575040:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783071382.853458:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707575168:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783071382.853529:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071382.853588:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707575168 00000100:00100000:3.0:1783071382.853594:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707575168 00000100:00100000:3.0:1783071382.853639:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783071382.853648:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707575168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783071382.853688:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783071382.853732:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707575168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071382.853739:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1783071382.853779:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c6a0380 x1869685707575168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071398 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071382.853797:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707575168:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783071382.855479:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783071382.855498:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c66aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707575424:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783071382.855553:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071382.855655:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c5ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707575296:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783071382.855684:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071382.856032:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707575424 00000100:00100000:2.0:1783071382.856041:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707575424 00000100:00100000:2.0:1783071382.856077:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707575296 00000100:00100000:2.0:1783071382.856080:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707575296 00000100:00100000:2.0:1783071382.856097:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783071382.856106:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c668380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707575424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783071382.856140:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783071382.856215:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c668380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707575424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (661us total) trans 0 rc 0/0 00010000:00080000:1.0:1783071382.856277:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c66aa00 x1869685707575424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071398 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071382.856308:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c66aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707575424:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783071382.863011:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783071382.863052:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783071382.863069:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707575296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783071382.863100:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783071382.863779:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707575296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 713us (8089us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071382.863788:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1783071382.864382:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c5ad880 x1869685707575296/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071398 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071382.864410:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c5ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707575296:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1783071383.813578:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071383.876154:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783071383.876187:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707575552:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783071383.876290:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071383.876382:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707575552 00000100:00100000:2.0:1783071383.876398:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707575552 00000100:00100000:2.0:1783071383.876611:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783071383.876622:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707575552:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783071383.876665:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783071383.876763:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707575552:12345-0@lo:41:osp-pre-1-0.0 Request processed in 143us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071383.876770:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783071383.877011:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707575552:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1783071384.836021:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071385.372045:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071385.372088:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071385.372119:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071385.372140:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071385.372160:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071385.372185:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692833920 00000100:00100000:1.0:1783071385.372195:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692833920 00000100:00100000:1.0:1783071385.372252:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692833792 00000100:00100000:1.0:1783071385.372255:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692833792 00000100:00100000:1.0:1783071385.372281:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 32 00000100:00100000:1.0:1783071385.372291:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c5ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf7532e4-6153-424a-9f4e-84941256b41f+5:2404:x1869685692833920:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1783071385.372388:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c5ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf7532e4-6153-424a-9f4e-84941256b41f+5:2404:x1869685692833920:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 75us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071385.372396:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 32 00000100:00100000:1.0:1783071385.372415:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 33 00000100:00100000:1.0:1783071385.372421:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c78fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf7532e4-6153-424a-9f4e-84941256b41f+5:2404:x1869685692833792:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1783071385.372447:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c78fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf7532e4-6153-424a-9f4e-84941256b41f+5:2404:x1869685692833792:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 26us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071385.372454:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 33 00000100:00080000:1.0:1783071385.372475:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783071385.372479:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783071385.372963:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692833408 00000100:00100000:2.0:1783071385.372983:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692833408 00000100:00100000:2.0:1783071385.373017:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 275 00000100:00100000:2.0:1783071385.373024:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e4e7df8-beb0-40df-a2a1-9decaa005633+10:2404:x1869685692833408:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1783071385.373065:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e4e7df8-beb0-40df-a2a1-9decaa005633+10:2404:x1869685692833408:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 42us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071385.373073:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 275 00000100:00100000:2.0:1783071385.373106:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692833664 00000100:00100000:2.0:1783071385.373109:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692833664 00000100:00100000:2.0:1783071385.373152:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692833536 00000100:00100000:2.0:1783071385.373155:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692833536 00000100:00100000:2.0:1783071385.373180:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 72 00000100:00100000:2.0:1783071385.373187:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c5adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+5:2404:x1869685692833664:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1783071385.373217:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c5adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+5:2404:x1869685692833664:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 32us (1129us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071385.373223:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 72 00000100:00100000:2.0:1783071385.373234:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 73 00000100:00100000:2.0:1783071385.373239:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c5ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+6:2404:x1869685692833536:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1783071385.373258:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c5ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+6:2404:x1869685692833536:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 20us (1118us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071385.373265:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 73 00000100:00080000:1.0:1783071385.374103:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783071385.374109:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:02000400:3.0:1783071385.489019:0:10689:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg438-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1783071385.858518:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071386.886287:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071387.458807:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707575936:0@lo:400:kworker.0 00000100:00100000:2.0:1783071387.458940:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071387.459043:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1869685707576448:0@lo:400:kworker.0 00000100:00100000:2.0:1783071387.459088:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071387.459123:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1869685707576960:0@lo:400:kworker.0 00000100:00100000:2.0:1783071387.459164:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071387.459194:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1783071387.459201:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869685707576064:0@lo:400:kworker.0 00000100:00100000:2.0:1783071387.459225:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071387.459246:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707576576:0@lo:400:kworker.0 00000100:00100000:2.0:1783071387.459277:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071387.459297:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707577088:0@lo:400:kworker.0 00000100:00100000:2.0:1783071387.459340:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071387.459418:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707576448 00000100:00100000:2.0:1783071387.459429:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707576448 00000100:00100000:2.0:1783071387.459496:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707576960 00000100:00100000:2.0:1783071387.459499:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707576960 00000100:00100000:2.0:1783071387.459514:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707576064 00000100:00100000:2.0:1783071387.459517:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707576064 00000100:00100000:2.0:1783071387.459532:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783071387.459540:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1869685707576448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071387.459602:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1869685707576448:12345-0@lo:400:kworker.0 Request processed in 63us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071387.459609:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783071387.459626:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783071387.459630:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1869685707576960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071387.459651:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1869685707576960:12345-0@lo:400:kworker.0 Request processed in 21us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071387.459657:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783071387.459664:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1783071387.459668:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1869685707576064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071387.459700:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1869685707576064:12345-0@lo:400:kworker.0 Request processed in 31us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071387.459706:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1783071387.459730:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707576576 00000100:00100000:2.0:1783071387.459733:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707576576 00000100:00100000:2.0:1783071387.459758:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707577088 00000100:00100000:2.0:1783071387.459761:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707577088 00000100:00100000:2.0:1783071387.459787:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783071387.459793:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b2ff81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707576576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071387.459820:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b2ff81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707576576:12345-0@lo:400:kworker.0 Request processed in 28us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071387.459826:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783071387.459859:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783071387.459873:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03808700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707577088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071387.459938:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03808700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707577088:12345-0@lo:400:kworker.0 Request processed in 69us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071387.459946:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:2.0:1783071387.460045:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783071387.460050:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783071387.460053:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783071387.460089:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869685707576064:0@lo:400:kworker.0 00010000:00080000:2.0:1783071387.460103:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a032e4e00 x1869685707576576/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071387.460114:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707576576:0@lo:400:kworker.0 00010000:00080000:2.0:1783071387.460123:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a032e4000 x1869685707577088/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071387.460130:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707577088:0@lo:400:kworker.0 00010000:00080000:2.0:1783071387.460141:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a032e7800 x1869685707576448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071387.460150:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1869685707576448:0@lo:400:kworker.0 00010000:00080000:2.0:1783071387.460170:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a032e7480 x1869685707576960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071387.460178:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1869685707576960:0@lo:400:kworker.0 00000100:00100000:3.0:1783071387.460441:0:9413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707575936 00000100:00100000:3.0:1783071387.460448:0:9413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707575936 00000100:00100000:3.0:1783071387.460483:0:9413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1783071387.460490:0:9413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707575936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071387.460539:0:9413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707575936:12345-0@lo:400:kworker.0 Request processed in 50us (1601us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071387.460546:0:9413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1783071387.460810:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707575936:0@lo:400:kworker.0 00000100:00100000:0.0:1783071387.464131:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:feaa1501-b927-4e07-baad-3200e92d7497:3647:1869685707575680:0@lo:400:kworker.0 00000100:00100000:0.0:1783071387.464257:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071387.464334:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707576192:0@lo:400:kworker.0 00000100:00100000:0.0:1783071387.464419:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071387.464452:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707576704:0@lo:400:kworker.0 00000100:00100000:0.0:1783071387.464478:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071387.464499:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707577216:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783071387.464521:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071387.464559:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1783071387.464567:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869685707575808:0@lo:400:kworker.0 00000100:00100000:0.0:1783071387.464623:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071387.464643:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1869685707576320:0@lo:400:kworker.0 00000100:00100000:0.0:1783071387.464662:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071387.464678:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1869685707576832:0@lo:400:kworker.0 00000100:00100000:0.0:1783071387.464698:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071387.464720:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707577344:0@lo:400:kworker.0 00000100:00100000:0.0:1783071387.464740:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071387.464783:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707575808 00000100:00100000:0.0:1783071387.464793:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707575808 00000100:00100000:0.0:1783071387.464849:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707576320 00000100:00100000:0.0:1783071387.464852:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707576320 00000100:00100000:0.0:1783071387.464874:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707576832 00000100:00100000:0.0:1783071387.464876:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707576832 00000100:00100000:0.0:1783071387.464909:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1783071387.464920:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c669500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869685707575808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071387.464995:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c669500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869685707575808:12345-0@lo:400:kworker.0 Request processed in 75us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071387.465003:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1783071387.465025:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1783071387.465031:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c669f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869685707576320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071387.465059:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c669f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869685707576320:12345-0@lo:400:kworker.0 Request processed in 28us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071387.465065:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1783071387.465076:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1783071387.465081:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c66aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869685707576832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071387.465105:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c66aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869685707576832:12345-0@lo:400:kworker.0 Request processed in 24us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071387.465118:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1783071387.465164:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869685707575808:0@lo:400:kworker.0 00000100:00100000:0.0:1783071387.465177:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1869685707576320:0@lo:400:kworker.0 00000100:00100000:0.0:1783071387.465185:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1869685707576832:0@lo:400:kworker.0 00000100:00100000:1.0:1783071387.467449:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707576704 00000100:00100000:1.0:1783071387.467468:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707576704 00000100:00100000:1.0:1783071387.467559:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707577344 00000100:00100000:1.0:1783071387.467563:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707577344 00000100:00100000:1.0:1783071387.467588:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783071387.467598:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c66a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707576704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071387.467671:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707576192 00000100:00100000:2.0:1783071387.467679:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707576192 00000100:00100000:2.0:1783071387.467723:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707577216 00000100:00100000:2.0:1783071387.467728:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707577216 00000100:00100000:2.0:1783071387.467749:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1783071387.467758:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c669180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707576192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071387.467765:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c66a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707576704:12345-0@lo:400:kworker.0 Request processed in 165us (3281us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071387.467774:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783071387.467797:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783071387.467806:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c669880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707577344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071387.467821:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c669180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707576192:12345-0@lo:400:kworker.0 Request processed in 63us (3399us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071387.467829:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1783071387.467849:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783071387.467849:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c669880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707577344:12345-0@lo:400:kworker.0 Request processed in 43us (3106us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071387.467861:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783071387.467863:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c66bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707577216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783071387.467915:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1783071387.467958:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c66bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707577216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (3436us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071387.467966:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:2.0:1783071387.468001:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783071387.468006:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783071387.468009:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783071387.469057:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707575680 00000100:00100000:3.0:1783071387.469075:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707575680 00000100:00100000:3.0:1783071387.469258:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1783071387.469268:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+24:3647:x1869685707575680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071387.469412:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+24:3647:x1869685707575680:12345-0@lo:400:kworker.0 Request processed in 144us (5154us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071387.469418:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00010000:00080000:0.0:1783071387.471516:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a032e4a80 x1869685707577344/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071387.471551:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707577344:0@lo:400:kworker.0 00000100:00100000:0.0:1783071387.471568:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:feaa1501-b927-4e07-baad-3200e92d7497:3647:1869685707575680:0@lo:400:kworker.0 00000100:00100000:0.0:1783071387.471584:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707576192:0@lo:400:kworker.0 00010000:00080000:0.0:1783071387.471597:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a032e7100 x1869685707576704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071387.471606:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707576704:0@lo:400:kworker.0 00000100:00100000:0.0:1783071387.471635:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707577216:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1783071387.906989:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071387.970592:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783071387.970624:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707577472:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783071387.970722:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071387.970812:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707577472 00000100:00100000:3.0:1783071387.970822:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707577472 00000100:00100000:3.0:1783071387.970896:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783071387.970907:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707577472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783071387.970946:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783071387.971000:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707577472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071387.971008:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1783071387.971065:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c6a3b80 x1869685707577472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071403 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071387.971088:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707577472:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783071387.971456:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783071387.971468:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707577728:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783071387.971502:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071387.971534:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707577728 00000100:00100000:3.0:1783071387.971539:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707577728 00000100:00100000:3.0:1783071387.971562:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783071387.971568:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707577728:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783071387.971583:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783071387.971614:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707577728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 45us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071387.971632:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1783071387.971661:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c6a3b80 x1869685707577728/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071403 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071387.971675:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707577728:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783071387.971694:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c66a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707577600:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783071387.971720:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071387.971744:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707577600 00000100:00100000:3.0:1783071387.971748:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707577600 00000100:00100000:3.0:1783071387.971769:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783071387.971776:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707577600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783071387.971794:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783071387.971824:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707577600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071387.971830:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1783071387.971853:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c66a680 x1869685707577600/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071403 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071387.971865:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c66a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707577600:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783071387.976278:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783071387.976313:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c66ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707577856:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783071387.976439:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071387.976629:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707577856 00000100:00100000:0.0:1783071387.976642:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707577856 00000100:00100000:0.0:1783071387.976722:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783071387.976735:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c78d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707577856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783071387.976773:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783071387.976837:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c78d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707577856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071387.976846:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1783071387.976976:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c66ad80 x1869685707577856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071403 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071387.977016:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c66ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707577856:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783071388.935193:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071388.995083:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783071388.995115:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707577984:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783071388.995208:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071388.995291:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707577984 00000100:00100000:3.0:1783071388.995301:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707577984 00000100:00100000:3.0:1783071388.995360:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1783071388.995389:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707577984:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783071388.995452:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783071388.995508:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707577984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 120us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071388.995517:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1783071388.995573:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707577984:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1783071389.955452:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071390.496680:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071390.496738:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071390.496783:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071390.496824:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692834304 00000100:00100000:1.0:1783071390.496851:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692834304 00000100:00100000:1.0:1783071390.496927:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692834176 00000100:00100000:1.0:1783071390.496931:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692834176 00000100:00100000:1.0:1783071390.496961:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 80 00000100:00100000:1.0:1783071390.496973:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c78ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+5:2406:x1869685692834304:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1783071390.497212:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692834048 00000100:00100000:0.0:1783071390.497218:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692834048 00000100:00100000:0.0:1783071390.497251:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 277 00000100:00100000:0.0:1783071390.497259:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e4e7df8-beb0-40df-a2a1-9decaa005633+10:2406:x1869685692834048:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1783071390.497322:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c78ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+5:2406:x1869685692834304:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 350us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071390.497332:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 80 00000100:00100000:1.0:1783071390.497356:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 81 00000100:00100000:1.0:1783071390.497394:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c78f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+6:2406:x1869685692834176:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1783071390.497587:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e4e7df8-beb0-40df-a2a1-9decaa005633+10:2406:x1869685692834048:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 328us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071390.497594:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 277 00000100:00100000:1.0:1783071390.497764:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c78f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+6:2406:x1869685692834176:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 400us (979us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071390.497771:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 81 00000100:00080000:1.0:1783071390.497796:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783071390.497801:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783071390.506986:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071390.518592:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071390.519911:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692834432 00000100:00100000:2.0:1783071390.519928:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692834432 00000100:00100000:2.0:1783071390.520019:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692834560 00000100:00100000:2.0:1783071390.520024:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692834560 00000100:00100000:2.0:1783071390.520080:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18 00000100:00100000:2.0:1783071390.520753:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0380b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf7532e4-6153-424a-9f4e-84941256b41f+5:2402:x1869685692834432:12345-192.168.204.38@tcp:9:kworker.0 00000020:00000080:2.0:1783071390.520805:0:8429:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6b58994c2cbdbfe5 00000100:00080000:2.0:1783071390.520818:0:8429:0:(import.c:65:import_set_state_nolock()) ffff8f8a02c77000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783071390.520886:0:8429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00080000:0.0:1783071390.521197:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783071390.521203:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783071390.522497:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19 00000100:00100000:1.0:1783071390.522521:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03808e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf7532e4-6153-424a-9f4e-84941256b41f+5:2402:x1869685692834560:12345-192.168.204.38@tcp:9:kworker.0 00000020:00000080:1.0:1783071390.522570:0:8431:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6b58994c2cbdbfec 00000100:00080000:1.0:1783071390.522590:0:8431:0:(import.c:65:import_set_state_nolock()) ffff8f8a03247800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783071390.522647:0:8431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1783071390.522861:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03808e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf7532e4-6153-424a-9f4e-84941256b41f+2:2402:x1869685692834560:12345-192.168.204.38@tcp:9:kworker.0 Request processed in 349us (4285us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071390.522870:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19 00000100:00100000:2.0:1783071390.523505:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0380b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf7532e4-6153-424a-9f4e-84941256b41f+2:2402:x1869685692834432:12345-192.168.204.38@tcp:9:kworker.0 Request processed in 2755us (16527us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071390.523516:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18 00010000:00010000:2.0:1783071390.523609:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071390.523885:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783071390.589720:0:10933:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg438-server.virtnet: executing yml_node 00010000:00010000:2.0:1783071390.980247:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071392.003233:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071392.582652:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707578112:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783071392.583216:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071392.585204:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:feaa1501-b927-4e07-baad-3200e92d7497:3647:1869685707578240:0@lo:400:kworker.0 00000100:00100000:2.0:1783071392.585293:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071392.585672:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783071392.585680:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869685707578368:0@lo:400:kworker.0 00000100:00100000:2.0:1783071392.585725:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071392.585940:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869685707578496:0@lo:400:kworker.0 00000100:00100000:1.0:1783071392.586087:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071392.586107:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c689500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707579008:0@lo:400:kworker.0 00000100:00100000:1.0:1783071392.586135:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071392.586152:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c688700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707579520:0@lo:400:kworker.0 00000100:00100000:1.0:1783071392.586174:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071392.586193:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1783071392.586199:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707578624:0@lo:400:kworker.0 00000100:00100000:1.0:1783071392.586222:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071392.586358:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707578240 00000100:00100000:2.0:1783071392.586384:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707578240 00000100:00100000:0.0:1783071392.586438:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707578368 00000100:00100000:0.0:1783071392.586444:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707578368 00000100:00100000:2.0:1783071392.586451:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1783071392.586465:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+24:3647:x1869685707578240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071392.586483:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707578496 00000100:00100000:0.0:1783071392.586488:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707578496 00000100:00100000:0.0:1783071392.586516:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1783071392.586524:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+24:3647:x1869685707578240:12345-0@lo:400:kworker.0 Request processed in 63us (1230us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071392.586527:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0380b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869685707578368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071392.586537:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1783071392.586578:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0380b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869685707578368:12345-0@lo:400:kworker.0 Request processed in 54us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071392.586596:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1783071392.586606:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c688e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1869685707578496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071392.586639:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c688e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1869685707578496:12345-0@lo:400:kworker.0 Request processed in 34us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071392.586808:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1783071392.587085:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707579008 00000100:00100000:0.0:1783071392.587091:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707579008 00000100:00100000:0.0:1783071392.587129:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707579520 00000100:00100000:0.0:1783071392.587132:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707579520 00000100:00100000:0.0:1783071392.587154:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783071392.587161:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c68b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707579008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071392.587205:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c68b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707579008:12345-0@lo:400:kworker.0 Request processed in 45us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071392.587212:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783071392.587462:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783071392.587469:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c68a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707579520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071392.587504:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c68a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707579520:12345-0@lo:400:kworker.0 Request processed in 36us (1328us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071392.587511:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783071392.587526:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1783071392.587533:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783071392.587538:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783071392.587581:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1869685707578752:0@lo:400:kworker.0 00000100:00100000:0.0:1783071392.587583:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c688380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1869685707578880:0@lo:400:kworker.0 00000100:00100000:2.0:1783071392.587732:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071392.587761:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c68ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1869685707579264:0@lo:400:kworker.0 00000100:00100000:2.0:1783071392.587785:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071392.587838:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869685707578368:0@lo:400:kworker.0 00000100:00100000:2.0:1783071392.587851:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:feaa1501-b927-4e07-baad-3200e92d7497:3647:1869685707578240:0@lo:400:kworker.0 00000100:00100000:2.0:1783071392.587885:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707578752 00000100:00100000:2.0:1783071392.587889:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707578752 00000100:00100000:2.0:1783071392.587920:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707579264 00000100:00100000:2.0:1783071392.587924:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707579264 00000100:00100000:2.0:1783071392.587942:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1783071392.587950:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0380a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869685707578752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071392.588298:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0380a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869685707578752:12345-0@lo:400:kworker.0 Request processed in 348us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071392.588306:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1783071392.588321:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1783071392.588328:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0380b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869685707579264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071392.588359:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0380b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869685707579264:12345-0@lo:400:kworker.0 Request processed in 32us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071392.588388:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:2.0:1783071392.588407:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783071392.588435:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1869685707578752:0@lo:400:kworker.0 00000100:00100000:2.0:1783071392.588446:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c68ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1869685707579264:0@lo:400:kworker.0 00000100:00100000:1.0:1783071392.588663:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c689f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707579136:0@lo:400:kworker.0 00000100:00100000:1.0:1783071392.588706:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071392.588728:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c68b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707579648:0@lo:400:kworker.0 00000100:00100000:1.0:1783071392.588752:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071392.588779:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869685707578496:0@lo:400:kworker.0 00010000:00080000:1.0:1783071392.588841:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c689500 x1869685707579008/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071392.588853:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c689500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707579008:0@lo:400:kworker.0 00010000:00080000:1.0:1783071392.588878:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c688700 x1869685707579520/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071392.588888:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c688700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707579520:0@lo:400:kworker.0 00000100:00100000:1.0:1783071392.588916:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707579136 00000100:00100000:1.0:1783071392.588920:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707579136 00000100:00100000:1.0:1783071392.588957:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707579648 00000100:00100000:1.0:1783071392.588961:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707579648 00000100:00100000:1.0:1783071392.589068:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783071392.589076:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c688000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707579136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071392.589467:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c688000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707579136:12345-0@lo:400:kworker.0 Request processed in 391us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071392.589474:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783071392.589490:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783071392.589498:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c688a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707579648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071392.589528:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c688a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707579648:12345-0@lo:400:kworker.0 Request processed in 32us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071392.589533:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:1.0:1783071392.589555:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783071392.589558:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783071392.589580:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c689f80 x1869685707579136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071392.589591:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c689f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707579136:0@lo:400:kworker.0 00010000:00080000:1.0:1783071392.589600:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c68b800 x1869685707579648/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071392.589606:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c68b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707579648:0@lo:400:kworker.0 00000100:00100000:0.0:1783071392.590512:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071392.590551:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c689c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1869685707579392:0@lo:400:kworker.0 00000100:00100000:0.0:1783071392.590584:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071392.590643:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707578880 00000100:00100000:0.0:1783071392.590648:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707578880 00000100:00100000:0.0:1783071392.590692:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707579392 00000100:00100000:0.0:1783071392.590696:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707579392 00000100:00100000:0.0:1783071392.590717:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1783071392.590724:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c669c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869685707578880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071392.590777:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c669c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869685707578880:12345-0@lo:400:kworker.0 Request processed in 52us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071392.590783:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1783071392.590810:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1783071392.590816:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c668700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869685707579392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071392.590863:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c668700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869685707579392:12345-0@lo:400:kworker.0 Request processed in 47us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071392.590870:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:0.0:1783071392.590903:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c688380 x1869685707578880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783071392.592499:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783071392.594802:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c688380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1869685707578880:0@lo:400:kworker.0 00010000:00080000:0.0:1783071392.594999:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c689c00 x1869685707579392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071392.595012:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c689c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1869685707579392:0@lo:400:kworker.0 00000100:00100000:2.0:1783071392.598578:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707578112 00000100:00100000:2.0:1783071392.598594:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707578112 00000100:00100000:2.0:1783071392.598686:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707578624 00000100:00100000:2.0:1783071392.598690:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707578624 00000100:00100000:2.0:1783071392.598712:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1783071392.598724:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c78df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707578112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783071392.598776:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1783071392.599277:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c78df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707578112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 554us (16061us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071392.599707:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1783071392.599735:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1783071392.599744:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c68b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707578624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071392.599806:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c68b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707578624:12345-0@lo:400:kworker.0 Request processed in 52us (13570us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071392.599812:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783071392.600080:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707578112:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783071392.600122:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707578624:0@lo:400:kworker.0 00010000:00010000:2.0:1783071393.026745:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071393.090688:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c66ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707579904:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783071393.090765:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071393.090857:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783071393.090864:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707579776:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783071393.090888:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071393.090972:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707579904 00000100:00100000:3.0:1783071393.090980:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707579904 00000100:00100000:3.0:1783071393.091020:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707579776 00000100:00100000:3.0:1783071393.091024:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707579776 00000100:00100000:3.0:1783071393.091040:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783071393.091050:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c66a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707579904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783071393.091098:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783071393.091158:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c66a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707579904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071393.091166:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783071393.091183:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783071393.091190:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37a60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707579776:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783071393.091205:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783071393.091240:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37a60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707579776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071393.091246:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1783071393.091409:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c6a3480 x1869685707579776/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071409 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071393.091430:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707579776:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1783071393.091441:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c66ad80 x1869685707579904/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071409 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071393.091452:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c66ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707579904:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783071393.091605:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783071393.091616:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c68b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707580032:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783071393.091652:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071393.091678:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707580032 00000100:00100000:1.0:1783071393.091681:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707580032 00000100:00100000:1.0:1783071393.091704:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783071393.091710:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c689f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707580032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783071393.091721:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783071393.091751:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c689f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707580032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (97us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071393.091756:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1783071393.091805:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c68b800 x1869685707580032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071409 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071393.091821:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c68b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707580032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783071393.091925:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783071393.091934:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37a63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707580160:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783071393.091962:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071393.091986:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707580160 00000100:00100000:0.0:1783071393.091990:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707580160 00000100:00100000:0.0:1783071393.092012:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783071393.092018:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37a60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707580160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783071393.092029:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783071393.092094:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37a60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707580160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071393.092101:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1783071393.092125:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b37a63800 x1869685707580160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071409 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071393.092138:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37a63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707580160:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783071394.051276:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071394.115572:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783071394.115598:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03808000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707580288:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783071394.115674:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071394.115860:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707580288 00000100:00100000:2.0:1783071394.115871:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707580288 00000100:00100000:2.0:1783071394.115934:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1783071394.115945:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c68b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707580288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783071394.116352:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783071394.116464:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c68b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707580288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 520us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071394.116472:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783071394.116573:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03808000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707580288:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1783071394.896735:0:11117:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.83 00010000:00010000:3.0:1783071395.075920:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071395.601651:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071395.601691:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071395.601753:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071395.601797:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692834944 00000100:00100000:3.0:1783071395.601810:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692834944 00000100:00100000:3.0:1783071395.601897:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692834816 00000100:00100000:3.0:1783071395.601901:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692834816 00000100:00100000:3.0:1783071395.601928:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 88 00000100:00100000:3.0:1783071395.601940:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+5:2403:x1869685692834944:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1783071395.602045:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+5:2403:x1869685692834944:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 106us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071395.602053:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 88 00000100:00100000:3.0:1783071395.602074:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 89 00000100:00100000:3.0:1783071395.602080:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02c0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+6:2403:x1869685692834816:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1783071395.602105:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02c0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+6:2403:x1869685692834816:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 26us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071395.602111:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 89 00000100:00080000:3.0:1783071395.602132:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783071395.602136:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783071395.602869:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692834688 00000100:00100000:0.0:1783071395.602878:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692834688 00000100:00100000:0.0:1783071395.602929:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 279 00000100:00100000:0.0:1783071395.602938:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e4e7df8-beb0-40df-a2a1-9decaa005633+10:2403:x1869685692834688:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1783071395.602993:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e4e7df8-beb0-40df-a2a1-9decaa005633+10:2403:x1869685692834688:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 56us (1359us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071395.603000:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 279 00010000:00010000:3.0:1783071396.099794:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783071396.169798:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bf7532e4-6153-424a-9f4e-84941256b41f 00000020:00000080:2.0:1783071396.169809:0:9510:0:(genops.c:906:class_export_put()) final put ffff8f8a03245800/bf7532e4-6153-424a-9f4e-84941256b41f 00000020:00000080:3.0:1783071396.169891:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8a03245800/bf7532e4-6153-424a-9f4e-84941256b41f for lustre-OST0001 00000020:00000080:3.0:1783071396.169947:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f8a03247800 for lustre-OST0001 00000001:00100000:2.0:1783071396.171353:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bf7532e4-6153-424a-9f4e-84941256b41f 00000020:00000080:2.0:1783071396.171408:0:8425:0:(genops.c:906:class_export_put()) final put ffff8f8a02c76800/bf7532e4-6153-424a-9f4e-84941256b41f 00000020:00000080:0.0:1783071396.171506:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8a02c76800/bf7532e4-6153-424a-9f4e-84941256b41f for lustre-OST0000 00000020:00000080:0.0:1783071396.171576:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f8a02c77000 for lustre-OST0000 00010000:00010000:3.0:1783071397.128039:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783071397.382810:0:11214:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.83 00000100:00100000:0.0:1783071397.701211:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37a63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707580416:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783071397.701297:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071397.701399:0:9413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707580416 00000100:00100000:0.0:1783071397.701408:0:9413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707580416 00000100:00100000:0.0:1783071397.701459:0:9413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1783071397.701469:0:9413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37a61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707580416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783071397.701506:0:9413:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1783071397.701551:0:9413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37a61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707580416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071397.701559:0:9413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1783071397.701623:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37a63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707580416:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783071397.702667:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03809180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869685707580672:0@lo:400:kworker.0 00000100:00100000:0.0:1783071397.702873:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03808a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:feaa1501-b927-4e07-baad-3200e92d7497:3645:1869685707580544:0@lo:400:kworker.0 00000100:00100000:0.0:1783071397.702921:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071397.702954:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03809880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1869685707581056:0@lo:400:kworker.0 00000100:00100000:0.0:1783071397.702981:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071397.703001:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03809f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1869685707581568:0@lo:400:kworker.0 00000100:00100000:0.0:1783071397.703021:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071397.703056:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707580544 00000100:00100000:0.0:1783071397.703062:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707580544 00000100:00100000:0.0:1783071397.703114:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1783071397.703121:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+24:3645:x1869685707580544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071397.703165:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+24:3645:x1869685707580544:12345-0@lo:400:kworker.0 Request processed in 44us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071397.703172:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1783071397.703204:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707581056 00000100:00100000:0.0:1783071397.703207:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707581056 00000100:00100000:0.0:1783071397.703241:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707581568 00000100:00100000:0.0:1783071397.703243:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707581568 00000100:00100000:0.0:1783071397.703261:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1783071397.703267:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37a63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1869685707581056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071397.703301:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37a63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1869685707581056:12345-0@lo:400:kworker.0 Request processed in 34us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071397.703307:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1783071397.703319:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1783071397.703325:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37a61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1869685707581568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071397.703352:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37a61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1869685707581568:12345-0@lo:400:kworker.0 Request processed in 27us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071397.703388:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:0.0:1783071397.703412:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783071397.703429:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0380a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869685707580800:0@lo:400:kworker.0 00000100:00100000:0.0:1783071397.703456:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071397.703473:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03808380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707581312:0@lo:400:kworker.0 00000100:00100000:0.0:1783071397.703513:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071397.703535:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03809c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707581824:0@lo:400:kworker.0 00000100:00100000:0.0:1783071397.703556:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071397.703572:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1783071397.703578:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0380bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707580928:0@lo:400:kworker.0 00000100:00100000:0.0:1783071397.703601:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071397.703618:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03809500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707581440:0@lo:400:kworker.0 00000100:00100000:0.0:1783071397.703641:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071397.703658:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03808000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707581952:0@lo:400:kworker.0 00000100:00100000:0.0:1783071397.703676:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071397.703725:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707581312 00000100:00100000:0.0:1783071397.703729:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707581312 00000100:00100000:0.0:1783071397.703754:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707581824 00000100:00100000:0.0:1783071397.703756:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707581824 00000100:00100000:0.0:1783071397.703767:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707581440 00000100:00100000:0.0:1783071397.703769:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707581440 00000100:00100000:0.0:1783071397.703792:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707581952 00000100:00100000:0.0:1783071397.703795:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707581952 00000100:00100000:0.0:1783071397.703809:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783071397.703815:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707581312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071397.703853:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707581312:12345-0@lo:400:kworker.0 Request processed in 38us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071397.703866:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783071397.703880:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783071397.703885:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707581824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071397.703914:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707581824:12345-0@lo:400:kworker.0 Request processed in 29us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071397.703919:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783071397.703932:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783071397.703937:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707581440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071397.703961:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707581440:12345-0@lo:400:kworker.0 Request processed in 24us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071397.703966:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783071397.703977:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783071397.703984:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707581952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071397.704010:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707581952:12345-0@lo:400:kworker.0 Request processed in 27us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071397.704016:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783071397.704039:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707580928 00000100:00100000:0.0:1783071397.704042:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707580928 00000100:00100000:0.0:1783071397.704064:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1783071397.704070:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707580928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071397.704100:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707580928:12345-0@lo:400:kworker.0 Request processed in 29us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071397.704106:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:0.0:1783071397.704127:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783071397.704130:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783071397.704162:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03808a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:feaa1501-b927-4e07-baad-3200e92d7497:3645:1869685707580544:0@lo:400:kworker.0 00000100:00100000:0.0:1783071397.704177:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03809880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1869685707581056:0@lo:400:kworker.0 00000100:00100000:0.0:1783071397.704188:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03809f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1869685707581568:0@lo:400:kworker.0 00000100:00100000:0.0:1783071397.704218:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707580800 00000100:00100000:0.0:1783071397.704221:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707580800 00000100:00100000:0.0:1783071397.704243:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1783071397.704250:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c66ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869685707580800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071397.704278:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c66ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869685707580800:12345-0@lo:400:kworker.0 Request processed in 28us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071397.704284:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1783071397.704316:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0380bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707580928:0@lo:400:kworker.0 00010000:00080000:0.0:1783071397.704328:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a03809500 x1869685707581440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071397.704338:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03809500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707581440:0@lo:400:kworker.0 00010000:00080000:0.0:1783071397.704348:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a03808000 x1869685707581952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071397.704357:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03808000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707581952:0@lo:400:kworker.0 00000100:00100000:0.0:1783071397.704390:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0380a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869685707580800:0@lo:400:kworker.0 00010000:00080000:0.0:1783071397.704401:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a03808380 x1869685707581312/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071397.704409:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03808380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707581312:0@lo:400:kworker.0 00010000:00080000:0.0:1783071397.704419:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a03809c00 x1869685707581824/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071397.704434:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03809c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707581824:0@lo:400:kworker.0 00000100:00100000:2.0:1783071397.704837:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071397.704879:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0380aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1869685707581184:0@lo:400:kworker.0 00000100:00100000:2.0:1783071397.704908:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071397.704923:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0380ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1869685707581696:0@lo:400:kworker.0 00000100:00100000:2.0:1783071397.704942:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071397.705165:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707580672 00000100:00100000:0.0:1783071397.705171:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707580672 00000100:00100000:0.0:1783071397.705206:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707581184 00000100:00100000:0.0:1783071397.705209:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707581184 00000100:00100000:0.0:1783071397.705235:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707581696 00000100:00100000:0.0:1783071397.705238:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707581696 00000100:00100000:0.0:1783071397.705252:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1783071397.705257:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03809c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869685707580672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071397.705306:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03809c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869685707580672:12345-0@lo:400:kworker.0 Request processed in 48us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071397.705313:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1783071397.705326:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1783071397.705331:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03808380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869685707581184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071397.705355:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03808380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869685707581184:12345-0@lo:400:kworker.0 Request processed in 24us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071397.705389:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1783071397.705401:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1783071397.705406:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0380a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869685707581696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071397.705433:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0380a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869685707581696:12345-0@lo:400:kworker.0 Request processed in 27us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071397.705439:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1783071397.705468:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03809180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869685707580672:0@lo:400:kworker.0 00010000:00080000:0.0:1783071397.705477:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a0380aa00 x1869685707581184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071397.705502:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0380aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1869685707581184:0@lo:400:kworker.0 00010000:00080000:0.0:1783071397.705515:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a0380ad80 x1869685707581696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071397.705523:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0380ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1869685707581696:0@lo:400:kworker.0 00000100:00080000:3.0:1783071397.705600:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1783071398.148073:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071398.211974:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783071398.212001:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c688700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707582080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783071398.212075:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071398.212151:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707582080 00000100:00100000:1.0:1783071398.212158:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707582080 00000100:00100000:1.0:1783071398.212207:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783071398.212216:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c689500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707582080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783071398.212249:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783071398.212291:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c689500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707582080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071398.212298:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1783071398.212338:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c688700 x1869685707582080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071414 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071398.212356:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c688700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707582080:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783071398.213027:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783071398.213038:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03808000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707582336:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783071398.213071:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071398.213094:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783071398.213100:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707582208:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783071398.213118:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071398.213144:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707582336 00000100:00100000:2.0:1783071398.213148:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707582336 00000100:00100000:2.0:1783071398.213167:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707582208 00000100:00100000:2.0:1783071398.213169:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707582208 00000100:00100000:2.0:1783071398.213179:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783071398.213185:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03809500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707582336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783071398.213204:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783071398.213234:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03809500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707582336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 48us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071398.213240:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783071398.213251:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783071398.213256:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0380bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707582208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783071398.213276:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783071398.213300:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0380bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707582208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071398.213305:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1783071398.213327:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a032cb800 x1869685707582208/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071414 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071398.213340:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707582208:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1783071398.213360:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a03808000 x1869685707582336/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071414 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071398.213393:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03808000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707582336:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783071398.213843:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783071398.213853:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c688700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707582464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783071398.213892:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071398.214107:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707582464 00000100:00100000:1.0:1783071398.214113:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707582464 00000100:00100000:1.0:1783071398.214147:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783071398.214154:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707582464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783071398.214167:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783071398.214200:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707582464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071398.214206:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1783071398.214232:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c688700 x1869685707582464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071414 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071398.214246:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c688700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707582464:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783071399.170931:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071399.235112:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783071399.235132:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03808000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707582592:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783071399.235200:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071399.238795:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707582592 00000100:00100000:2.0:1783071399.238813:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707582592 00000100:00100000:2.0:1783071399.238882:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1783071399.238893:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c688700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707582592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783071399.238939:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783071399.239053:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c688700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707582592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 161us (3851us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071399.239060:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783071399.240031:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03808000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707582592:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1783071400.020076:0:11311:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.83 00010000:00010000:2.0:1783071400.203168:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071400.724428:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071400.724725:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071400.724802:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692835200 00000100:00100000:3.0:1783071400.724809:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071400.724812:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692835200 00000100:00080000:3.0:1783071400.724846:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783071400.724878:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692835328 00000100:00100000:0.0:1783071400.724882:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692835328 00000100:00100000:3.0:1783071400.724894:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 96 00000100:00100000:3.0:1783071400.724923:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02c09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+6:2406:x1869685692835200:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1783071400.725004:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02c09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+6:2406:x1869685692835200:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 85us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071400.725064:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692835072 00000100:00100000:1.0:1783071400.725069:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692835072 00000100:00100000:1.0:1783071400.725100:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 281 00000100:00100000:1.0:1783071400.725107:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e4e7df8-beb0-40df-a2a1-9decaa005633+10:2406:x1869685692835072:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1783071400.725135:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e4e7df8-beb0-40df-a2a1-9decaa005633+10:2406:x1869685692835072:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 28us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071400.725142:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 281 00000100:00080000:1.0:1783071400.725201:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783071400.727357:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 97 00000100:00100000:0.0:1783071400.727387:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02c09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+5:2406:x1869685692835328:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1783071400.727462:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02c09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+5:2406:x1869685692835328:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 81us (2653us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071400.727471:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 97 00000100:00100000:3.0:1783071400.729888:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 96 00010000:00010000:3.0:1783071401.219071:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783071401.436028:0:11360:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Jul 3 05:36:40 EDT 2026 00010000:00010000:3.0:1783071402.243083:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071402.827623:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03809f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:feaa1501-b927-4e07-baad-3200e92d7497:3646:1869685707582720:0@lo:400:kworker.0 00000100:00100000:2.0:1783071402.827697:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071402.827745:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0380ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707583232:0@lo:400:kworker.0 00000100:00100000:2.0:1783071402.827773:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071402.827794:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707583744:0@lo:400:kworker.0 00000100:00100000:2.0:1783071402.827827:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071402.827847:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b2fcb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707584256:0@lo:400:kworker.0 00000100:00100000:2.0:1783071402.827868:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071402.827891:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1783071402.827897:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03808000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869685707583104:0@lo:400:kworker.0 00000100:00100000:2.0:1783071402.827920:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071402.827938:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707583616:0@lo:400:kworker.0 00000100:00100000:2.0:1783071402.827957:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071402.827974:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707584128:0@lo:400:kworker.0 00000100:00100000:2.0:1783071402.827996:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071402.828024:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03809880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869685707582848:0@lo:400:kworker.0 00000100:00100000:2.0:1783071402.828047:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071402.828064:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0380aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1869685707583360:0@lo:400:kworker.0 00000100:00100000:2.0:1783071402.828083:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071402.828099:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1869685707583872:0@lo:400:kworker.0 00000100:00100000:2.0:1783071402.828119:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071402.828135:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1783071402.828140:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03808a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707582976:0@lo:400:kworker.0 00000100:00100000:2.0:1783071402.828157:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071402.828169:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03809180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1869685707583488:0@lo:400:kworker.0 00000100:00100000:2.0:1783071402.828185:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071402.828193:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1869685707584000:0@lo:400:kworker.0 00000100:00100000:2.0:1783071402.828212:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071402.828238:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707582720 00000100:00100000:2.0:1783071402.828251:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707582720 00000100:00100000:2.0:1783071402.828301:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1783071402.828311:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+24:3646:x1869685707582720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071402.828389:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+24:3646:x1869685707582720:12345-0@lo:400:kworker.0 Request processed in 52us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071402.828398:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1783071402.828435:0:9413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707583232 00000100:00100000:2.0:1783071402.828440:0:9413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707583232 00000100:00100000:2.0:1783071402.828466:0:9413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707582976 00000100:00100000:2.0:1783071402.828470:0:9413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707582976 00000100:00100000:2.0:1783071402.828484:0:9413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783071402.828494:0:9413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707583232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071402.828532:0:9413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707583232:12345-0@lo:400:kworker.0 Request processed in 42us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071402.828538:0:9413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783071402.828550:0:9413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783071402.828556:0:9413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03331c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707582976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071402.828587:0:9413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03331c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707582976:12345-0@lo:400:kworker.0 Request processed in 31us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071402.828593:0:9413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783071402.828622:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707583744 00000100:00100000:2.0:1783071402.828626:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707583744 00000100:00100000:2.0:1783071402.828654:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707584256 00000100:00100000:2.0:1783071402.828657:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707584256 00000100:00100000:2.0:1783071402.828670:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707583616 00000100:00100000:2.0:1783071402.828672:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707583616 00000100:00100000:2.0:1783071402.828683:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707584128 00000100:00100000:2.0:1783071402.828685:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707584128 00000100:00100000:2.0:1783071402.828697:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783071402.828710:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707583744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071402.828745:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707583744:12345-0@lo:400:kworker.0 Request processed in 36us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071402.828752:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783071402.828764:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783071402.828770:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b078daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707584256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071402.828797:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b078daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707584256:12345-0@lo:400:kworker.0 Request processed in 28us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071402.828803:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783071402.828813:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783071402.828819:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3b4d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707583616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071402.828843:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3b4d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707583616:12345-0@lo:400:kworker.0 Request processed in 25us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071402.828848:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783071402.828859:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783071402.828866:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3b4dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707584128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071402.828892:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3b4dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707584128:12345-0@lo:400:kworker.0 Request processed in 27us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071402.828897:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783071402.828921:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707583104 00000100:00100000:2.0:1783071402.828925:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707583104 00000100:00100000:2.0:1783071402.828942:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707582848 00000100:00100000:2.0:1783071402.828945:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707582848 00000100:00100000:2.0:1783071402.828956:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707583360 00000100:00100000:2.0:1783071402.828958:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707583360 00000100:00100000:2.0:1783071402.828969:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707583872 00000100:00100000:2.0:1783071402.828970:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707583872 00000100:00100000:2.0:1783071402.828988:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707583488 00000100:00100000:2.0:1783071402.828991:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707583488 00000100:00100000:2.0:1783071402.829001:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707584000 00000100:00100000:2.0:1783071402.829003:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707584000 00000100:00100000:2.0:1783071402.829014:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1783071402.829019:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3b4d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869685707583104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071402.829048:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3b4d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869685707583104:12345-0@lo:400:kworker.0 Request processed in 29us (1128us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071402.829054:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1783071402.829064:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1783071402.829068:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03331180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869685707582848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071402.829097:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03331180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869685707582848:12345-0@lo:400:kworker.0 Request processed in 28us (1049us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071402.829103:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1783071402.829114:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1783071402.829119:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03331880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869685707583360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071402.829144:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03331880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869685707583360:12345-0@lo:400:kworker.0 Request processed in 25us (1060us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071402.829149:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1783071402.829159:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1783071402.829165:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03331500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869685707583872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071402.829190:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03331500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869685707583872:12345-0@lo:400:kworker.0 Request processed in 26us (1071us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071402.829196:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1783071402.829206:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1783071402.829212:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03330380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869685707583488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071402.829248:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03330380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869685707583488:12345-0@lo:400:kworker.0 Request processed in 36us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071402.829254:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1783071402.829265:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1783071402.829271:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869685707584000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071402.829295:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869685707584000:12345-0@lo:400:kworker.0 Request processed in 25us (1082us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071402.829300:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1783071402.829396:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03808000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869685707583104:0@lo:400:kworker.0 00010000:00080000:2.0:1783071402.829413:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c78e680 x1869685707583616/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071402.829424:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707583616:0@lo:400:kworker.0 00010000:00080000:2.0:1783071402.829435:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c78f480 x1869685707584128/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071402.829444:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707584128:0@lo:400:kworker.0 00000100:00100000:2.0:1783071402.829454:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03809f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:feaa1501-b927-4e07-baad-3200e92d7497:3646:1869685707582720:0@lo:400:kworker.0 00000100:00100000:2.0:1783071402.829465:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0380ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707583232:0@lo:400:kworker.0 00010000:00080000:2.0:1783071402.829474:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c78f800 x1869685707583744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071402.829483:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707583744:0@lo:400:kworker.0 00010000:00080000:2.0:1783071402.829494:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b2fcb0000 x1869685707584256/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071402.829514:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b2fcb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707584256:0@lo:400:kworker.0 00000100:00100000:2.0:1783071402.829563:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03808a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707582976:0@lo:400:kworker.0 00010000:00080000:2.0:1783071402.829574:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a03809180 x1869685707583488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071402.829583:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03809180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1869685707583488:0@lo:400:kworker.0 00010000:00080000:2.0:1783071402.829592:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c78c380 x1869685707584000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071402.829613:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1869685707584000:0@lo:400:kworker.0 00000100:00100000:2.0:1783071402.829624:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03809880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869685707582848:0@lo:400:kworker.0 00000100:00100000:2.0:1783071402.829633:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0380aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1869685707583360:0@lo:400:kworker.0 00000100:00100000:2.0:1783071402.829643:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1869685707583872:0@lo:400:kworker.0 00000100:00080000:2.0:1783071402.829666:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783071402.829669:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783071402.829672:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783071402.829674:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783071402.834836:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02c08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707584384:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783071402.834907:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071402.836611:0:9413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707584384 00000100:00100000:3.0:1783071402.836623:0:9413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707584384 00000100:00100000:3.0:1783071402.836677:0:9413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1783071402.836687:0:9413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707584384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783071402.836727:0:9413:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783071402.836800:0:9413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707584384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 114us (1893us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071402.836808:0:9413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1783071402.839328:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02c08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707584384:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1783071403.281690:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071403.330533:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783071403.330557:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c689180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707584512:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783071403.330638:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071403.330705:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707584512 00000100:00100000:1.0:1783071403.330713:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707584512 00000100:00100000:1.0:1783071403.330765:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783071403.330775:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c68a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707584512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783071403.330822:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783071403.331047:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c68a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707584512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 273us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071403.331055:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1783071403.331097:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c689180 x1869685707584512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071419 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071403.331114:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c689180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707584512:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783071403.332509:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02c0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707584640:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783071403.332564:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071403.332625:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707584640 00000100:00100000:3.0:1783071403.332631:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707584640 00000100:00100000:3.0:1783071403.332677:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783071403.332685:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02c09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707584640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783071403.332709:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783071403.332745:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02c09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707584640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071403.332751:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1783071403.332780:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a02c0aa00 x1869685707584640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071419 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071403.332820:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02c0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707584640:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783071403.334405:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707584768:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783071403.334458:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071403.334574:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707584768 00000100:00100000:0.0:1783071403.334580:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707584768 00000100:00100000:0.0:1783071403.334628:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783071403.334636:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02c0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707584768:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783071403.334656:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783071403.334716:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02c0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707584768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071403.334723:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1783071403.335030:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a032cb100 x1869685707584768/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071419 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071403.335047:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707584768:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783071403.340142:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783071403.340163:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c689180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707584896:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783071403.340227:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071403.340397:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707584896 00000100:00100000:1.0:1783071403.340404:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707584896 00000100:00100000:1.0:1783071403.340450:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783071403.340459:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02c0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707584896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783071403.340489:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783071403.340531:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02c0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707584896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071403.340538:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:0.0:1783071403.340726:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c689180 x1869685707584896/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071419 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071403.340744:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c689180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707584896:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1783071404.296445:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071404.358847:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707585024:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783071404.358940:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071404.359146:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707585024 00000100:00100000:3.0:1783071404.359155:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707585024 00000100:00100000:3.0:1783071404.359211:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1783071404.359239:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707585024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783071404.359286:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783071404.362528:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707585024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3298us (3579us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071404.362542:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1783071404.364966:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707585024:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1783071405.320605:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071405.849669:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071405.851172:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071405.851216:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071405.851249:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692835456 00000100:00100000:0.0:1783071405.851259:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692835456 00000100:00100000:0.0:1783071405.851323:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 283 00000100:00100000:0.0:1783071405.851334:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e4e7df8-beb0-40df-a2a1-9decaa005633+10:2406:x1869685692835456:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1783071405.851436:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e4e7df8-beb0-40df-a2a1-9decaa005633+10:2406:x1869685692835456:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 104us (1777us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071405.851445:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 283 00000100:00100000:0.0:1783071405.851498:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692835712 00000100:00100000:0.0:1783071405.851501:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692835712 00000100:00100000:0.0:1783071405.851531:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692835584 00000100:00100000:0.0:1783071405.851533:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692835584 00000100:00100000:0.0:1783071405.851567:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 104 00000100:00100000:0.0:1783071405.851574:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+5:2406:x1869685692835712:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1783071405.851602:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+5:2406:x1869685692835712:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 29us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071405.851618:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 104 00000100:00100000:0.0:1783071405.851630:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 105 00000100:00100000:0.0:1783071405.851636:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+6:2406:x1869685692835584:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1783071405.851658:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+6:2406:x1869685692835584:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 23us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071405.851663:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 105 00000100:00080000:0.0:1783071405.851775:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783071405.851779:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1783071406.345620:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071407.371754:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071407.939149:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02c0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707585152:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783071407.939258:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071407.939567:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707585152 00000100:00100000:2.0:1783071407.939585:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707585152 00000100:00100000:2.0:1783071407.939648:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783071407.939659:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707585152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783071407.939699:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1783071407.939797:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707585152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 140us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071407.939804:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1783071407.941862:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02c08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869685707585408:0@lo:400:kworker.0 00000100:00100000:3.0:1783071407.941947:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071407.942009:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0178f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1869685707585920:0@lo:400:kworker.0 00000100:00100000:3.0:1783071407.942034:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071407.942073:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0178fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1869685707586432:0@lo:400:kworker.0 00000100:00100000:0.0:1783071407.942149:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02c08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869685707585536:0@lo:400:kworker.0 00000100:00100000:2.0:1783071407.946586:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707585408 00000100:00100000:2.0:1783071407.946602:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707585408 00000100:00100000:2.0:1783071407.946832:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707585920 00000100:00100000:2.0:1783071407.946836:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707585920 00000100:00100000:2.0:1783071407.946874:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1783071407.946884:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01764380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869685707585408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071407.947122:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02c0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707585152:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783071407.947174:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0178ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707585664:0@lo:400:kworker.0 00000100:00100000:0.0:1783071407.947408:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1783071407.947426:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869685707585920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071407.953438:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01764380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869685707585408:12345-0@lo:400:kworker.0 Request processed in 6536us (11471us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071407.953453:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:2.0:1783071407.953511:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783071407.959196:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02c0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:feaa1501-b927-4e07-baad-3200e92d7497:3646:1869685707585280:0@lo:400:kworker.0 00000100:00100000:2.0:1783071407.959290:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071407.959347:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0178d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1869685707585792:0@lo:400:kworker.0 00000100:00100000:2.0:1783071407.959399:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071407.959579:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071407.959636:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0178ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707586176:0@lo:400:kworker.0 00000100:00100000:1.0:1783071407.959679:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071407.959704:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01766d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707586688:0@lo:400:kworker.0 00000100:00100000:1.0:1783071407.959728:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071407.959787:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707585664 00000100:00100000:1.0:1783071407.959797:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707585664 00000100:00100000:1.0:1783071407.959855:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783071407.959865:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c68bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707585664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071407.959918:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0178ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1869685707586304:0@lo:400:kworker.0 00000100:00100000:2.0:1783071407.959959:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071407.960027:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707585280 00000100:00100000:2.0:1783071407.960034:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707585280 00000100:00100000:2.0:1783071407.960090:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1783071407.960099:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+24:3646:x1869685707585280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071407.960163:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+24:3646:x1869685707585280:12345-0@lo:400:kworker.0 Request processed in 64us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071407.960171:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1783071407.961769:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869685707585920:12345-0@lo:400:kworker.0 Request processed in 14340us (19723us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071407.961785:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1783071407.965085:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707585792 00000100:00100000:2.0:1783071407.965115:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707585792 00000100:00100000:2.0:1783071407.965188:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707586304 00000100:00100000:2.0:1783071407.965192:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707586304 00000100:00100000:2.0:1783071407.965213:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1783071407.965222:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869685707585792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071407.965322:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869685707585792:12345-0@lo:400:kworker.0 Request processed in 100us (5922us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071407.965329:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1783071407.965346:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1783071407.965352:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869685707586304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071407.965399:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869685707586304:12345-0@lo:400:kworker.0 Request processed in 46us (5439us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071407.965405:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:2.0:1783071407.965434:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783071407.965551:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02c0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:feaa1501-b927-4e07-baad-3200e92d7497:3646:1869685707585280:0@lo:400:kworker.0 00000100:00100000:2.0:1783071407.965565:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0178d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1869685707585792:0@lo:400:kworker.0 00000100:00100000:2.0:1783071407.965575:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0178ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1869685707586304:0@lo:400:kworker.0 00000100:00100000:2.0:1783071407.967393:0:8910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707586176 00000100:00100000:2.0:1783071407.967405:0:8910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707586176 00000100:00100000:2.0:1783071407.967942:0:8910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707586688 00000100:00100000:2.0:1783071407.967947:0:8910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707586688 00000100:00100000:2.0:1783071407.967967:0:8910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783071407.967977:0:8910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c689880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707586176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071407.968068:0:8910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c689880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707586176:12345-0@lo:400:kworker.0 Request processed in 93us (8387us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071407.968075:0:8910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783071407.968106:0:8910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783071407.968112:0:8910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c68aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707586688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071407.968539:0:8910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c68aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707586688:12345-0@lo:400:kworker.0 Request processed in 426us (8809us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071407.968546:0:8910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1783071407.968578:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783071407.968582:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783071407.970221:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c68bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707585664:12345-0@lo:400:kworker.0 Request processed in 10344us (10636us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071407.970239:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783071407.970344:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0178ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707585664:0@lo:400:kworker.0 00010000:00080000:1.0:1783071407.970381:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a0178ca80 x1869685707586176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071407.970394:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0178ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707586176:0@lo:400:kworker.0 00010000:00080000:1.0:1783071407.970410:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a01766d80 x1869685707586688/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071407.970439:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01766d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707586688:0@lo:400:kworker.0 00000100:00100000:3.0:1783071407.976978:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071407.978001:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707586432 00000100:00100000:2.0:1783071407.978020:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707586432 00000100:00100000:2.0:1783071407.978117:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1783071407.978129:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01765f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869685707586432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071407.979354:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01765f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869685707586432:12345-0@lo:400:kworker.0 Request processed in 1223us (2381us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071407.979385:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:2.0:1783071407.979494:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1783071407.979544:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a0178fb80 x1869685707586432/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071407.979561:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0178fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1869685707586432:0@lo:400:kworker.0 00000100:00100000:2.0:1783071407.979596:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02c08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869685707585408:0@lo:400:kworker.0 00010000:00080000:2.0:1783071407.979608:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a0178f800 x1869685707585920/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071407.979618:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0178f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1869685707585920:0@lo:400:kworker.0 00000100:00100000:0.0:1783071407.980198:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071407.980264:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0178d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707586048:0@lo:400:kworker.0 00000100:00100000:0.0:1783071407.980322:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071407.980352:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01764700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707586560:0@lo:400:kworker.0 00000100:00100000:2.0:1783071407.980401:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707585536 00000100:00100000:2.0:1783071407.980410:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707585536 00000100:00100000:0.0:1783071407.980417:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071407.980875:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1783071407.980886:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869685707585536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071407.980991:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869685707585536:12345-0@lo:400:kworker.0 Request processed in 106us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071407.981002:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1783071407.981034:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02c08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869685707585536:0@lo:400:kworker.0 00000100:00100000:2.0:1783071407.981036:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707586048 00000100:00100000:2.0:1783071407.981045:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707586048 00000100:00100000:2.0:1783071407.981082:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707586560 00000100:00100000:2.0:1783071407.981086:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707586560 00000100:00100000:2.0:1783071407.981108:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783071407.981115:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707586048:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1783071407.981247:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a0178d500 x1869685707586048/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071407.981260:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0178d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707586048:0@lo:400:kworker.0 00000100:00100000:2.0:1783071407.981855:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707586048:12345-0@lo:400:kworker.0 Request processed in 38us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071407.981866:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783071407.981888:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783071407.981898:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707586560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071407.981963:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707586560:12345-0@lo:400:kworker.0 Request processed in 65us (1543us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071407.981972:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:0.0:1783071407.981986:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a01764700 x1869685707586560/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783071407.981998:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783071407.982000:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01764700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707586560:0@lo:400:kworker.0 00000100:00080000:2.0:1783071407.982004:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1783071408.395192:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071408.450813:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783071408.450841:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c689180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707586816:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783071408.450913:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071408.450974:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707586816 00000100:00100000:1.0:1783071408.450982:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707586816 00000100:00100000:1.0:1783071408.451038:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783071408.451047:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c689c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707586816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783071408.451093:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783071408.451155:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c689c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707586816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071408.451162:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1783071408.451205:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c689180 x1869685707586816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071424 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071408.451225:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c689180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707586816:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783071408.455602:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783071408.455622:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707586944:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783071408.455683:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071408.455732:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707586944 00000100:00100000:3.0:1783071408.455739:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707586944 00000100:00100000:3.0:1783071408.455782:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1783071408.455792:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707586944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783071408.455823:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783071408.455867:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707586944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071408.455875:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1783071408.455909:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a01765880 x1869685707586944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071424 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071408.455926:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707586944:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783071408.456629:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783071408.456640:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707587072:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783071408.456676:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071408.456710:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707587072 00000100:00100000:2.0:1783071408.456714:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707587072 00000100:00100000:2.0:1783071408.456740:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783071408.456746:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707587072:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783071408.456761:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783071408.456805:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707587072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071408.456812:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1783071408.456842:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c6a9500 x1869685707587072/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071424 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071408.456855:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707587072:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783071408.457573:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783071408.457585:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707587200:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783071408.457620:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071408.457658:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707587200 00000100:00100000:3.0:1783071408.457663:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707587200 00000100:00100000:3.0:1783071408.457693:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783071408.457700:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707587200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783071408.457714:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783071408.457746:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707587200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071408.457764:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:3.0:1783071408.457794:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a01765880 x1869685707587200/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071424 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071408.457808:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707587200:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1783071409.419660:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071409.475542:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783071409.475662:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707587328:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783071409.475736:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071409.475832:0:9413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707587328 00000100:00100000:3.0:1783071409.475842:0:9413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707587328 00000100:00100000:3.0:1783071409.475898:0:9413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1783071409.475908:0:9413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707587328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783071409.475944:0:9413:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783071409.475991:0:9413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707587328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071409.475998:0:9413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1783071409.476041:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707587328:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1783071410.437553:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071410.962323:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071410.962702:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692835840 00000100:00100000:1.0:1783071410.962713:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692835840 00000100:00100000:1.0:1783071410.962783:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 285 00000100:00100000:1.0:1783071410.962794:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e4e7df8-beb0-40df-a2a1-9decaa005633+10:2405:x1869685692835840:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1783071410.962868:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e4e7df8-beb0-40df-a2a1-9decaa005633+10:2405:x1869685692835840:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 75us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071410.962877:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 285 00000100:00100000:1.0:1783071410.966902:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071410.967016:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071410.967127:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692835968 00000100:00100000:2.0:1783071410.967137:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692835968 00000100:00100000:2.0:1783071410.967192:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692836096 00000100:00100000:2.0:1783071410.967195:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692836096 00000100:00100000:3.0:1783071410.967212:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 112 00000100:00100000:3.0:1783071410.967226:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c689180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+6:2406:x1869685692835968:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1783071410.967297:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c689180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+6:2406:x1869685692835968:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 75us (406us total) trans 0 rc 0/0 00000100:00080000:0.0:1783071410.969737:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783071410.969747:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783071410.973156:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 112 00000100:00100000:3.0:1783071410.973208:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 113 00000100:00100000:3.0:1783071410.973225:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c688380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+5:2405:x1869685692836096:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1783071410.973320:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c688380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+5:2405:x1869685692836096:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 103us (6304us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071410.973341:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 113 00010000:00010000:0.0:1783071411.458790:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071412.482609:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071413.059683:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783071413.059708:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707587456:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783071413.059781:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071413.060035:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707587456 00000100:00100000:3.0:1783071413.060045:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707587456 00000100:00100000:3.0:1783071413.060106:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1783071413.060117:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c68ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707587456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783071413.060153:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783071413.060200:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c68ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707587456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071413.060207:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1783071413.061766:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707587456:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783071413.061797:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869685707587712:0@lo:400:kworker.0 00000100:00100000:1.0:1783071413.061809:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:feaa1501-b927-4e07-baad-3200e92d7497:3648:1869685707587584:0@lo:400:kworker.0 00000100:00100000:0.0:1783071413.061955:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869685707587840:0@lo:400:kworker.0 00000100:00100000:2.0:1783071413.064445:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707587968:0@lo:400:kworker.0 00000100:00100000:3.0:1783071413.066763:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071413.066847:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c68ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1869685707588224:0@lo:400:kworker.0 00000100:00100000:3.0:1783071413.066886:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071413.066908:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c68ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1869685707588736:0@lo:400:kworker.0 00000100:00100000:3.0:1783071413.066926:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071413.066970:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707587712 00000100:00100000:3.0:1783071413.067661:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707587712 00000100:00100000:3.0:1783071413.067716:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707588224 00000100:00100000:3.0:1783071413.067720:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707588224 00000100:00100000:3.0:1783071413.067744:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707588736 00000100:00100000:3.0:1783071413.067747:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707588736 00000100:00100000:3.0:1783071413.067763:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1783071413.067771:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1869685707587712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071413.067834:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1869685707587712:12345-0@lo:400:kworker.0 Request processed in 62us (1077us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071413.067841:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1783071413.067871:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1783071413.067877:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1869685707588224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071413.067905:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1869685707588224:12345-0@lo:400:kworker.0 Request processed in 29us (1019us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071413.067911:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1783071413.067923:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1783071413.067929:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01766d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1869685707588736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071413.067955:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01766d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1869685707588736:12345-0@lo:400:kworker.0 Request processed in 26us (1027us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071413.067960:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00010000:00080000:3.0:1783071413.068128:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c68ed80 x1869685707588224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071413.068142:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c68ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1869685707588224:0@lo:400:kworker.0 00010000:00080000:3.0:1783071413.068153:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c68ce00 x1869685707588736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071413.068161:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c68ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1869685707588736:0@lo:400:kworker.0 00000100:00100000:3.0:1783071413.068170:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869685707587712:0@lo:400:kworker.0 00000100:00100000:1.0:1783071413.070951:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071413.071066:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707587584 00000100:00100000:3.0:1783071413.071076:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707587584 00000100:00100000:3.0:1783071413.071132:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1783071413.071141:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+24:3648:x1869685707587584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071413.071244:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c68df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1869685707588096:0@lo:400:kworker.0 00000100:00100000:1.0:1783071413.071292:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071413.071313:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c68f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1869685707588608:0@lo:400:kworker.0 00000100:00100000:1.0:1783071413.071335:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071413.071382:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707588096 00000100:00100000:1.0:1783071413.071386:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707588096 00000100:00100000:1.0:1783071413.071421:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707588608 00000100:00100000:1.0:1783071413.071425:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707588608 00000100:00100000:1.0:1783071413.071440:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1783071413.071446:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02c08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869685707588096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071413.071497:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02c08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869685707588096:12345-0@lo:400:kworker.0 Request processed in 50us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071413.071504:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1783071413.071521:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1783071413.071526:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02c08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869685707588608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071413.071551:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02c08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869685707588608:12345-0@lo:400:kworker.0 Request processed in 25us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071413.071557:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1783071413.071617:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c68df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1869685707588096:0@lo:400:kworker.0 00000100:00100000:1.0:1783071413.071626:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c68f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1869685707588608:0@lo:400:kworker.0 00000100:00080000:1.0:1783071413.071669:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783071413.071684:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783071413.073929:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:feaa1501-b927-4e07-baad-3200e92d7497:3648:1869685707587584:0@lo:400:kworker.0 00000100:00100000:3.0:1783071413.074124:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+24:3648:x1869685707587584:12345-0@lo:400:kworker.0 Request processed in 2982us (3178us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071413.074137:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1783071413.078807:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071413.078867:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c68dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707588352:0@lo:400:kworker.0 00000100:00100000:1.0:1783071413.078915:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071413.078942:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c68f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707588864:0@lo:400:kworker.0 00000100:00100000:0.0:1783071413.079059:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707587840 00000100:00100000:0.0:1783071413.079067:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707587840 00000100:00100000:0.0:1783071413.079122:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1783071413.079132:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02c0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869685707587840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071413.079169:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071413.079187:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02c0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869685707587840:12345-0@lo:400:kworker.0 Request processed in 57us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071413.079195:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1783071413.079214:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869685707587840:0@lo:400:kworker.0 00000100:00100000:0.0:1783071413.079231:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707588352 00000100:00100000:0.0:1783071413.079234:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707588352 00000100:00080000:1.0:1783071413.079272:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783071413.079299:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707588864 00000100:00100000:1.0:1783071413.079302:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783071413.079303:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707588864 00000100:00100000:1.0:1783071413.079310:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02c0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707588352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071413.079336:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783071413.079342:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c681f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707588864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071413.079345:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02c0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707588352:12345-0@lo:400:kworker.0 Request processed in 37us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071413.079351:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783071413.079389:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c681f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707588864:12345-0@lo:400:kworker.0 Request processed in 47us (220us total) trans 0 rc 0/0 00010000:00080000:1.0:1783071413.079391:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c68dc00 x1869685707588352/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071413.079395:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783071413.079402:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c68dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707588352:0@lo:400:kworker.0 00000100:00080000:0.0:1783071413.079421:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1783071413.079432:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c68f100 x1869685707588864/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071413.079441:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c68f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707588864:0@lo:400:kworker.0 00000100:00100000:1.0:1783071413.083609:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071413.083660:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c68c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707588480:0@lo:400:kworker.0 00000100:00100000:0.0:1783071413.083680:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707587968 00000100:00100000:0.0:1783071413.083687:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707587968 00000100:00100000:1.0:1783071413.083710:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071413.083736:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c68e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707588992:0@lo:400:kworker.0 00000100:00100000:0.0:1783071413.083737:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1783071413.083746:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707587968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071413.083756:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071413.083801:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707587968:12345-0@lo:400:kworker.0 Request processed in 56us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071413.083809:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1783071413.083848:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707587968:0@lo:400:kworker.0 00000100:00100000:2.0:1783071413.083973:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707588480 00000100:00100000:2.0:1783071413.083986:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707588480 00000100:00100000:2.0:1783071413.084028:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707588992 00000100:00100000:2.0:1783071413.084031:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707588992 00000100:00100000:2.0:1783071413.084051:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783071413.084057:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c681c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707588480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071413.084095:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c681c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707588480:12345-0@lo:400:kworker.0 Request processed in 38us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071413.084101:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783071413.084110:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783071413.084115:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707588992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071413.084135:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707588992:12345-0@lo:400:kworker.0 Request processed in 21us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071413.084141:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:2.0:1783071413.084165:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c68c700 x1869685707588480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071413.084192:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c68c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707588480:0@lo:400:kworker.0 00010000:00080000:2.0:1783071413.084202:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c68e680 x1869685707588992/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071413.084210:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c68e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707588992:0@lo:400:kworker.0 00000100:00080000:0.0:1783071413.084622:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783071413.084626:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1783071413.506886:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071413.578222:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783071413.578245:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707589120:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783071413.578556:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707589248:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783071413.578589:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707589376:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783071413.579878:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071413.579967:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c68f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707589504:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783071413.580005:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071413.580036:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707589120 00000100:00100000:2.0:1783071413.580044:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707589120 00000100:00100000:2.0:1783071413.580076:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707589504 00000100:00100000:2.0:1783071413.580079:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707589504 00000100:00100000:2.0:1783071413.580095:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783071413.580102:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707589120:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783071413.580131:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783071413.580190:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707589120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (1873us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071413.580196:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783071413.580212:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783071413.580218:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707589504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783071413.580228:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783071413.580252:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707589504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 34us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071413.580268:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783071413.580287:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071413.581518:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707589248 00000100:00100000:0.0:1783071413.581527:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707589248 00000100:00100000:0.0:1783071413.581558:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783071413.581565:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0178d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707589248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783071413.581589:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783071413.581636:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0178d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707589248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (1347us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071413.581642:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:2.0:1783071413.582908:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a032cb800 x1869685707589248/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071429 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071413.582933:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707589248:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783071413.582974:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071413.583037:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707589376 00000100:00100000:2.0:1783071413.583043:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707589376 00000100:00100000:2.0:1783071413.583070:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783071413.583076:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0178f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707589376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783071413.583094:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783071413.583141:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0178f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707589376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071413.583147:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1783071413.585458:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a032cb100 x1869685707589376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071429 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071413.585495:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707589376:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1783071413.585616:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c68f480 x1869685707589504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071429 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071413.585631:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c68f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707589504:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1783071413.585646:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c6a9500 x1869685707589120/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071429 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071413.585659:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707589120:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1783071414.530802:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071414.597155:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783071414.597193:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c68c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707589632:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783071414.597313:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071414.597441:0:9413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707589632 00000100:00100000:3.0:1783071414.597451:0:9413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707589632 00000100:00100000:3.0:1783071414.597648:0:9413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1783071414.597659:0:9413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707589632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783071414.597707:0:9413:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783071414.597774:0:9413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707589632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 116us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071414.597782:0:9413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1783071414.597891:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c68c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707589632:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1783071415.559542:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783071415.811113:0:11989:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 05:36:55 (1783071415) === 00000100:00100000:1.0:1783071416.084123:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071416.084197:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071416.084248:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071416.084297:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692836480 00000100:00100000:2.0:1783071416.084313:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692836480 00000100:00100000:2.0:1783071416.084441:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692836352 00000100:00100000:2.0:1783071416.084446:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692836352 00000100:00100000:0.0:1783071416.084742:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692836224 00000100:00100000:0.0:1783071416.084753:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692836224 00000100:00080000:3.0:1783071416.084784:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783071416.084824:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 287 00000100:00100000:3.0:1783071416.084836:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 120 00000100:00100000:0.0:1783071416.084842:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e4e7df8-beb0-40df-a2a1-9decaa005633+10:2406:x1869685692836224:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1783071416.084859:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c683800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+5:2406:x1869685692836480:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1783071416.084961:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e4e7df8-beb0-40df-a2a1-9decaa005633+10:2406:x1869685692836224:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 123us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071416.084971:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 287 00000100:00100000:2.0:1783071416.085139:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 121 00000100:00100000:2.0:1783071416.085149:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+6:2406:x1869685692836352:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1783071416.085182:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+6:2406:x1869685692836352:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 36us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071416.085200:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 121 00000100:00080000:2.0:1783071416.085222:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783071416.085450:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c683800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+5:2406:x1869685692836480:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 601us (1251us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071416.085458:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 120 00000100:00100000:3.0:1783071416.116619:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071416.116832:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692836608 00000100:00100000:2.0:1783071416.116841:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692836608 00000100:00100000:2.0:1783071416.116935:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 288 00000100:00100000:2.0:1783071416.116945:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e4e7df8-beb0-40df-a2a1-9decaa005633+10:8742:x1869685692836608:12345-192.168.204.38@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783071416.116962:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071416.116978:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b01546600/0x6b58994c2cbdc0da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98cae expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071416.117009:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b01546600/0x6b58994c2cbdc0da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98cae expref: 11 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071416.117020:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b01546600/0x6b58994c2cbdc0da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98cae expref: 11 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071416.117029:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b01546600, rc 0) 00000100:00100000:2.0:1783071416.117093:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e4e7df8-beb0-40df-a2a1-9decaa005633+11:8742:x1869685692836608:12345-192.168.204.38@tcp:101:mount.lustre.0 Request processed in 148us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071416.117100:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 288 00000100:00100000:1.0:1783071416.118986:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071416.119071:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692836736 00000100:00100000:0.0:1783071416.119080:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692836736 00000100:00100000:0.0:1783071416.119129:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 289 00000100:00100000:0.0:1783071416.119137:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e4e7df8-beb0-40df-a2a1-9decaa005633+11:8742:x1869685692836736:12345-192.168.204.38@tcp:501:mount.lustre.0 00000100:00100000:0.0:1783071416.119319:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e4e7df8-beb0-40df-a2a1-9decaa005633+11:8742:x1869685692836736:12345-192.168.204.38@tcp:501:mount.lustre.0 Request processed in 182us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071416.119326:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 289 00000100:00100000:1.0:1783071416.121605:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071416.121702:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692836864 00000100:00100000:2.0:1783071416.121713:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692836864 00000100:00100000:2.0:1783071416.121810:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 290 00000100:00100000:2.0:1783071416.121820:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e4e7df8-beb0-40df-a2a1-9decaa005633+11:8742:x1869685692836864:12345-192.168.204.38@tcp:503:mount.lustre.0 00000100:00100000:2.0:1783071416.121974:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e4e7df8-beb0-40df-a2a1-9decaa005633+11:8742:x1869685692836864:12345-192.168.204.38@tcp:503:mount.lustre.0 Request processed in 155us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071416.121992:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 290 00000100:00100000:1.0:1783071416.125666:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071416.125766:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692836992 00000100:00100000:3.0:1783071416.125779:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692836992 00000100:00100000:3.0:1783071416.125842:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 291 00000100:00100000:3.0:1783071416.125853:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e4e7df8-beb0-40df-a2a1-9decaa005633+11:8746:x1869685692836992:12345-192.168.204.38@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783071416.126015:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e4e7df8-beb0-40df-a2a1-9decaa005633+11:8746:x1869685692836992:12345-192.168.204.38@tcp:502:llog_process_th.0 Request processed in 164us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071416.126024:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 291 00000100:00100000:1.0:1783071416.157056:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071416.157607:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692837120 00000100:00100000:2.0:1783071416.157618:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692837120 00000100:00100000:2.0:1783071416.157676:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 292 00000100:00100000:2.0:1783071416.157688:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e4e7df8-beb0-40df-a2a1-9decaa005633+11:8746:x1869685692837120:12345-192.168.204.38@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783071416.158080:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e4e7df8-beb0-40df-a2a1-9decaa005633+11:8746:x1869685692837120:12345-192.168.204.38@tcp:502:llog_process_th.0 Request processed in 393us (1035us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071416.158088:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 292 00000100:00100000:1.0:1783071416.166936:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071416.167031:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692837248 00000100:00100000:0.0:1783071416.167104:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692837248 00000100:00100000:0.0:1783071416.167269:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 293 00000100:00100000:0.0:1783071416.167280:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e4e7df8-beb0-40df-a2a1-9decaa005633+11:8746:x1869685692837248:12345-192.168.204.38@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783071416.168002:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e4e7df8-beb0-40df-a2a1-9decaa005633+11:8746:x1869685692837248:12345-192.168.204.38@tcp:502:llog_process_th.0 Request processed in 720us (1071us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071416.168012:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 293 00000100:00100000:1.0:1783071416.170765:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071416.170941:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692837376 00000100:00100000:2.0:1783071416.170953:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692837376 00000100:00100000:2.0:1783071416.171011:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 294 00000100:00100000:2.0:1783071416.171023:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e4e7df8-beb0-40df-a2a1-9decaa005633+11:8742:x1869685692837376:12345-192.168.204.38@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783071416.171039:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071416.171055:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b01546000/0x6b58994c2cbdc0e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98cdf expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071416.171086:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b01546000/0x6b58994c2cbdc0e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98cdf expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071416.171099:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b01546000/0x6b58994c2cbdc0e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98cdf expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071416.171109:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b01546000, rc 0) 00000100:00100000:2.0:1783071416.171172:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e4e7df8-beb0-40df-a2a1-9decaa005633+12:8742:x1869685692837376:12345-192.168.204.38@tcp:101:mount.lustre.0 Request processed in 152us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071416.171180:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 294 00000100:00100000:1.0:1783071416.176765:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071416.177107:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692837504 00000100:00100000:0.0:1783071416.177118:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692837504 00000100:00100000:0.0:1783071416.177177:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 295 00000100:00100000:0.0:1783071416.177188:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e4e7df8-beb0-40df-a2a1-9decaa005633+12:8742:x1869685692837504:12345-192.168.204.38@tcp:256:mount.lustre.0 20000000:01000000:0.0:1783071416.177231:0:6508:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1783071416.177249:0:6508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1783071416.177254:0:6508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1783071416.177257:0:6508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1783071416.177260:0:6508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1783071416.177262:0:6508:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1783071416.182488:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e4e7df8-beb0-40df-a2a1-9decaa005633+12:8742:x1869685692837504:12345-192.168.204.38@tcp:256:mount.lustre.0 Request processed in 5271us (5702us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071416.182504:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 295 00000100:00100000:1.0:1783071416.185949:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071416.186076:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692837632 00000100:00100000:3.0:1783071416.186087:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692837632 00000100:00100000:3.0:1783071416.186214:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 296 00000100:00100000:3.0:1783071416.186226:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e4e7df8-beb0-40df-a2a1-9decaa005633+12:8742:x1869685692837632:12345-192.168.204.38@tcp:101:mount.lustre.0 00010000:00010000:3.0:1783071416.186244:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071416.186261:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b014b9000/0x6b58994c2cbdc0e8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98ce6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071416.186291:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b014b9000/0x6b58994c2cbdc0e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ce6 expref: 13 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071416.186303:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b014b9000/0x6b58994c2cbdc0e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ce6 expref: 13 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071416.186312:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b014b9000, rc 0) 00000100:00100000:3.0:1783071416.186449:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:8742:x1869685692837632:12345-192.168.204.38@tcp:101:mount.lustre.0 Request processed in 225us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071416.186457:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 296 00000100:00100000:1.0:1783071416.190857:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071416.191158:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692837760 00000100:00100000:0.0:1783071416.191169:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692837760 00000100:00100000:0.0:1783071416.191288:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 297 00000100:00100000:0.0:1783071416.191301:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:8742:x1869685692837760:12345-192.168.204.38@tcp:501:mount.lustre.0 00000100:00100000:0.0:1783071416.191504:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:8742:x1869685692837760:12345-192.168.204.38@tcp:501:mount.lustre.0 Request processed in 206us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071416.191512:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 297 00000100:00100000:1.0:1783071416.194312:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071416.203824:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692837888 00000100:00100000:3.0:1783071416.203839:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692837888 00000100:00100000:3.0:1783071416.203914:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 298 00000100:00100000:3.0:1783071416.203927:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:8742:x1869685692837888:12345-192.168.204.38@tcp:503:mount.lustre.0 00000100:00100000:3.0:1783071416.204104:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:8742:x1869685692837888:12345-192.168.204.38@tcp:503:mount.lustre.0 Request processed in 179us (9802us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071416.204113:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 298 00000100:00100000:1.0:1783071416.217181:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071416.217745:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692838016 00000100:00100000:0.0:1783071416.217758:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692838016 00000100:00100000:0.0:1783071416.217824:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 299 00000100:00100000:0.0:1783071416.217835:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:8751:x1869685692838016:12345-192.168.204.38@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783071416.218145:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:8751:x1869685692838016:12345-192.168.204.38@tcp:502:llog_process_th.0 Request processed in 259us (921us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071416.218156:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 299 00000100:00100000:0.0:1783071416.222875:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071416.223033:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692838144 00000100:00100000:2.0:1783071416.223043:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692838144 00000100:00100000:2.0:1783071416.223195:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 300 00000100:00100000:2.0:1783071416.223208:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:8751:x1869685692838144:12345-192.168.204.38@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783071416.223403:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:8751:x1869685692838144:12345-192.168.204.38@tcp:502:llog_process_th.0 Request processed in 198us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071416.227203:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 300 00000100:00100000:1.0:1783071416.235079:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071416.235693:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071416.235980:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692838272 00000100:00100000:0.0:1783071416.235990:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692838272 00000100:00100000:0.0:1783071416.236054:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692838528 00000100:00100000:0.0:1783071416.236058:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692838528 00000100:00100000:0.0:1783071416.236087:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 16 00000100:00100000:0.0:1783071416.236105:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2402:x1869685692838272:12345-192.168.204.38@tcp:38:mount.lustre.0 00010000:00080000:0.0:1783071416.236296:0:6516:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 39473256-b7f7-4f8b-91c6-e632aff5be8d@192.168.204.38@tcp t0 exp 0000000000000000 cur 318 last 0 00000020:00000080:0.0:1783071416.236338:0:6516:0:(genops.c:1406:class_connect()) connect: client 39473256-b7f7-4f8b-91c6-e632aff5be8d, cookie 0x6b58994c2cbdc0ef 00000004:00100000:0.0:1783071416.236397:0:6516:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1783071416.236602:0:6516:0:(import.c:65:import_set_state_nolock()) ffff8f8a02132000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783071416.236675:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39473256-b7f7-4f8b-91c6-e632aff5be8d+6:2402:x1869685692838272:12345-192.168.204.38@tcp:38:mount.lustre.0 Request processed in 578us (1605us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071416.236684:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 16 00000100:00100000:0.0:1783071416.236704:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 17 00000100:00100000:0.0:1783071416.236709:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2402:x1869685692838528:12345-192.168.204.38@tcp:38:mount.lustre.0 00010000:00080000:0.0:1783071416.236725:0:6516:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from 39473256-b7f7-4f8b-91c6-e632aff5be8d@192.168.204.38@tcp t0 exp 0000000000000000 cur 318 last 0 00000020:00000080:0.0:1783071416.236747:0:6516:0:(genops.c:1406:class_connect()) connect: client 39473256-b7f7-4f8b-91c6-e632aff5be8d, cookie 0x6b58994c2cbdc0f6 00000004:00100000:0.0:1783071416.236759:0:6516:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1783071416.238611:0:6516:0:(import.c:65:import_set_state_nolock()) ffff8f8a02133800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783071416.238735:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39473256-b7f7-4f8b-91c6-e632aff5be8d+6:2402:x1869685692838528:12345-192.168.204.38@tcp:38:mount.lustre.0 Request processed in 2020us (3040us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071416.238745:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 17 00000100:00100000:1.0:1783071416.243779:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071416.243828:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071416.244058:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692838784 00000100:00100000:3.0:1783071416.244067:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692838784 00000100:00100000:3.0:1783071416.244342:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692838400 00000100:00100000:3.0:1783071416.244358:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692838400 00000100:00080000:0.0:1783071416.244432:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783071416.246326:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18 00000100:00100000:1.0:1783071416.246359:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:39473256-b7f7-4f8b-91c6-e632aff5be8d+7:8742:x1869685692838784:12345-192.168.204.38@tcp:41:mount.lustre.0 00000004:00000024:1.0:1783071416.246417:0:10292:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1783071416.246977:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:39473256-b7f7-4f8b-91c6-e632aff5be8d+7:8742:x1869685692838784:12345-192.168.204.38@tcp:41:mount.lustre.0 Request processed in 636us (3207us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071416.246986:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18 00000100:00100000:1.0:1783071416.247014:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19 00000100:00100000:1.0:1783071416.247023:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:39473256-b7f7-4f8b-91c6-e632aff5be8d+6:0:x1869685692838400:12345-192.168.204.38@tcp:41:mount.lustre.0 00000004:00000024:1.0:1783071416.247037:0:10292:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1783071416.247060:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:39473256-b7f7-4f8b-91c6-e632aff5be8d+6:0:x1869685692838400:12345-192.168.204.38@tcp:41:mount.lustre.0 Request processed in 39us (3232us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071416.247066:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19 00000100:00100000:0.0:1783071416.261585:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071416.261643:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071416.263490:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692838912 00000100:00100000:2.0:1783071416.263504:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692838912 00000100:00100000:2.0:1783071416.263557:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692838656 00000100:00100000:2.0:1783071416.263561:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692838656 00000100:00100000:2.0:1783071416.263615:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 20 00000100:00100000:2.0:1783071416.263624:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c68c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39473256-b7f7-4f8b-91c6-e632aff5be8d+6:8742:x1869685692838912:12345-192.168.204.38@tcp:40:mount.lustre.0 00000100:00100000:2.0:1783071416.263716:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c68c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39473256-b7f7-4f8b-91c6-e632aff5be8d+6:8742:x1869685692838912:12345-192.168.204.38@tcp:40:mount.lustre.0 Request processed in 92us (2141us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071416.263724:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 20 00000100:00100000:2.0:1783071416.263754:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 21 00000100:00100000:2.0:1783071416.263762:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c68ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39473256-b7f7-4f8b-91c6-e632aff5be8d+6:0:x1869685692838656:12345-192.168.204.38@tcp:41:mount.lustre.0 00000004:00000024:2.0:1783071416.263785:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783071416.263828:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c68ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39473256-b7f7-4f8b-91c6-e632aff5be8d+6:0:x1869685692838656:12345-192.168.204.38@tcp:41:mount.lustre.0 Request processed in 67us (2184us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071416.263835:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 21 00000100:00080000:3.0:1783071416.265091:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783071416.270521:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071416.270808:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692839296 00000100:00100000:1.0:1783071416.270818:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692839296 00000100:00100000:1.0:1783071416.270882:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 5 00000100:00100000:1.0:1783071416.270894:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c68d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:39473256-b7f7-4f8b-91c6-e632aff5be8d+6:8742:x1869685692839296:12345-192.168.204.38@tcp:900:mount.lustre.0 00000100:00100000:1.0:1783071416.270988:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c68d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:39473256-b7f7-4f8b-91c6-e632aff5be8d+6:8742:x1869685692839296:12345-192.168.204.38@tcp:900:mount.lustre.0 Request processed in 95us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071416.270997:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 5 00000100:00100000:1.0:1783071416.272595:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071416.272635:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071416.272711:0:8910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692839040 00000100:00100000:3.0:1783071416.272719:0:8910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692839040 00000100:00100000:3.0:1783071416.272768:0:8910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692839168 00000100:00100000:3.0:1783071416.272772:0:8910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692839168 00000100:00100000:3.0:1783071416.272797:0:8910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 20 00000100:00100000:3.0:1783071416.272804:0:8910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c680a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2402:x1869685692839040:12345-192.168.204.38@tcp:8:mount.lustre.0 00010000:00080000:3.0:1783071416.272837:0:8910:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 39473256-b7f7-4f8b-91c6-e632aff5be8d@192.168.204.38@tcp t0 exp 0000000000000000 cur 318 last 0 00000020:00000080:3.0:1783071416.272869:0:8910:0:(genops.c:1406:class_connect()) connect: client 39473256-b7f7-4f8b-91c6-e632aff5be8d, cookie 0x6b58994c2cbdc0fd 00002000:00100000:3.0:1783071416.272883:0:8910:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 39473256-b7f7-4f8b-91c6-e632aff5be8d/ffff8f8a03243000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783071416.272902:0:8910:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783071416.272999:0:8910:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1783071416.273028:0:8910:0:(import.c:65:import_set_state_nolock()) ffff8f8a03245800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783071416.273264:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 21 00000100:00100000:0.0:1783071416.273270:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c681180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2402:x1869685692839168:12345-192.168.204.38@tcp:8:mount.lustre.0 00010000:00080000:0.0:1783071416.273296:0:8429:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 39473256-b7f7-4f8b-91c6-e632aff5be8d@192.168.204.38@tcp t0 exp 0000000000000000 cur 318 last 0 00000020:00000080:0.0:1783071416.273320:0:8429:0:(genops.c:1406:class_connect()) connect: client 39473256-b7f7-4f8b-91c6-e632aff5be8d, cookie 0x6b58994c2cbdc104 00002000:00100000:0.0:1783071416.273327:0:8429:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 39473256-b7f7-4f8b-91c6-e632aff5be8d/ffff8f8a02137000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783071416.273338:0:8429:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783071416.273419:0:8429:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783071416.273436:0:8429:0:(import.c:65:import_set_state_nolock()) ffff8f8a02134800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783071416.273578:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c681180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:39473256-b7f7-4f8b-91c6-e632aff5be8d+6:2402:x1869685692839168:12345-192.168.204.38@tcp:8:mount.lustre.0 Request processed in 304us (940us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071416.273587:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 21 00000100:00100000:3.0:1783071416.273824:0:8910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c680a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:39473256-b7f7-4f8b-91c6-e632aff5be8d+6:2402:x1869685692839040:12345-192.168.204.38@tcp:8:mount.lustre.0 Request processed in 1018us (1234us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071416.273833:0:8910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 20 00000100:00100000:1.0:1783071416.280668:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071416.283661:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692839424 00000100:00100000:2.0:1783071416.283678:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692839424 00000100:00100000:2.0:1783071416.283880:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1 00000100:00100000:2.0:1783071416.283893:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:39473256-b7f7-4f8b-91c6-e632aff5be8d+6:8742:x1869685692839424:12345-192.168.204.38@tcp:33:mount.lustre.0 00000004:00200000:2.0:1783071416.284004:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1783071416.284179:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:39473256-b7f7-4f8b-91c6-e632aff5be8d+6:8742:x1869685692839424:12345-192.168.204.38@tcp:33:mount.lustre.0 Request processed in 218us (3452us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071416.284188:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1 00010000:00010000:0.0:1783071416.578852:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071417.606060:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071418.179523:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707589760:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783071418.179604:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071418.179823:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707589760 00000100:00100000:3.0:1783071418.179833:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707589760 00000100:00100000:3.0:1783071418.179887:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1783071418.179896:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0178fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707589760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783071418.179932:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783071418.179986:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0178fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707589760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071418.179993:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1783071418.180080:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707589760:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783071418.182425:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869685707590016:0@lo:400:kworker.0 00000100:00100000:1.0:1783071418.182486:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071418.182525:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a021ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1869685707590528:0@lo:400:kworker.0 00000100:00100000:1.0:1783071418.182548:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071418.182569:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a021eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1869685707591040:0@lo:400:kworker.0 00000100:00100000:1.0:1783071418.182596:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071418.182632:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1783071418.182639:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869685707590144:0@lo:400:kworker.0 00000100:00100000:1.0:1783071418.182660:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071418.182675:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a021ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707590656:0@lo:400:kworker.0 00000100:00100000:1.0:1783071418.182699:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071418.182716:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a021ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707591168:0@lo:400:kworker.0 00000100:00100000:1.0:1783071418.182734:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071418.182772:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707590016 00000100:00100000:1.0:1783071418.182778:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707590016 00000100:00100000:1.0:1783071418.182815:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707590528 00000100:00100000:1.0:1783071418.182818:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707590528 00000100:00100000:1.0:1783071418.182842:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707591040 00000100:00100000:1.0:1783071418.182845:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707591040 00000100:00100000:1.0:1783071418.182868:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707590144 00000100:00100000:1.0:1783071418.182871:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707590144 00000100:00100000:1.0:1783071418.182885:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1783071418.182893:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a021efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869685707590016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071418.182944:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a021efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869685707590016:12345-0@lo:400:kworker.0 Request processed in 52us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071418.182951:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1783071418.182969:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1783071418.182974:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a021ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869685707590528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071418.183002:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a021ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869685707590528:12345-0@lo:400:kworker.0 Request processed in 28us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071418.183008:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1783071418.183020:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1783071418.183025:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a021eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869685707591040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071418.183063:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a021eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869685707591040:12345-0@lo:400:kworker.0 Request processed in 38us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071418.183069:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1783071418.183081:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1783071418.183086:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a021ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869685707590144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071418.183110:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a021ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869685707590144:12345-0@lo:400:kworker.0 Request processed in 24us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071418.183115:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1783071418.183142:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707590656 00000100:00100000:1.0:1783071418.183146:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707590656 00000100:00100000:1.0:1783071418.183172:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707591168 00000100:00100000:1.0:1783071418.183175:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707591168 00000100:00100000:1.0:1783071418.183194:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783071418.183200:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a021ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707590656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071418.183230:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a021ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707590656:12345-0@lo:400:kworker.0 Request processed in 30us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071418.183236:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783071418.183246:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783071418.183252:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a021edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707591168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071418.183276:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a021edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707591168:12345-0@lo:400:kworker.0 Request processed in 25us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071418.183282:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:1.0:1783071418.183300:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783071418.183304:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783071418.183306:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783071418.183336:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:feaa1501-b927-4e07-baad-3200e92d7497:3646:1869685707589888:0@lo:400:kworker.0 00000100:00100000:1.0:1783071418.183397:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071418.183420:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1869685707590400:0@lo:400:kworker.0 00000100:00100000:1.0:1783071418.183440:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071418.183454:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a021ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1869685707590912:0@lo:400:kworker.0 00000100:00100000:1.0:1783071418.183472:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071418.183487:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1783071418.183493:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707590272:0@lo:400:kworker.0 00000100:00100000:1.0:1783071418.183517:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071418.183536:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a021ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707590784:0@lo:400:kworker.0 00000100:00100000:1.0:1783071418.183556:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071418.183571:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a021ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707591296:0@lo:400:kworker.0 00000100:00100000:1.0:1783071418.183590:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071418.183616:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707589888 00000100:00100000:1.0:1783071418.183620:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707589888 00000100:00100000:1.0:1783071418.183648:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1783071418.183654:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0d1cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+24:3646:x1869685707589888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071418.183688:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0d1cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+24:3646:x1869685707589888:12345-0@lo:400:kworker.0 Request processed in 34us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071418.183695:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1783071418.183723:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707590272 00000100:00100000:1.0:1783071418.183727:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707590272 00000100:00100000:1.0:1783071418.183748:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1783071418.183754:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a021ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707590272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071418.183784:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a021ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707590272:12345-0@lo:400:kworker.0 Request processed in 31us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071418.183799:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1783071418.183821:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707590784 00000100:00100000:1.0:1783071418.183825:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707590784 00000100:00100000:1.0:1783071418.183849:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707591296 00000100:00100000:1.0:1783071418.183852:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707591296 00000100:00100000:1.0:1783071418.183870:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1783071418.183876:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a021ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707590784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071418.183908:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a021ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707590784:12345-0@lo:400:kworker.0 Request processed in 32us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071418.183913:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1783071418.183923:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1783071418.183929:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a021ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707591296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071418.183953:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a021ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707591296:12345-0@lo:400:kworker.0 Request processed in 25us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071418.183958:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1783071418.183975:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707590400 00000100:00100000:1.0:1783071418.183978:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707590400 00000100:00100000:1.0:1783071418.183997:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707590912 00000100:00100000:1.0:1783071418.184000:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707590912 00000100:00100000:1.0:1783071418.184017:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1783071418.184023:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a021eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869685707590400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071418.184052:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a021eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869685707590400:12345-0@lo:400:kworker.0 Request processed in 29us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071418.184057:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1783071418.184069:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1783071418.184074:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a021edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869685707590912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071418.184112:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a021edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869685707590912:12345-0@lo:400:kworker.0 Request processed in 37us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071418.184117:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:1.0:1783071418.184137:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783071418.184140:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783071418.184141:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783071418.184176:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707590272:0@lo:400:kworker.0 00010000:00080000:1.0:1783071418.184189:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a021ef480 x1869685707590784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071418.184198:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a021ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707590784:0@lo:400:kworker.0 00010000:00080000:1.0:1783071418.184207:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a021ee300 x1869685707591296/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071418.184215:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a021ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707591296:0@lo:400:kworker.0 00000100:00100000:1.0:1783071418.184223:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:feaa1501-b927-4e07-baad-3200e92d7497:3646:1869685707589888:0@lo:400:kworker.0 00000100:00100000:1.0:1783071418.184233:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1869685707590400:0@lo:400:kworker.0 00000100:00100000:1.0:1783071418.184241:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a021ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1869685707590912:0@lo:400:kworker.0 00000100:00100000:1.0:1783071418.184276:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869685707590144:0@lo:400:kworker.0 00010000:00080000:1.0:1783071418.184287:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a021ee680 x1869685707590656/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071418.184294:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a021ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707590656:0@lo:400:kworker.0 00010000:00080000:1.0:1783071418.184303:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a021ed180 x1869685707591168/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071418.184338:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a021ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707591168:0@lo:400:kworker.0 00000100:00100000:1.0:1783071418.184351:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869685707590016:0@lo:400:kworker.0 00010000:00080000:1.0:1783071418.184361:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a021ef100 x1869685707590528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071418.184392:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a021ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1869685707590528:0@lo:400:kworker.0 00010000:00080000:1.0:1783071418.184402:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a021eca80 x1869685707591040/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071418.184408:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a021eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1869685707591040:0@lo:400:kworker.0 00010000:00010000:2.0:1783071418.630603:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071418.690883:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707591424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783071418.690956:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071418.691071:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707591424 00000100:00100000:3.0:1783071418.691079:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707591424 00000100:00100000:3.0:1783071418.691153:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783071418.691164:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a021eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707591424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783071418.691194:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783071418.691246:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a021eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707591424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071418.691254:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:3.0:1783071418.691293:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a032c9880 x1869685707591424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071434 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071418.691325:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707591424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783071418.692402:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783071418.692417:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a021ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707591552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783071418.692466:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071418.692511:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707591552 00000100:00100000:1.0:1783071418.692517:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707591552 00000100:00100000:1.0:1783071418.692551:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783071418.692557:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a021ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707591552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783071418.692605:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783071418.692642:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a021ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707591552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071418.692648:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1783071418.692683:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a021ef100 x1869685707591552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071434 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071418.692712:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a021ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707591552:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783071418.692982:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783071418.692994:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0178ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707591680:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783071418.693026:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071418.693096:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707591680 00000100:00100000:2.0:1783071418.693101:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707591680 00000100:00100000:2.0:1783071418.693140:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783071418.693147:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707591680:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783071418.693159:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783071418.693193:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707591680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 47us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071418.693200:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:2.0:1783071418.693226:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a0178ca80 x1869685707591680/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071434 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071418.693239:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0178ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707591680:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783071418.695249:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c68e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707591808:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783071418.695316:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071418.695457:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707591808 00000100:00100000:1.0:1783071418.695463:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707591808 00000100:00100000:1.0:1783071418.695513:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783071418.695522:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0178ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707591808:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783071418.695544:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783071418.695579:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0178ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707591808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071418.695584:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:2.0:1783071418.695692:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c68e300 x1869685707591808/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071434 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071418.695709:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c68e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707591808:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1783071419.652130:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071419.715245:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c68fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707591936:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783071419.715344:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071419.715501:0:9413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707591936 00000100:00100000:1.0:1783071419.715510:0:9413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707591936 00000100:00100000:1.0:1783071419.715556:0:9413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1783071419.715564:0:9413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707591936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783071419.715605:0:9413:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783071419.715655:0:9413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707591936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071419.715662:0:9413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1783071419.715765:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c68fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707591936:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1783071420.675006:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071421.698645:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071421.717859:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071421.717904:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071421.717930:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071421.717960:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071421.717977:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071421.717997:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071421.718022:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071421.718053:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692840192 00000100:00100000:0.0:1783071421.718063:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692840192 00000100:00100000:0.0:1783071421.718116:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692840320 00000100:00100000:0.0:1783071421.718119:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692840320 00000100:00100000:0.0:1783071421.718141:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 62 00000100:00100000:0.0:1783071421.718149:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c68c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:39473256-b7f7-4f8b-91c6-e632aff5be8d+6:2406:x1869685692840192:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1783071421.718215:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c68c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:39473256-b7f7-4f8b-91c6-e632aff5be8d+6:2406:x1869685692840192:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 66us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071421.718239:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 62 00000100:00100000:0.0:1783071421.718271:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 63 00000100:00100000:0.0:1783071421.718279:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c68e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:39473256-b7f7-4f8b-91c6-e632aff5be8d+6:2406:x1869685692840320:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1783071421.718306:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c68e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:39473256-b7f7-4f8b-91c6-e632aff5be8d+6:2406:x1869685692840320:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 27us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071421.718312:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 63 00000100:00100000:0.0:1783071421.718342:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692839552 00000100:00100000:0.0:1783071421.718346:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692839552 00000100:00100000:0.0:1783071421.718395:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 302 00000100:00100000:0.0:1783071421.718402:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b13f99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:2406:x1869685692839552:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1783071421.719406:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692839680 00000100:00100000:3.0:1783071421.719417:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692839680 00000100:00100000:3.0:1783071421.719465:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692839936 00000100:00100000:3.0:1783071421.719469:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692839936 00000100:00100000:3.0:1783071421.719484:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692839808 00000100:00100000:3.0:1783071421.719486:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692839808 00000100:00100000:3.0:1783071421.719498:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692840064 00000100:00100000:3.0:1783071421.719501:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692840064 00000100:00100000:3.0:1783071421.719519:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 128 00000100:00100000:3.0:1783071421.719527:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c68d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+6:2406:x1869685692839680:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1783071421.719582:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c68d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+6:2406:x1869685692839680:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 56us (1735us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071421.719589:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 128 00000100:00100000:3.0:1783071421.719604:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 129 00000100:00100000:3.0:1783071421.719610:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c68ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39473256-b7f7-4f8b-91c6-e632aff5be8d+6:2406:x1869685692839936:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1783071421.719634:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c68ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39473256-b7f7-4f8b-91c6-e632aff5be8d+6:2406:x1869685692839936:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 23us (1729us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071421.719640:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 129 00000100:00100000:3.0:1783071421.719651:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 130 00000100:00100000:3.0:1783071421.719656:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c68d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+5:2406:x1869685692839808:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1783071421.719678:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c68d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+5:2406:x1869685692839808:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 22us (1700us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071421.719683:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 130 00000100:00100000:3.0:1783071421.719703:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 131 00000100:00100000:3.0:1783071421.719709:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c68fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39473256-b7f7-4f8b-91c6-e632aff5be8d+6:2406:x1869685692840064:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1783071421.719736:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c68fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39473256-b7f7-4f8b-91c6-e632aff5be8d+6:2406:x1869685692840064:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 26us (1738us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071421.719741:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 131 00000100:00100000:0.0:1783071421.719747:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b13f99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:2406:x1869685692839552:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 1345us (1786us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071421.719755:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 302 00000100:00080000:0.0:1783071421.719803:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783071421.719807:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783071421.719810:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783071421.719813:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:0.0:1783071421.767297:0:12181:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg438-client.virtnet: executing check_config_client /mnt/lustre 00000001:00100000:1.0:1783071422.276899:0:6495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 39473256-b7f7-4f8b-91c6-e632aff5be8d 00000001:00100000:0.0:1783071422.277717:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 39473256-b7f7-4f8b-91c6-e632aff5be8d 00000001:00100000:3.0:1783071422.277759:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 39473256-b7f7-4f8b-91c6-e632aff5be8d 00000001:00100000:2.0:1783071422.277918:0:7447:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 39473256-b7f7-4f8b-91c6-e632aff5be8d 00010000:00010000:2.0:1783071422.722840:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071423.298888:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:feaa1501-b927-4e07-baad-3200e92d7497:3647:1869685707592064:0@lo:400:kworker.0 00000100:00100000:2.0:1783071423.298962:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707592320:0@lo:400:kworker.0 00000100:00100000:3.0:1783071423.298964:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071423.299006:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071423.299023:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707592576:0@lo:400:kworker.0 00000100:00100000:2.0:1783071423.299036:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03905880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1869685707592832:0@lo:400:kworker.0 00000100:00100000:3.0:1783071423.299068:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071423.299076:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071423.302063:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1869685707593344:0@lo:400:kworker.0 00000100:00100000:2.0:1783071423.302123:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071423.302156:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1783071423.302163:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869685707592448:0@lo:400:kworker.0 00000100:00100000:2.0:1783071423.302191:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071423.302211:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707592960:0@lo:400:kworker.0 00000100:00100000:3.0:1783071423.302464:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707593088:0@lo:400:kworker.0 00000100:00100000:3.0:1783071423.302494:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071423.302518:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707593600:0@lo:400:kworker.0 00000100:00100000:3.0:1783071423.302543:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071423.302564:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1783071423.302571:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869685707592192:0@lo:400:kworker.0 00000100:00100000:3.0:1783071423.302595:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071423.302615:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03907b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1869685707592704:0@lo:400:kworker.0 00000100:00100000:3.0:1783071423.302637:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071423.302651:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03905500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1869685707593216:0@lo:400:kworker.0 00000100:00100000:3.0:1783071423.302671:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071423.302680:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c68f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707593728:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783071423.302699:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071423.302736:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707592064 00000100:00100000:3.0:1783071423.302749:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707592064 00000100:00100000:3.0:1783071423.302802:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1783071423.302811:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b02bf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+24:3647:x1869685707592064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071423.302861:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b02bf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+24:3647:x1869685707592064:12345-0@lo:400:kworker.0 Request processed in 51us (3898us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071423.302869:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1783071423.302898:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707592320 00000100:00100000:3.0:1783071423.302902:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707592320 00000100:00100000:3.0:1783071423.302918:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707592576 00000100:00100000:3.0:1783071423.302920:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707592576 00000100:00100000:3.0:1783071423.302930:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707593728 00000100:00100000:3.0:1783071423.302932:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707593728 00000100:00100000:3.0:1783071423.302941:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1783071423.302946:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0178ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1869685707592320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071423.302978:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0178ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1869685707592320:12345-0@lo:400:kworker.0 Request processed in 32us (3974us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071423.302985:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1783071423.302997:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1783071423.303002:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03904700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707592576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071423.303030:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03904700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707592576:12345-0@lo:400:kworker.0 Request processed in 28us (3962us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071423.303036:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1783071423.303047:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1783071423.303051:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03904000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707593728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783071423.303075:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783071423.303104:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03904000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707593728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 52us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071423.303120:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1783071423.303143:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707592832 00000100:00100000:3.0:1783071423.303147:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707592832 00000100:00100000:3.0:1783071423.303190:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707593344 00000100:00100000:3.0:1783071423.303193:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707593344 00000100:00100000:3.0:1783071423.303207:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707592448 00000100:00100000:3.0:1783071423.303210:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707592448 00000100:00100000:3.0:1783071423.303231:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707592192 00000100:00100000:3.0:1783071423.303233:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707592192 00000100:00100000:3.0:1783071423.303242:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707592704 00000100:00100000:3.0:1783071423.303244:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707592704 00000100:00100000:3.0:1783071423.303255:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707593216 00000100:00100000:3.0:1783071423.303257:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707593216 00000100:00100000:3.0:1783071423.303268:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1783071423.303274:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0178ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1869685707592832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071423.303307:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0178ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1869685707592832:12345-0@lo:400:kworker.0 Request processed in 33us (4232us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071423.303313:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1783071423.303324:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1783071423.303330:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0178d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1869685707593344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071423.303353:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0178d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1869685707593344:12345-0@lo:400:kworker.0 Request processed in 23us (1231us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071423.303359:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1783071423.303405:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1783071423.303411:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b2fcb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1869685707592448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071423.303439:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b2fcb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1869685707592448:12345-0@lo:400:kworker.0 Request processed in 28us (1247us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071423.303445:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1783071423.303465:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1783071423.303472:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03907100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869685707592192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071423.303505:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03907100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869685707592192:12345-0@lo:400:kworker.0 Request processed in 34us (908us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071423.303512:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1783071423.303525:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1783071423.303531:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03906680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869685707592704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071423.303559:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03906680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869685707592704:12345-0@lo:400:kworker.0 Request processed in 29us (921us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071423.303566:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1783071423.303578:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1783071423.303584:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071423.303587:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03907480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869685707593216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071423.303623:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707593472:0@lo:400:kworker.0 00000100:00100000:3.0:1783071423.303624:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03907480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869685707593216:12345-0@lo:400:kworker.0 Request processed in 38us (951us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071423.303635:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1783071423.303657:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707593088 00000100:00100000:2.0:1783071423.303663:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071423.303664:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707593088 00000100:00100000:3.0:1783071423.303691:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707593600 00000100:00100000:3.0:1783071423.303695:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707593600 00000100:00100000:2.0:1783071423.303707:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707592320:0@lo:400:kworker.0 00000100:00100000:3.0:1783071423.303708:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707592960 00000100:00100000:3.0:1783071423.303713:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707592960 00000100:00100000:3.0:1783071423.303728:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707593472 00010000:00080000:2.0:1783071423.303729:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a03905880 x1869685707592832/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071423.303732:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707593472 00000100:00100000:2.0:1783071423.303744:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03905880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1869685707592832:0@lo:400:kworker.0 00000100:00100000:3.0:1783071423.303750:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1783071423.303758:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03907800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707593088:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1783071423.303761:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a03905f80 x1869685707593344/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071423.303786:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1869685707593344:0@lo:400:kworker.0 00000100:00100000:3.0:1783071423.303797:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03907800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707593088:12345-0@lo:400:kworker.0 Request processed in 39us (1301us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071423.303814:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1783071423.303816:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869685707592448:0@lo:400:kworker.0 00000100:00100000:3.0:1783071423.303834:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1783071423.303843:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03904e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707593600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071423.303862:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1783071423.303874:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c78fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707592960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071423.303881:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03904e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707593600:12345-0@lo:400:kworker.0 Request processed in 37us (1334us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071423.303888:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1783071423.303903:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783071423.303911:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c78c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707593472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071423.303924:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c78fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707592960:12345-0@lo:400:kworker.0 Request processed in 52us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071423.303932:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1783071423.303968:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c78c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707593472:12345-0@lo:400:kworker.0 Request processed in 57us (307us total) trans 0 rc 0/0 00010000:00080000:2.0:1783071423.303970:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a03906a00 x1869685707592960/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071423.303984:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1783071423.303990:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707592960:0@lo:400:kworker.0 00010000:00080000:2.0:1783071423.304003:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a03906d80 x1869685707593472/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071423.304011:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707593472:0@lo:400:kworker.0 00000100:00080000:3.0:1783071423.304022:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783071423.304028:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783071423.304030:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783071423.304033:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783071423.304055:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869685707592192:0@lo:400:kworker.0 00000100:00100000:3.0:1783071423.304066:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03907b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1869685707592704:0@lo:400:kworker.0 00000100:00100000:3.0:1783071423.304076:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03905500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1869685707593216:0@lo:400:kworker.0 00000100:00100000:3.0:1783071423.304091:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c68f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707593728:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783071423.304101:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:feaa1501-b927-4e07-baad-3200e92d7497:3647:1869685707592064:0@lo:400:kworker.0 00000100:00100000:3.0:1783071423.304112:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707592576:0@lo:400:kworker.0 00010000:00080000:3.0:1783071423.304125:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a03904380 x1869685707593088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071423.304145:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707593088:0@lo:400:kworker.0 00010000:00080000:3.0:1783071423.304159:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a03905c00 x1869685707593600/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071423.304167:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707593600:0@lo:400:kworker.0 00010000:00010000:2.0:1783071423.747229:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071423.810658:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783071423.810688:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707593856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783071423.810988:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071423.811731:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707593856 00000100:00100000:0.0:1783071423.811740:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707593856 00000100:00100000:0.0:1783071423.811807:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783071423.811819:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03904380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707593856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783071423.811877:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783071423.812130:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c68e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707593984:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783071423.812172:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1783071423.812241:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a03905c00 x1869685707593856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071439 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071423.812265:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707593856:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783071423.812578:0:8433:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1783071423.812601:0:8433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:2.0:1783071423.812802:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707594112:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783071423.812827:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a021ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707594240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783071423.812848:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03904380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707593856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071423.812882:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783071423.812922:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707593984 00000100:00100000:0.0:1783071423.812929:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707593984 00000100:00100000:0.0:1783071423.812955:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783071423.812963:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c78f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707593984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783071423.812981:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783071423.813009:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071423.816018:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c78f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707593984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3040us (3830us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071423.816039:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783071423.816082:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707594112 00000100:00100000:0.0:1783071423.816092:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707594112 00000100:00100000:0.0:1783071423.816142:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783071423.816152:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c78f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707594112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783071423.816274:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783071423.816360:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c78f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707594112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 210us (3352us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071423.816395:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783071423.818598:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1783071423.818817:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c68e680 x1869685707593984/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071439 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071423.818843:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c68e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707593984:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783071423.819099:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707594240 00000100:00100000:0.0:1783071423.819110:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707594240 00000100:00100000:0.0:1783071423.819153:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783071423.819162:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03905500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707594240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783071423.819188:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783071423.819425:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03905500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707594240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071423.819436:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:3.0:1783071423.819690:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a021ef100 x1869685707594240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071439 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071423.819707:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a021ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707594240:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1783071423.819978:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a03906300 x1869685707594112/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071439 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071423.819995:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707594112:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1783071424.771097:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071424.834518:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783071424.834542:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03907b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707594368:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783071424.834614:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071424.837115:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707594368 00000100:00100000:2.0:1783071424.837132:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707594368 00000100:00100000:2.0:1783071424.837210:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1783071424.837221:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03906300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707594368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783071424.837604:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783071424.837689:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03906300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707594368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 469us (3074us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071424.837697:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1783071424.837781:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03907b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707594368:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1783071425.794629:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071426.818911:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071426.838451:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071426.838560:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692840448 00000100:00100000:0.0:1783071426.838591:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692840448 00000100:00100000:0.0:1783071426.838668:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 304 00000100:00100000:0.0:1783071426.838681:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b06199c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:2406:x1869685692840448:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1783071426.838892:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b06199c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:2406:x1869685692840448:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 212us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071426.838902:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 304 00000100:00100000:1.0:1783071426.842174:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071426.842358:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071426.842421:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071426.842478:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071426.842512:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071426.842545:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071426.842607:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692840704 00000100:00100000:1.0:1783071426.842618:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692840704 00000100:00100000:1.0:1783071426.842680:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692840960 00000100:00100000:1.0:1783071426.842684:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692840960 00000100:00100000:1.0:1783071426.842698:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692840576 00000100:00100000:1.0:1783071426.842700:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692840576 00000100:00100000:1.0:1783071426.842711:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692840832 00000100:00100000:1.0:1783071426.842713:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692840832 00000100:00100000:1.0:1783071426.842735:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 138 00000100:00100000:1.0:1783071426.842746:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a021ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+5:2406:x1869685692840704:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1783071426.842839:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a021ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+5:2406:x1869685692840704:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 94us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071426.842848:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 138 00000100:00100000:1.0:1783071426.842870:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 139 00000100:00100000:1.0:1783071426.842877:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a021ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2406:x1869685692840960:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1783071426.842908:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a021ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2406:x1869685692840960:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 31us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071426.842913:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 139 00000100:00100000:1.0:1783071426.842926:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 140 00000100:00100000:1.0:1783071426.842932:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a021ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+6:2406:x1869685692840576:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1783071426.844520:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 141 00000100:00100000:3.0:1783071426.844551:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a021ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2406:x1869685692840832:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1783071426.844630:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a021ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2406:x1869685692840832:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 95us (2116us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071426.844638:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 141 00000100:00080000:3.0:1783071426.844678:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783071426.844704:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783071426.844704:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692841216 00000100:00100000:2.0:1783071426.844716:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692841216 00000100:00080000:3.0:1783071426.844783:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783071426.844801:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692841088 00000100:00100000:2.0:1783071426.844806:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692841088 00000100:00100000:3.0:1783071426.844823:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 68 00000100:00100000:3.0:1783071426.844835:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a021ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2406:x1869685692841216:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1783071426.844845:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 69 00000100:00100000:2.0:1783071426.844858:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c681880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2406:x1869685692841088:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1783071426.844882:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a021ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2406:x1869685692841216:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 50us (2459us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071426.844891:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 68 00000100:00100000:2.0:1783071426.844896:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c681880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2406:x1869685692841088:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 41us (2348us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071426.844904:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 69 00000100:00080000:3.0:1783071426.844912:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783071426.849287:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a021ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+6:2406:x1869685692840576:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 6334us (6816us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071426.849329:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 140 00010000:00010000:2.0:1783071427.843525:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071428.418680:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869685707594880:0@lo:400:kworker.0 00000100:00100000:3.0:1783071428.418755:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071428.418801:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707595392:0@lo:400:kworker.0 00000100:00100000:3.0:1783071428.418829:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071428.418846:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c685880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707595904:0@lo:400:kworker.0 00000100:00100000:3.0:1783071428.418867:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071428.418898:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1783071428.418904:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03907b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:feaa1501-b927-4e07-baad-3200e92d7497:3645:1869685707594496:0@lo:400:kworker.0 00000100:00100000:3.0:1783071428.418931:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071428.418954:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707595008:0@lo:400:kworker.0 00000100:00100000:3.0:1783071428.418976:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071428.418991:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707595520:0@lo:400:kworker.0 00000100:00100000:3.0:1783071428.419011:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071428.419026:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c686a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707596032:0@lo:400:kworker.0 00000100:00100000:3.0:1783071428.419045:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071428.419068:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869685707594624:0@lo:400:kworker.0 00000100:00100000:3.0:1783071428.419090:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071428.419130:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1869685707595136:0@lo:400:kworker.0 00000100:00100000:3.0:1783071428.419154:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071428.419172:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1869685707595648:0@lo:400:kworker.0 00000100:00100000:3.0:1783071428.419190:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071428.419283:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1783071428.419290:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707594752:0@lo:400:kworker.0 00000100:00100000:3.0:1783071428.419311:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071428.419326:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03905880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1869685707595264:0@lo:400:kworker.0 00000100:00100000:3.0:1783071428.419345:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071428.419355:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c687b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1869685707595776:0@lo:400:kworker.0 00000100:00100000:3.0:1783071428.419403:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071428.419429:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707594880 00000100:00100000:3.0:1783071428.419437:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707594880 00000100:00100000:3.0:1783071428.419474:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707594624 00000100:00100000:3.0:1783071428.419476:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707594624 00000100:00100000:3.0:1783071428.419486:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707595136 00000100:00100000:3.0:1783071428.419488:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707595136 00000100:00100000:3.0:1783071428.419507:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707595648 00000100:00100000:3.0:1783071428.419509:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707595648 00000100:00100000:3.0:1783071428.419520:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707595264 00000100:00100000:3.0:1783071428.419522:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707595264 00000100:00100000:3.0:1783071428.419533:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707595776 00000100:00100000:3.0:1783071428.419535:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707595776 00000100:00100000:3.0:1783071428.419550:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1783071428.419557:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c684380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1869685707594880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071428.419611:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c684380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1869685707594880:12345-0@lo:400:kworker.0 Request processed in 54us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071428.419618:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1783071428.419642:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1783071428.419648:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c687800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869685707594624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071428.419679:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c687800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869685707594624:12345-0@lo:400:kworker.0 Request processed in 31us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071428.419684:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1783071428.419694:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1783071428.419699:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c684e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869685707595136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071428.419722:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c684e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869685707595136:12345-0@lo:400:kworker.0 Request processed in 24us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071428.419728:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1783071428.419737:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1783071428.419741:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c687100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869685707595648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071428.419763:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c687100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869685707595648:12345-0@lo:400:kworker.0 Request processed in 22us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071428.419767:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1783071428.419777:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1783071428.419783:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869685707595264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071428.419807:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869685707595264:12345-0@lo:400:kworker.0 Request processed in 25us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071428.419813:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1783071428.419823:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1783071428.419828:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869685707595776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071428.419852:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869685707595776:12345-0@lo:400:kworker.0 Request processed in 24us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071428.419858:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1783071428.419884:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707595392 00000100:00100000:3.0:1783071428.419888:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707595392 00000100:00100000:3.0:1783071428.419906:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707595904 00000100:00100000:3.0:1783071428.419909:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707595904 00000100:00100000:3.0:1783071428.419919:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707595520 00000100:00100000:3.0:1783071428.419921:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707595520 00000100:00100000:3.0:1783071428.419931:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707596032 00000100:00100000:3.0:1783071428.419933:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707596032 00000100:00100000:3.0:1783071428.419946:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1783071428.419953:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c685500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707595392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071428.419984:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c685500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707595392:12345-0@lo:400:kworker.0 Request processed in 32us (1154us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071428.419991:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1783071428.420001:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783071428.420007:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c685f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707595904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071428.420032:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c685f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707595904:12345-0@lo:400:kworker.0 Request processed in 26us (1164us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071428.420038:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783071428.420047:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1783071428.420053:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c685c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707595520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071428.420077:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c685c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707595520:12345-0@lo:400:kworker.0 Request processed in 24us (1065us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071428.420082:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1783071428.420090:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1783071428.420096:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c684700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707596032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071428.420130:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c684700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707596032:12345-0@lo:400:kworker.0 Request processed in 22us (1072us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071428.420145:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1783071428.420168:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707594496 00000100:00100000:3.0:1783071428.420172:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707594496 00000100:00100000:3.0:1783071428.420211:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1783071428.420219:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b06198c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+24:3645:x1869685707594496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071428.420249:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b06198c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+24:3645:x1869685707594496:12345-0@lo:400:kworker.0 Request processed in 32us (1317us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071428.420256:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1783071428.420284:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707595008 00000100:00100000:3.0:1783071428.420288:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707595008 00000100:00100000:3.0:1783071428.420313:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707594752 00000100:00100000:3.0:1783071428.420316:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707594752 00000100:00100000:3.0:1783071428.420329:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1783071428.420335:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c686d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707595008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071428.420398:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c686d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707595008:12345-0@lo:400:kworker.0 Request processed in 62us (1421us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071428.420405:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1783071428.420416:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1783071428.420423:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c686680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707594752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071428.420451:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c686680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707594752:12345-0@lo:400:kworker.0 Request processed in 28us (1138us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071428.420457:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:3.0:1783071428.420489:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783071428.420493:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783071428.420495:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783071428.420497:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783071428.420532:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707594752:0@lo:400:kworker.0 00010000:00080000:3.0:1783071428.420557:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a03905880 x1869685707595264/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071428.420566:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03905880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1869685707595264:0@lo:400:kworker.0 00010000:00080000:3.0:1783071428.420576:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c687b80 x1869685707595776/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071428.420583:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c687b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1869685707595776:0@lo:400:kworker.0 00000100:00100000:3.0:1783071428.420592:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869685707594624:0@lo:400:kworker.0 00000100:00100000:3.0:1783071428.420601:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1869685707595136:0@lo:400:kworker.0 00000100:00100000:3.0:1783071428.420610:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1869685707595648:0@lo:400:kworker.0 00000100:00100000:3.0:1783071428.420645:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03907b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:feaa1501-b927-4e07-baad-3200e92d7497:3645:1869685707594496:0@lo:400:kworker.0 00000100:00100000:3.0:1783071428.420655:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707595008:0@lo:400:kworker.0 00010000:00080000:3.0:1783071428.420665:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a032cb800 x1869685707595520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071428.420674:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707595520:0@lo:400:kworker.0 00010000:00080000:3.0:1783071428.420684:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c686a00 x1869685707596032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071428.420691:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c686a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707596032:0@lo:400:kworker.0 00000100:00100000:3.0:1783071428.420700:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869685707594880:0@lo:400:kworker.0 00010000:00080000:3.0:1783071428.420710:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a03904a80 x1869685707595392/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071428.420730:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707595392:0@lo:400:kworker.0 00010000:00080000:3.0:1783071428.420742:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c685880 x1869685707595904/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071428.420750:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c685880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707595904:0@lo:400:kworker.0 00000100:00100000:0.0:1783071428.421456:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783071428.421469:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c68c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707596160:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783071428.421512:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071428.421553:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707596160 00000100:00100000:0.0:1783071428.421568:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707596160 00000100:00100000:0.0:1783071428.421601:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1783071428.421607:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c68f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707596160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783071428.421635:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1783071428.421673:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c68f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707596160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 66us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071428.421678:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1783071428.421711:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c68c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707596160:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1783071428.871223:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783071428.895554:0:12498:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783071428.896828:0:12498:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1783071428.930550:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707596288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783071428.930634:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071428.930718:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707596288 00000100:00100000:1.0:1783071428.930727:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707596288 00000100:00100000:1.0:1783071428.930790:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783071428.930800:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c681500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707596288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783071428.930839:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783071428.930895:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c681500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707596288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071428.930904:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:3.0:1783071428.931140:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c682a00 x1869685707596288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071444 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071428.931159:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707596288:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783071428.932471:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c685880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707596416:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783071428.932537:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071428.932732:0:12254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707596416 00000100:00100000:3.0:1783071428.932738:0:12254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707596416 00000100:00100000:3.0:1783071428.932782:0:12254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1783071428.932790:0:12254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c686a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707596416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783071428.932812:0:12254:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783071428.932851:0:12254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c686a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707596416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071428.932858:0:12254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783071428.933508:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c68c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707596544:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783071428.933546:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071428.933586:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707596544 00000100:00100000:1.0:1783071428.933592:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707596544 00000100:00100000:1.0:1783071428.933620:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783071428.933627:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707596544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783071428.933650:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783071428.933684:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707596544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071428.933691:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:1.0:1783071428.933726:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c68c700 x1869685707596544/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071444 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071428.933743:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c68c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707596544:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783071428.933766:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783071428.933781:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707596672:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783071428.933806:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071428.933828:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707596672 00000100:00100000:1.0:1783071428.933832:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707596672 00000100:00100000:1.0:1783071428.933853:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783071428.933859:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c682a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707596672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783071428.933869:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783071428.933895:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c682a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707596672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 37us (88us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071428.933902:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:1.0:1783071428.933925:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c683b80 x1869685707596672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071444 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071428.933937:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707596672:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1783071428.934249:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c685880 x1869685707596416/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071444 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071428.934265:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c685880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707596416:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1783071429.890690:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071429.954713:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783071429.954757:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c68dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707596800:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783071429.954850:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071429.954951:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707596800 00000100:00100000:0.0:1783071429.954958:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707596800 00000100:00100000:0.0:1783071429.955027:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1783071429.955038:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c685880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707596800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783071429.955076:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783071429.955145:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c685880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707596800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071429.955152:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1783071429.955406:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c68dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707596800:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1783071430.914561:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1783071430.916935:0:12596:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783071430.917188:0:12596:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783071431.941254:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071431.957811:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071431.957859:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071431.957904:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071431.957936:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071431.957960:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071431.957983:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071431.958026:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071431.958072:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692841984 00000100:00100000:3.0:1783071431.958082:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692841984 00000100:00100000:3.0:1783071431.958158:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692842112 00000100:00100000:3.0:1783071431.958162:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692842112 00000100:00100000:3.0:1783071431.958203:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 74 00000100:00100000:3.0:1783071431.958214:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c685180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2406:x1869685692841984:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1783071431.958290:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c685180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2406:x1869685692841984:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 78us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071431.958299:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 74 00000100:00100000:3.0:1783071431.958317:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 75 00000100:00100000:3.0:1783071431.958324:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2406:x1869685692842112:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1783071431.958354:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2406:x1869685692842112:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 31us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071431.958360:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 75 00000100:00100000:3.0:1783071431.958406:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692841344 00000100:00100000:3.0:1783071431.958418:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692841344 00000100:00100000:3.0:1783071431.958458:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 306 00000100:00100000:3.0:1783071431.958465:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18686850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:2406:x1869685692841344:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1783071431.958493:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18686850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:2406:x1869685692841344:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 29us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071431.958500:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 306 00000100:00100000:3.0:1783071431.958533:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692841472 00000100:00100000:3.0:1783071431.958536:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692841472 00000100:00100000:2.0:1783071431.958910:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692841728 00000100:00100000:2.0:1783071431.958916:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692841728 00000100:00100000:2.0:1783071431.958949:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692841600 00000100:00100000:2.0:1783071431.958954:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692841600 00000100:00100000:2.0:1783071431.958967:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692841856 00000100:00100000:2.0:1783071431.958971:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692841856 00000100:00100000:2.0:1783071431.958984:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 148 00000100:00100000:2.0:1783071431.958991:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c684a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2406:x1869685692841728:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1783071431.959026:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c684a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2406:x1869685692841728:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 36us (1167us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071431.959033:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 148 00000100:00100000:2.0:1783071431.959045:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 149 00000100:00100000:2.0:1783071431.959061:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c686300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+5:2406:x1869685692841600:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1783071431.959086:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c686300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+5:2406:x1869685692841600:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 35us (1125us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071431.959091:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 149 00000100:00100000:2.0:1783071431.959102:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 150 00000100:00100000:2.0:1783071431.959108:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2406:x1869685692841856:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1783071431.959140:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2406:x1869685692841856:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 31us (1156us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071431.959145:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 150 00000100:00100000:3.0:1783071431.959357:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 151 00000100:00100000:3.0:1783071431.959391:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+6:2406:x1869685692841472:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1783071431.959420:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+6:2406:x1869685692841472:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 57us (1620us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071431.959426:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 151 00000100:00080000:3.0:1783071431.959462:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783071431.959466:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783071431.959468:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783071431.959471:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000004:3.0:1783071432.907250:0:12694:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783071432.907923:0:12694:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783071432.964119:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071433.538670:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707597184:0@lo:400:kworker.0 00000100:00100000:3.0:1783071433.538744:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071433.538793:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03905880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1869685707597696:0@lo:400:kworker.0 00000100:00100000:3.0:1783071433.538871:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071433.538890:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a038b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1869685707598208:0@lo:400:kworker.0 00000100:00100000:3.0:1783071433.538911:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071433.538963:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1783071433.538970:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03907b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869685707597312:0@lo:400:kworker.0 00000100:00100000:3.0:1783071433.538993:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071433.539011:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707597824:0@lo:400:kworker.0 00000100:00100000:3.0:1783071433.539046:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071433.539065:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a038bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707598336:0@lo:400:kworker.0 00000100:00100000:3.0:1783071433.539087:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071433.539128:0:9413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707597184 00000100:00100000:3.0:1783071433.539136:0:9413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707597184 00000100:00100000:3.0:1783071433.539184:0:9413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1783071433.539192:0:9413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a038bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707597184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071433.539257:0:9413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a038bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707597184:12345-0@lo:400:kworker.0 Request processed in 65us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071433.539265:0:9413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1783071433.539287:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707597696 00000100:00100000:3.0:1783071433.539290:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707597696 00000100:00100000:3.0:1783071433.539323:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707598208 00000100:00100000:3.0:1783071433.539326:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707598208 00000100:00100000:3.0:1783071433.539339:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707597312 00000100:00100000:3.0:1783071433.539341:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707597312 00000100:00100000:3.0:1783071433.539353:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1783071433.539385:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a038b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869685707597696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071433.539416:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a038b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869685707597696:12345-0@lo:400:kworker.0 Request processed in 57us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071433.539422:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1783071433.539433:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1783071433.539438:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a038b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869685707598208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071433.539473:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a038b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869685707598208:12345-0@lo:400:kworker.0 Request processed in 35us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071433.539479:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1783071433.539492:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1783071433.539498:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a038b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869685707597312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071433.539520:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a038b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869685707597312:12345-0@lo:400:kworker.0 Request processed in 23us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071433.539526:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1783071433.539553:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707597824 00000100:00100000:3.0:1783071433.539556:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707597824 00000100:00100000:3.0:1783071433.539583:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707598336 00000100:00100000:3.0:1783071433.539585:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707598336 00000100:00100000:3.0:1783071433.539604:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1783071433.539611:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a038ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707597824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071433.539642:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a038ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707597824:12345-0@lo:400:kworker.0 Request processed in 32us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071433.539649:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1783071433.539660:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1783071433.539666:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a038bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707598336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071433.539692:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a038bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707598336:12345-0@lo:400:kworker.0 Request processed in 26us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071433.539698:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:3.0:1783071433.539721:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783071433.539725:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783071433.539727:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783071433.539766:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03907b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869685707597312:0@lo:400:kworker.0 00010000:00080000:3.0:1783071433.539789:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a03906d80 x1869685707597824/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071433.539800:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707597824:0@lo:400:kworker.0 00010000:00080000:3.0:1783071433.539812:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a038bb100 x1869685707598336/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071433.539822:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a038bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707598336:0@lo:400:kworker.0 00000100:00100000:3.0:1783071433.539835:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707597184:0@lo:400:kworker.0 00000100:00100000:1.0:1783071433.539839:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:feaa1501-b927-4e07-baad-3200e92d7497:3645:1869685707596928:0@lo:400:kworker.0 00010000:00080000:3.0:1783071433.539850:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a03905880 x1869685707597696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071433.539860:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03905880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1869685707597696:0@lo:400:kworker.0 00010000:00080000:3.0:1783071433.539873:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a038b8e00 x1869685707598208/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071433.539883:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a038b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1869685707598208:0@lo:400:kworker.0 00000100:00100000:1.0:1783071433.539885:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071433.539933:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707597440:0@lo:400:kworker.0 00000100:00100000:1.0:1783071433.539961:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071433.539988:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a038b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707597952:0@lo:400:kworker.0 00000100:00100000:1.0:1783071433.540220:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071433.540241:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a038ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707598464:0@lo:400:kworker.0 00000100:00100000:1.0:1783071433.540262:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071433.540281:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1783071433.540296:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869685707597056:0@lo:400:kworker.0 00000100:00100000:1.0:1783071433.540320:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071433.540337:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1869685707597568:0@lo:400:kworker.0 00000100:00100000:1.0:1783071433.540359:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071433.540410:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a038bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1869685707598080:0@lo:400:kworker.0 00000100:00100000:1.0:1783071433.540430:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071433.540488:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707596928 00000100:00100000:1.0:1783071433.540493:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707596928 00000100:00100000:1.0:1783071433.540523:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1783071433.540530:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18684050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+24:3645:x1869685707596928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071433.540566:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18684050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+24:3645:x1869685707596928:12345-0@lo:400:kworker.0 Request processed in 37us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071433.540573:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1783071433.540590:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:feaa1501-b927-4e07-baad-3200e92d7497:3645:1869685707596928:0@lo:400:kworker.0 00000100:00100000:1.0:1783071433.540605:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707597056 00000100:00100000:1.0:1783071433.540610:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707597056 00000100:00100000:1.0:1783071433.540641:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707597568 00000100:00100000:1.0:1783071433.540644:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707597568 00000100:00100000:1.0:1783071433.540663:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707598080 00000100:00100000:1.0:1783071433.540665:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707598080 00000100:00100000:1.0:1783071433.540680:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1783071433.540685:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02e43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1869685707597056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071433.540713:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02e43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1869685707597056:12345-0@lo:400:kworker.0 Request processed in 28us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071433.540718:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1783071433.540728:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1783071433.540732:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02e40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1869685707597568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071433.540750:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02e40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1869685707597568:12345-0@lo:400:kworker.0 Request processed in 18us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071433.540761:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1783071433.540772:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1783071433.540777:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02e43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1869685707598080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071433.540807:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02e43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1869685707598080:12345-0@lo:400:kworker.0 Request processed in 30us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071433.540813:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1783071433.540832:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707597952 00000100:00100000:1.0:1783071433.540835:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707597952 00000100:00100000:1.0:1783071433.540859:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707598464 00000100:00100000:1.0:1783071433.540862:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707598464 00000100:00100000:1.0:1783071433.540879:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1783071433.540886:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02e41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707597952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071433.540915:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02e41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707597952:12345-0@lo:400:kworker.0 Request processed in 30us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071433.540921:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1783071433.540932:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1783071433.540938:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02e40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707598464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071433.540964:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02e40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707598464:12345-0@lo:400:kworker.0 Request processed in 26us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071433.540974:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1783071433.541033:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c68f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707598592:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783071433.541067:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071433.541118:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869685707597056:0@lo:400:kworker.0 00000100:00100000:2.0:1783071433.541130:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1869685707597568:0@lo:400:kworker.0 00000100:00100000:2.0:1783071433.541148:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a038bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1869685707598080:0@lo:400:kworker.0 00010000:00080000:2.0:1783071433.541157:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a038b8700 x1869685707597952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071433.541168:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a038b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707597952:0@lo:400:kworker.0 00010000:00080000:2.0:1783071433.541177:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a038ba680 x1869685707598464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071433.541185:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a038ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707598464:0@lo:400:kworker.0 00000100:00100000:3.0:1783071433.542349:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707597440 00000100:00100000:3.0:1783071433.542377:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707597440 00000100:00100000:3.0:1783071433.542425:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707598592 00000100:00100000:3.0:1783071433.542429:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707598592 00000100:00100000:0.0:1783071433.542437:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1783071433.542451:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c683b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707597440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071433.542452:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1783071433.542466:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c78e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707598592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783071433.542497:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1783071433.542534:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c683b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707597440:12345-0@lo:400:kworker.0 Request processed in 87us (2571us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071433.542541:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1783071433.542555:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c78e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707598592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (1485us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071433.542563:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:3.0:1783071433.542611:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783071433.542618:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783071433.542622:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783071433.542642:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707597440:0@lo:400:kworker.0 00000100:00100000:3.0:1783071433.542654:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c68f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707598592:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1783071433.986780:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071434.050696:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02e42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707598848:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783071434.050697:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c68df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707598720:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783071434.050808:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783071434.050823:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c68ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707598976:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783071434.055207:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783071434.055232:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02e43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707599104:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783071434.056218:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071434.056292:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071434.056331:0:12254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707598720 00000100:00100000:2.0:1783071434.056340:0:12254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707598720 00000100:00100000:0.0:1783071434.056345:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707598976 00000100:00100000:0.0:1783071434.056351:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707598976 00000100:00100000:0.0:1783071434.056423:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783071434.056433:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c68ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707598976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783071434.056468:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783071434.056514:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c68ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707598976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071434.056521:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:0.0:1783071434.056573:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c68ce00 x1869685707598976/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071450 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071434.056592:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c68ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707598976:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783071434.056866:0:12254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1783071434.056878:0:12254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0380aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707598720:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783071434.056896:0:12254:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783071434.056936:0:12254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0380aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707598720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071434.056942:0:12254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:2.0:1783071434.057511:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c68df80 x1869685707598720/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071450 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071434.057528:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c68df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707598720:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783071434.059897:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071434.060131:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707599104 00000100:00100000:0.0:1783071434.060154:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707599104 00000100:00100000:0.0:1783071434.060222:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1783071434.060234:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c9b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707599104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783071434.060264:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783071434.060322:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c9b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707599104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071434.060342:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:2.0:1783071434.060906:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a02e43480 x1869685707599104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071450 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071434.060934:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02e43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707599104:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783071434.063754:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071434.064169:0:12254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707598848 00000100:00100000:2.0:1783071434.064179:0:12254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707598848 00000100:00100000:2.0:1783071434.064291:0:12254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1783071434.064303:0:12254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a038b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707598848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783071434.064331:0:12254:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783071434.064426:0:12254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a038b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707598848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071434.064437:0:12254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:3.0:1783071434.064465:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a02e42680 x1869685707598848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071450 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071434.064482:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02e42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707598848:0@lo:13:osp-pre-1-0.0 00000020:00000004:0.0:1783071434.798133:0:12792:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783071434.798942:0:12792:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783071435.010502:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071435.078255:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783071435.078576:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c68ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707599232:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783071435.078649:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071435.078818:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707599232 00000100:00100000:0.0:1783071435.078826:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707599232 00000100:00100000:0.0:1783071435.078920:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1783071435.078931:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b06cdf850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707599232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783071435.078969:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783071435.079146:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b06cdf850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707599232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 216us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071435.079154:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1783071435.079678:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c68ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707599232:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1783071436.034723:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1783071436.460034:0:12890:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783071436.461202:0:12890:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783071437.058529:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071437.074244:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071437.074275:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071437.074300:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071437.074325:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071437.074337:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692842368 00000100:00100000:0.0:1783071437.074347:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071437.074349:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692842368 00000100:00100000:0.0:1783071437.074393:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071437.074426:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071437.074446:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692842624 00000100:00100000:1.0:1783071437.074451:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692842624 00000100:00100000:0.0:1783071437.074452:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692842240 00000100:00100000:0.0:1783071437.074458:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692842240 00000100:00100000:1.0:1783071437.074471:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692842496 00000100:00100000:1.0:1783071437.074476:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692842496 00000100:00100000:1.0:1783071437.074497:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692842752 00000100:00100000:0.0:1783071437.074497:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 308 00000100:00100000:1.0:1783071437.074501:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692842752 00000100:00100000:1.0:1783071437.074519:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 158 00000100:00100000:0.0:1783071437.074526:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18684450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:2403:x1869685692842240:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1783071437.074532:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c68f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+6:2403:x1869685692842368:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1783071437.074615:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18684450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:2403:x1869685692842240:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 91us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071437.074616:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c68f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+6:2403:x1869685692842368:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 86us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071437.074634:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 158 00000100:00100000:0.0:1783071437.074635:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 308 00000100:00100000:2.0:1783071437.074646:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 159 00000100:00100000:2.0:1783071437.074656:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c68ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2403:x1869685692842624:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1783071437.074663:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 160 00000100:00100000:1.0:1783071437.074673:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c68ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+5:2403:x1869685692842496:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1783071437.074693:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c68ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2403:x1869685692842624:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 39us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071437.074701:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 159 00000100:00100000:1.0:1783071437.074709:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c68ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+5:2403:x1869685692842496:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 36us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071437.074717:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 160 00000100:00100000:2.0:1783071437.074734:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 161 00000100:00100000:2.0:1783071437.074744:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c68df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2403:x1869685692842752:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1783071437.074759:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692842880 00000100:00100000:1.0:1783071437.075178:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692842880 00000100:00100000:1.0:1783071437.075218:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692843008 00000100:00100000:1.0:1783071437.075221:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692843008 00000100:00100000:1.0:1783071437.075315:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 22 00000100:00100000:1.0:1783071437.075325:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c68f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2402:x1869685692842880:12345-192.168.204.38@tcp:9:kworker.0 00000020:00000080:1.0:1783071437.075351:0:8431:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6b58994c2cbdc0fd 00000100:00080000:1.0:1783071437.075360:0:8431:0:(import.c:65:import_set_state_nolock()) ffff8f8a03245800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783071437.075426:0:8431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1783071437.075697:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c68df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2403:x1869685692842752:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 952us (1347us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071437.075702:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c68f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:39473256-b7f7-4f8b-91c6-e632aff5be8d+2:2402:x1869685692842880:12345-192.168.204.38@tcp:9:kworker.0 Request processed in 376us (1305us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071437.075725:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 22 00000100:00100000:1.0:1783071437.075744:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 23 00000100:00100000:1.0:1783071437.075751:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c68dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2402:x1869685692843008:12345-192.168.204.38@tcp:9:kworker.0 00000020:00000080:1.0:1783071437.075766:0:8431:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6b58994c2cbdc104 00000100:00080000:1.0:1783071437.075773:0:8431:0:(import.c:65:import_set_state_nolock()) ffff8f8a02134800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783071437.075795:0:8431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1783071437.076193:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 161 00010000:00010000:2.0:1783071437.076220:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071437.076226:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071437.076418:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c68dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:39473256-b7f7-4f8b-91c6-e632aff5be8d+2:2402:x1869685692843008:12345-192.168.204.38@tcp:9:kworker.0 Request processed in 665us (1991us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071437.076425:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 23 00000100:00080000:1.0:1783071437.076907:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783071437.076911:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783071437.076915:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783071437.076917:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783071438.083137:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071438.658746:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a038b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869685707599744:0@lo:400:kworker.0 00000100:00100000:3.0:1783071438.658780:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a038baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707599616:0@lo:400:kworker.0 00000100:00100000:2.0:1783071438.658844:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a038bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:feaa1501-b927-4e07-baad-3200e92d7497:3648:1869685707599360:0@lo:400:kworker.0 00000100:00100000:0.0:1783071438.658903:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a038b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869685707599488:0@lo:400:kworker.0 00000100:00100000:3.0:1783071438.658980:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071438.659029:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a038bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1869685707600128:0@lo:400:kworker.0 00000100:00100000:3.0:1783071438.659053:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071438.659073:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a038b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1869685707600640:0@lo:400:kworker.0 00000100:00100000:3.0:1783071438.659097:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071438.659151:0:9413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707599616 00000100:00100000:3.0:1783071438.659158:0:9413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707599616 00000100:00100000:3.0:1783071438.659208:0:9413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1783071438.659217:0:9413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03904000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707599616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071438.659255:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071438.659271:0:9413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03904000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707599616:12345-0@lo:400:kworker.0 Request processed in 56us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071438.659274:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a038b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707600256:0@lo:400:kworker.0 00000100:00100000:3.0:1783071438.659279:0:9413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1783071438.659297:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071438.659316:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a038baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707599616:0@lo:400:kworker.0 00000100:00100000:1.0:1783071438.659316:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a038bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707600768:0@lo:400:kworker.0 00000100:00100000:1.0:1783071438.659334:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071438.659383:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707600128 00000100:00100000:3.0:1783071438.659387:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707600128 00000100:00100000:1.0:1783071438.659388:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707600640 00000100:00100000:1.0:1783071438.659390:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707600640 00000100:00100000:3.0:1783071438.659438:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707599744 00000100:00100000:3.0:1783071438.659441:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707599744 00000100:00100000:3.0:1783071438.659455:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1783071438.659461:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03906300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869685707600128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071438.659494:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03906300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869685707600128:12345-0@lo:400:kworker.0 Request processed in 33us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071438.659501:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1783071438.659512:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1783071438.659517:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02e40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869685707599744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071438.659547:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02e40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869685707599744:12345-0@lo:400:kworker.0 Request processed in 30us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071438.659554:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00010000:00080000:3.0:1783071438.659583:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a038bad80 x1869685707600128/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071438.659593:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a038bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1869685707600128:0@lo:400:kworker.0 00000100:00100000:1.0:1783071438.659625:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1783071438.659634:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03904380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869685707600640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071438.659668:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03904380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869685707600640:12345-0@lo:400:kworker.0 Request processed in 37us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071438.659669:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071438.659683:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1783071438.659694:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a038b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707599872:0@lo:400:kworker.0 00000100:00100000:2.0:1783071438.659715:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071438.659732:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a038bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707600384:0@lo:400:kworker.0 00000100:00100000:2.0:1783071438.659751:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071438.659767:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03904700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707600896:0@lo:400:kworker.0 00000100:00100000:2.0:1783071438.659789:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071438.659817:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707599360 00000100:00100000:2.0:1783071438.659820:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707599360 00000100:00100000:2.0:1783071438.659847:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1783071438.659858:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18687050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+24:3648:x1869685707599360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071438.659890:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18687050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+24:3648:x1869685707599360:12345-0@lo:400:kworker.0 Request processed in 37us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071438.659896:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1783071438.659940:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a038bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:feaa1501-b927-4e07-baad-3200e92d7497:3648:1869685707599360:0@lo:400:kworker.0 00000100:00080000:2.0:1783071438.659974:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783071438.659986:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707600256 00000100:00100000:2.0:1783071438.659989:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707600256 00000100:00100000:2.0:1783071438.660011:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707600768 00000100:00100000:2.0:1783071438.660015:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707600768 00000100:00100000:2.0:1783071438.660026:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707600384 00000100:00100000:2.0:1783071438.660039:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707600384 00000100:00100000:2.0:1783071438.660056:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707600896 00000100:00100000:2.0:1783071438.660059:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707600896 00000100:00100000:2.0:1783071438.660076:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1783071438.660085:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02e40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707600256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071438.660093:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071438.660131:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02e40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707600256:12345-0@lo:400:kworker.0 Request processed in 48us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071438.660137:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1783071438.660149:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1783071438.660154:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02e41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707600768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071438.660180:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02e41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707600768:12345-0@lo:400:kworker.0 Request processed in 26us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071438.660186:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1783071438.660196:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1783071438.660201:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03809180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707600384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071438.660312:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03809180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707600384:12345-0@lo:400:kworker.0 Request processed in 110us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071438.660319:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1783071438.660329:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1783071438.660333:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03808a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707600896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071438.660355:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03808a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707600896:12345-0@lo:400:kworker.0 Request processed in 22us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071438.660361:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:2.0:1783071438.660396:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783071438.660399:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783071438.664990:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707599488 00000100:00100000:3.0:1783071438.665004:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707599488 00000100:00100000:3.0:1783071438.665068:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1783071438.665077:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c68e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1869685707599488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071438.665080:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a038b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1869685707600000:0@lo:400:kworker.0 00000100:00100000:0.0:1783071438.665169:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071438.665184:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a038ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1869685707600512:0@lo:400:kworker.0 00000100:00100000:0.0:1783071438.665207:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071438.665209:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c68e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1869685707599488:12345-0@lo:400:kworker.0 Request processed in 134us (5120us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071438.665216:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1783071438.665217:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c68c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707601024:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783071438.665231:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707600000 00000100:00100000:3.0:1783071438.665234:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707600000 00000100:00100000:0.0:1783071438.665237:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071438.665265:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707600512 00000100:00100000:3.0:1783071438.665268:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707600512 00000100:00100000:3.0:1783071438.665280:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1783071438.665285:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c68f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1869685707600000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071438.665285:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a038b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869685707599488:0@lo:400:kworker.0 00000100:00100000:0.0:1783071438.665324:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707599872 00000100:00100000:0.0:1783071438.665328:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707599872 00000100:00100000:0.0:1783071438.665353:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707601024 00000100:00100000:0.0:1783071438.665356:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707601024 00000100:00100000:1.0:1783071438.665385:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1783071438.665394:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b08872a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1869685707600512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071438.665603:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c68f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1869685707600000:12345-0@lo:400:kworker.0 Request processed in 316us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071438.665610:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00080000:3.0:1783071438.665627:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783071438.665643:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1783071438.665651:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03809880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707599872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071438.665684:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03809880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707599872:12345-0@lo:400:kworker.0 Request processed in 35us (5968us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071438.665689:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:3.0:1783071438.665742:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a038b8700 x1869685707600640/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071438.665753:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a038b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1869685707600640:0@lo:400:kworker.0 00000100:00100000:3.0:1783071438.665788:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a038b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707599872:0@lo:400:kworker.0 00010000:00080000:3.0:1783071438.665801:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a038bb480 x1869685707600384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071438.665809:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a038bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707600384:0@lo:400:kworker.0 00010000:00080000:3.0:1783071438.665821:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a03904700 x1869685707600896/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071438.665830:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03904700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707600896:0@lo:400:kworker.0 00000100:00100000:1.0:1783071438.666021:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b08872a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1869685707600512:12345-0@lo:400:kworker.0 Request processed in 627us (811us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071438.666027:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00010000:00080000:1.0:1783071438.666060:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a038bb800 x1869685707600768/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071438.666069:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a038bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707600768:0@lo:400:kworker.0 00000100:00100000:1.0:1783071438.666082:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a038b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869685707599744:0@lo:400:kworker.0 00010000:00080000:1.0:1783071438.666094:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a038b9c00 x1869685707600256/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071438.666102:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a038b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707600256:0@lo:400:kworker.0 00000100:00100000:1.0:1783071438.666199:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a038b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1869685707600000:0@lo:400:kworker.0 00000100:00100000:1.0:1783071438.666209:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a038ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1869685707600512:0@lo:400:kworker.0 00000100:00100000:0.0:1783071438.666213:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1783071438.666221:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b08871500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707601024:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783071438.666249:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1783071438.666299:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b08871500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707601024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (1061us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071438.666305:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1783071438.666350:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c68c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707601024:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1783071439.112143:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071439.170585:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783071439.171067:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b08870380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707601280:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783071439.171153:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071439.171229:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707601280 00000100:00100000:0.0:1783071439.171239:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707601280 00000100:00100000:3.0:1783071439.171280:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03904700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707601408:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783071439.171287:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1783071439.171295:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b08871180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707601280:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783071439.171315:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1783071439.171326:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783071439.171345:0:12254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707601408 00000100:00100000:3.0:1783071439.171348:0:12254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707601408 00000100:00100000:3.0:1783071439.171384:0:12254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1783071439.171390:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b08871180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707601280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071439.171391:0:12254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03905500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707601408:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783071439.171397:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00002000:00000024:3.0:1783071439.171402:0:12254:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783071439.171430:0:12254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03905500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707601408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 39us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071439.171436:0:12254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:0.0:1783071439.171442:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b08870380 x1869685707601280/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071455 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1783071439.171459:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a03904700 x1869685707601408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071455 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071439.171460:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b08870380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707601280:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783071439.171471:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03904700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707601408:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783071439.171477:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b08871c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707601152:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783071439.171515:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071439.171654:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707601152 00000100:00100000:3.0:1783071439.171659:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707601152 00000100:00100000:3.0:1783071439.171725:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1783071439.171733:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02e42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707601152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783071439.171752:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783071439.171782:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02e42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707601152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071439.171788:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1783071439.171839:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02e43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707601536:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783071439.171868:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071439.171894:0:12254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707601536 00000100:00100000:3.0:1783071439.171899:0:12254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707601536 00010000:00080000:0.0:1783071439.171910:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b08871c00 x1869685707601152/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071455 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071439.171932:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b08871c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707601152:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783071439.171975:0:12254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1783071439.171983:0:12254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b08870380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707601536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783071439.171994:0:12254:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783071439.172030:0:12254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b08870380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707601536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071439.172044:0:12254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:0.0:1783071439.172652:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a02e43b80 x1869685707601536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071455 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071439.172671:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02e43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707601536:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1783071439.552207:0:13035:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1783071440.130745:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071440.194733:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b08871c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707601664:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783071440.194808:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071440.195016:0:9413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707601664 00000100:00100000:0.0:1783071440.195027:0:9413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707601664 00000100:00100000:0.0:1783071440.195101:0:9413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1783071440.195113:0:9413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03904700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707601664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783071440.195158:0:9413:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783071440.195220:0:9413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03904700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707601664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071440.195227:0:9413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1783071440.195347:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b08871c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707601664:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1783071441.157262:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071442.180000:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071442.193461:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071442.193564:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071442.193591:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071442.193614:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071442.193645:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071442.194245:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692843136 00000100:00100000:0.0:1783071442.194267:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692843136 00000100:00100000:0.0:1783071442.194328:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 310 00000100:00100000:0.0:1783071442.194337:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18686450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:2406:x1869685692843136:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1783071442.194434:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18686450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:2406:x1869685692843136:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 97us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071442.194441:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 310 00000100:00100000:2.0:1783071442.195627:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692843264 00000100:00100000:2.0:1783071442.195673:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692843264 00000100:00100000:2.0:1783071442.195761:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692843392 00000100:00100000:2.0:1783071442.196224:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692843392 00000100:00100000:2.0:1783071442.196252:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692843520 00000100:00100000:2.0:1783071442.196255:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692843520 00000100:00100000:2.0:1783071442.196274:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692843648 00000100:00100000:2.0:1783071442.196278:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692843648 00000100:00100000:2.0:1783071442.196302:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 168 00000100:00100000:2.0:1783071442.196312:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03905f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+6:2405:x1869685692843264:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1783071442.196511:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03905f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+6:2405:x1869685692843264:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 199us (2945us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071442.196518:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 168 00000100:00100000:2.0:1783071442.196536:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 169 00000100:00100000:2.0:1783071442.196542:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03905c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+5:2406:x1869685692843392:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1783071442.196567:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03905c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+5:2406:x1869685692843392:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 26us (2975us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071442.196574:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 169 00000100:00100000:2.0:1783071442.196585:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 170 00000100:00100000:2.0:1783071442.196591:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03906a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2405:x1869685692843520:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1783071442.196614:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03906a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2405:x1869685692843520:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 24us (3001us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071442.196620:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 170 00000100:00100000:2.0:1783071442.196629:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 171 00000100:00100000:2.0:1783071442.196635:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03904a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2406:x1869685692843648:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1783071442.196724:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03904a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2406:x1869685692843648:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 88us (3077us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071442.196739:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 171 00000100:00080000:2.0:1783071442.196959:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783071442.196965:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:3.0:1783071442.882799:0:13182:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe8368f990 20000000:00000080:3.0:1783071442.882822:0:13182:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f8a031dd000 uarg=0000000000000000 20000000:01000000:3.0:1783071442.882901:0:13182:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1783071442.882910:0:13182:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1783071442.882916:0:13182:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1783071442.883815:0:13183:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1783071442.884044:0:13182:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1783071442.892230:0:13182:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1783071442.892275:0:13182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f8b014b8000/0x6b58994c2cbdc10b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071442.892314:0:13182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8b3c460200/0x6b58994c2cbdc09b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ca7 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071442.892323:0:13182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8b3c460400/0x6b58994c2cbdc0a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdc0a2 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071442.892330:0:13182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8b10967400/0x6b58994c2cbdc0b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdc0b0 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071442.892337:0:13182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8b10967000/0x6b58994c2cbdc0c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdc0be expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071442.892410:0:13182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8b10966800/0x6b58994c2cbdc0d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdc0cc expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071442.892418:0:13182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8b014b9000/0x6b58994c2cbdc0e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ce6 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071442.892427:0:13182:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f8b014b8000/0x6b58994c2cbdc10b lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071442.892605:0:13182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8b014b9000/0x6b58994c2cbdc0e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ce6 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071442.892625:0:13182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f8b014b9000/0x6b58994c2cbdc0e8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ce6 expref: 12 pid: 6510 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071442.892644:0:13182:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03905880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1869685707601792:192.168.204.38@tcp:104: 00010000:00010000:3.0:1783071442.892797:0:13182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8b10966800/0x6b58994c2cbdc0d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6b58994c2cbdc0cc expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071442.892805:0:13182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8b10966800/0x6b58994c2cbdc0d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6b58994c2cbdc0cc expref: 23 pid: 6511 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071442.892814:0:13182:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03905180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1869685707601920:0@lo:104: 00000100:00100000:3.0:1783071442.892874:0:13182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783071442.892916:0:13182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8b10967000/0x6b58994c2cbdc0c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6b58994c2cbdc0be expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071442.892935:0:13182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8b10967000/0x6b58994c2cbdc0c5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6b58994c2cbdc0be expref: 23 pid: 6511 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071442.892952:0:13182:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03907b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1869685707602048:0@lo:104: 00000100:00100000:3.0:1783071442.892973:0:13182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071442.893013:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707601920 00000100:00100000:3.0:1783071442.893026:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707601920 00000100:00100000:3.0:1783071442.893077:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707602048 00000100:00100000:3.0:1783071442.893081:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707602048 00000100:00100000:3.0:1783071442.893096:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783071442.893105:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03906d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:feaa1501-b927-4e07-baad-3200e92d7497+4:13182:x1869685707601920:12345-0@lo:104: 00010000:00010000:3.0:1783071442.893119:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8f8b10966c00/0x6b58994c2cbdc0cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdc0d3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071442.893795:0:13182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8b10967400/0x6b58994c2cbdc0b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6b58994c2cbdc0b0 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071442.893807:0:13182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8b10967400/0x6b58994c2cbdc0b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6b58994c2cbdc0b0 expref: 23 pid: 6508 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071442.893819:0:13182:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0380ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1869685707602176:0@lo:104: 00000100:00100000:2.0:1783071442.893868:0:13182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783071442.893895:0:13182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8b3c460400/0x6b58994c2cbdc0a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6b58994c2cbdc0a2 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071442.893902:0:13182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8b3c460400/0x6b58994c2cbdc0a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6b58994c2cbdc0a2 expref: 23 pid: 6508 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071442.893911:0:13182:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03808000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1869685707602304:0@lo:104: 00000100:00100000:2.0:1783071442.893934:0:13182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783071442.893953:0:13182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8b3c460200/0x6b58994c2cbdc09b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ca7 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071442.893961:0:13182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f8b3c460200/0x6b58994c2cbdc09b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ca7 expref: 12 pid: 6508 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071442.893970:0:13182:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0380bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1869685707602432:192.168.204.38@tcp:104: 00000100:00100000:2.0:1783071442.894009:0:13182:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b1f0ba180 going to sleep for 11 seconds 00000100:00100000:0.0:1783071442.894909:0:6499:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1783071442.894927:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:0.0:1783071442.896054:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707602176 00000100:00100000:0.0:1783071442.896067:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707602176 00000100:00100000:0.0:1783071442.896123:0:6499:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1783071442.896133:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707602304 00000100:00100000:0.0:1783071442.896136:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707602304 00000100:00100000:2.0:1783071442.896710:0:13184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783071442.896723:0:13184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a038ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:feaa1501-b927-4e07-baad-3200e92d7497+6:13182:x1869685707602048:12345-0@lo:104: 00010000:00010000:2.0:1783071442.896757:0:13184:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8f8b014b9a00/0x6b58994c2cbdc0be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdc0c5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071442.896905:0:13182:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03907b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1869685707602048:0@lo:104: 00010000:00010000:2.0:1783071442.896983:0:13184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783071442.896990:0:13184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a038ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:feaa1501-b927-4e07-baad-3200e92d7497+6:13182:x1869685707602048:12345-0@lo:104: Request processed in 271us (4015us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071442.896998:0:13184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783071442.897021:0:13184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783071442.897027:0:13184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03809f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:feaa1501-b927-4e07-baad-3200e92d7497+5:13182:x1869685707602176:12345-0@lo:104: 00010000:00010000:2.0:1783071442.897035:0:13184:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461c00/0x6b58994c2cbdc0b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdc0b7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071442.897084:0:13182:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0380ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1869685707602176:0@lo:104: 00010000:00010000:2.0:1783071442.897102:0:13184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783071442.897106:0:13184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03809f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:feaa1501-b927-4e07-baad-3200e92d7497+5:13182:x1869685707602176:12345-0@lo:104: Request processed in 81us (3239us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071442.897111:0:13184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:2.0:1783071442.897129:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783071442.897136:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8b014b9a00/0x6b58994c2cbdc0be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdc0c5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071442.897144:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b014b9a00 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:2.0:1783071442.897148:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8b014b9a00/0x6b58994c2cbdc0be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x6b58994c2cbdc0c5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071442.897237:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8b014b9a00/0x6b58994c2cbdc0be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x6b58994c2cbdc0c5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783071442.897254:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8b014b9a00/0x6b58994c2cbdc0be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x6b58994c2cbdc0c5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071442.897259:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783071442.897315:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8f8b014b9a00/0x6b58994c2cbdc0be lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdc0c5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071442.897322:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783071442.897357:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8b014b9a00/0x6b58994c2cbdc0be lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdc0c5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071442.897386:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8b014b9a00/0x6b58994c2cbdc0be lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdc0c5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071442.897399:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783071442.897402:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461c00/0x6b58994c2cbdc0b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdc0b7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071442.897407:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b3c461c00 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:2.0:1783071442.897410:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461c00/0x6b58994c2cbdc0b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6b58994c2cbdc0b7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071442.897416:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461c00/0x6b58994c2cbdc0b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6b58994c2cbdc0b7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783071442.897421:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461c00/0x6b58994c2cbdc0b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6b58994c2cbdc0b7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071442.897427:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783071442.897448:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461c00/0x6b58994c2cbdc0b0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdc0b7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071442.897454:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783071442.897460:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461c00/0x6b58994c2cbdc0b0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdc0b7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071442.897468:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461c00/0x6b58994c2cbdc0b0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdc0b7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071442.897749:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783071442.897757:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03906d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:feaa1501-b927-4e07-baad-3200e92d7497+4:13182:x1869685707601920:12345-0@lo:104: Request processed in 4652us (4882us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071442.897764:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783071442.897787:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783071442.897796:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03809500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:feaa1501-b927-4e07-baad-3200e92d7497+3:13182:x1869685707602304:12345-0@lo:104: 00010000:00010000:3.0:1783071442.897804:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8f8b10967a00/0x6b58994c2cbdc0a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdc0a9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071442.897837:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1783071442.897842:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03809500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:feaa1501-b927-4e07-baad-3200e92d7497+3:13182:x1869685707602304:12345-0@lo:104: Request processed in 49us (3907us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071442.897858:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783071442.897888:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c79c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:feaa1501-b927-4e07-baad-3200e92d7497:3648:1869685707602688:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783071442.897930:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071442.897989:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783071442.897995:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0380aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:feaa1501-b927-4e07-baad-3200e92d7497:3648:1869685707602560:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783071442.898017:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071442.898136:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707602688 00000100:00100000:3.0:1783071442.898143:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707602688 00010000:00010000:3.0:1783071442.898238:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8b10967400/0x6b58994c2cbdc0b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdc0b0 expref: 24 pid: 6508 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071442.898265:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707602560 00000100:00100000:3.0:1783071442.898268:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707602560 00010000:00010000:3.0:1783071442.898279:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8b10967000/0x6b58994c2cbdc0c5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdc0be expref: 25 pid: 6511 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071442.898297:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783071442.898304:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a038b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:feaa1501-b927-4e07-baad-3200e92d7497+25:3648:x1869685707602688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783071442.898316:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071442.898320:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8b10967400/0x6b58994c2cbdc0b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdc0b0 expref: 25 pid: 6508 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071442.898329:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8b10967400/0x6b58994c2cbdc0b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6b58994c2cbdc0b0 expref: 25 pid: 6508 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071442.898346:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b10967400/0x6b58994c2cbdc0b7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6b58994c2cbdc0b0 expref: 25 pid: 6508 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071442.898385:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783071442.898414:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a038b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:feaa1501-b927-4e07-baad-3200e92d7497+24:3648:x1869685707602688:12345-0@lo:103:ldlm_bl.0 Request processed in 111us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071442.898424:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783071442.898438:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783071442.898450:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a038b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:feaa1501-b927-4e07-baad-3200e92d7497+23:3648:x1869685707602560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783071442.898459:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071442.898464:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8b10967000/0x6b58994c2cbdc0c5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdc0be expref: 23 pid: 6511 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071442.898472:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8b10967000/0x6b58994c2cbdc0c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6b58994c2cbdc0be expref: 23 pid: 6511 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071442.898633:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783071442.898639:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8b10966c00/0x6b58994c2cbdc0cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdc0d3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071442.898645:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b10966c00 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:2.0:1783071442.898649:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8b10966c00/0x6b58994c2cbdc0cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6b58994c2cbdc0d3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071442.898658:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8b10966c00/0x6b58994c2cbdc0cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6b58994c2cbdc0d3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783071442.898664:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8b10966c00/0x6b58994c2cbdc0cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6b58994c2cbdc0d3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071442.898669:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783071442.898690:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8f8b10966c00/0x6b58994c2cbdc0cc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdc0d3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071442.898696:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783071442.898712:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8b10966c00/0x6b58994c2cbdc0cc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdc0d3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071442.898730:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8b10966c00/0x6b58994c2cbdc0cc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdc0d3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071442.898740:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783071442.898743:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8b10967a00/0x6b58994c2cbdc0a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdc0a9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071442.898748:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b10967a00 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:2.0:1783071442.898751:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8b10967a00/0x6b58994c2cbdc0a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6b58994c2cbdc0a9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071442.898757:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8b10967a00/0x6b58994c2cbdc0a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6b58994c2cbdc0a9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783071442.898763:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8b10967a00/0x6b58994c2cbdc0a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6b58994c2cbdc0a9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071442.898767:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783071442.898782:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8f8b10967a00/0x6b58994c2cbdc0a2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdc0a9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071442.898788:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783071442.898794:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8b10967a00/0x6b58994c2cbdc0a2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdc0a9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071442.898800:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8b10967a00/0x6b58994c2cbdc0a2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdc0a9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071442.898812:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071442.898819:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071442.898821:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071442.898874:0:13182:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03905180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1869685707601920:0@lo:104: 00000100:00100000:2.0:1783071442.898886:0:13182:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03808000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1869685707602304:0@lo:104: 00000100:00100000:2.0:1783071442.898961:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c79c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:feaa1501-b927-4e07-baad-3200e92d7497:3648:1869685707602688:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783071442.899095:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b10967000/0x6b58994c2cbdc0c5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6b58994c2cbdc0be expref: 23 pid: 6511 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071442.899105:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783071442.899146:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a038b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:feaa1501-b927-4e07-baad-3200e92d7497+22:3648:x1869685707602560:12345-0@lo:103:ldlm_bl.0 Request processed in 696us (1127us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071442.899295:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783071442.899546:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0380aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:feaa1501-b927-4e07-baad-3200e92d7497:3648:1869685707602560:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783071442.899701:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c79c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:feaa1501-b927-4e07-baad-3200e92d7497:3645:1869685707602816:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783071442.899742:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071442.899785:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783071442.899792:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c79ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:feaa1501-b927-4e07-baad-3200e92d7497:3645:1869685707602944:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783071442.899813:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071442.899897:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707602816 00000100:00100000:3.0:1783071442.899904:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707602816 00010000:00010000:3.0:1783071442.899939:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8b10966800/0x6b58994c2cbdc0d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdc0cc expref: 22 pid: 6511 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071442.899968:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707602944 00000100:00100000:3.0:1783071442.899971:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707602944 00010000:00010000:3.0:1783071442.899981:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8b3c460400/0x6b58994c2cbdc0a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdc0a2 expref: 23 pid: 6508 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071442.900001:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783071442.900009:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02e41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:feaa1501-b927-4e07-baad-3200e92d7497+23:3645:x1869685707602816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783071442.900022:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071442.900028:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8b10966800/0x6b58994c2cbdc0d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdc0cc expref: 23 pid: 6511 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071442.900049:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8b10966800/0x6b58994c2cbdc0d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6b58994c2cbdc0cc expref: 23 pid: 6511 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071442.900063:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b10966800/0x6b58994c2cbdc0d3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6b58994c2cbdc0cc expref: 23 pid: 6511 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071442.900074:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783071442.900105:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02e41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:feaa1501-b927-4e07-baad-3200e92d7497+22:3645:x1869685707602816:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071442.900112:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783071442.900124:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783071442.900130:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02e42a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:feaa1501-b927-4e07-baad-3200e92d7497+21:3645:x1869685707602944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783071442.900140:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071442.900145:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8b3c460400/0x6b58994c2cbdc0a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdc0a2 expref: 21 pid: 6508 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071442.900467:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071442.900609:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8b3c460400/0x6b58994c2cbdc0a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6b58994c2cbdc0a2 expref: 21 pid: 6508 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071442.900623:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b3c460400/0x6b58994c2cbdc0a9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6b58994c2cbdc0a2 expref: 21 pid: 6508 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071442.900633:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783071442.900662:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02e42a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:feaa1501-b927-4e07-baad-3200e92d7497+20:3645:x1869685707602944:12345-0@lo:103:ldlm_bl.0 Request processed in 531us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071442.900668:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783071442.900704:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c79ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:feaa1501-b927-4e07-baad-3200e92d7497:3645:1869685707602944:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783071442.900712:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c79c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:feaa1501-b927-4e07-baad-3200e92d7497:3645:1869685707602816:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783071442.908900:0:13182:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03905880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1869685707601792:192.168.204.38@tcp:104: 00000100:00100000:2.0:1783071442.908931:0:13182:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0380bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1869685707602432:192.168.204.38@tcp:104: 00010000:00010000:2.0:1783071442.908981:0:13182:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f8b014b8000/0x6b58994c2cbdc10b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071442.911239:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071442.911633:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071442.912273:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692843776 00000100:00100000:1.0:1783071442.912287:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692843776 00010000:00010000:1.0:1783071442.912420:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8b014b9000/0x6b58994c2cbdc0e8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ce6 expref: 13 pid: 6510 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071442.912570:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692843904 00000100:00100000:1.0:1783071442.912574:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692843904 00010000:00010000:1.0:1783071442.912589:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8b3c460200/0x6b58994c2cbdc09b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ca7 expref: 14 pid: 6508 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071442.912656:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 44 00000100:00100000:3.0:1783071442.912670:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c79c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e4e7df8-beb0-40df-a2a1-9decaa005633+14:2405:x1869685692843776:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783071442.912692:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071442.912699:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8b014b9000/0x6b58994c2cbdc0e8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ce6 expref: 14 pid: 6510 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071442.912713:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8b014b9000/0x6b58994c2cbdc0e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ce6 expref: 14 pid: 6510 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071442.912735:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b014b9000/0x6b58994c2cbdc0e8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ce6 expref: 14 pid: 6510 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071442.912756:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783071442.912825:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c79c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:2405:x1869685692843776:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 158us (1603us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071442.912833:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 44 00000100:00100000:3.0:1783071442.912870:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 45 00000100:00100000:3.0:1783071442.912877:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab8e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e4e7df8-beb0-40df-a2a1-9decaa005633+12:2405:x1869685692843904:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783071442.912885:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071442.912889:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8b3c460200/0x6b58994c2cbdc09b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ca7 expref: 12 pid: 6508 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071442.912897:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8b3c460200/0x6b58994c2cbdc09b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ca7 expref: 12 pid: 6508 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071442.912906:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b3c460200/0x6b58994c2cbdc09b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ca7 expref: 12 pid: 6508 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071442.912953:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f8b014b8000/0x6b58994c2cbdc10b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071442.912962:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b014b8000/0x6b58994c2cbdc10b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071442.912979:0:6503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f8b014b8000/0x6b58994c2cbdc10b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071442.912985:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f8b014b8000/0x6b58994c2cbdc10b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071442.912992:0:6503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f8b014b8000/0x6b58994c2cbdc10b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071442.913000:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f8b014b8000/0x6b58994c2cbdc10b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071442.913006:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b014b8000 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:3.0:1783071442.913011:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f8b014b8000/0x6b58994c2cbdc10b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071442.913020:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f8b014b8000/0x6b58994c2cbdc10b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071442.913030:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f8b014b8000/0x6b58994c2cbdc10b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071442.913042:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783071442.913061:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab8e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e4e7df8-beb0-40df-a2a1-9decaa005633+11:2405:x1869685692843904:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 185us (1430us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071442.913073:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 45 00010000:00010000:2.0:1783071442.913193:0:13182:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f8b014b8000/0x6b58994c2cbdc10b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071442.913201:0:13182:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f8b014b8000/0x6b58994c2cbdc10b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071442.913208:0:13182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b014b8000/0x6b58994c2cbdc10b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071443.202479:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783071443.276994:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 39473256-b7f7-4f8b-91c6-e632aff5be8d 00000020:00000080:1.0:1783071443.277007:0:8425:0:(genops.c:906:class_export_put()) final put ffff8f8a03243000/39473256-b7f7-4f8b-91c6-e632aff5be8d 00000020:00000080:2.0:1783071443.277150:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8a03243000/39473256-b7f7-4f8b-91c6-e632aff5be8d for lustre-OST0000 00000020:00000080:2.0:1783071443.277215:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f8a03245800 for lustre-OST0000 00000001:00100000:3.0:1783071443.277716:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 39473256-b7f7-4f8b-91c6-e632aff5be8d 00000020:00000080:3.0:1783071443.277728:0:9510:0:(genops.c:906:class_export_put()) final put ffff8f8a02137000/39473256-b7f7-4f8b-91c6-e632aff5be8d 00000020:00000080:1.0:1783071443.278167:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8a02137000/39473256-b7f7-4f8b-91c6-e632aff5be8d for lustre-OST0001 00000020:00000080:1.0:1783071443.278210:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f8a02134800 for lustre-OST0001 00000100:00100000:2.0:1783071443.778727:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b08870000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707603072:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783071443.778826:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071443.779066:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707603072 00000100:00100000:0.0:1783071443.779076:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707603072 00000100:00100000:0.0:1783071443.779131:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1783071443.779140:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c79d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707603072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783071443.779178:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1783071443.779232:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c79d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707603072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071443.779240:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1783071443.779327:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b08870000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707603072:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783071443.779738:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c79ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869685707603328:0@lo:400:kworker.0 00000100:00100000:1.0:1783071443.779786:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071443.779788:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c79f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869685707603456:0@lo:400:kworker.0 00000100:00100000:3.0:1783071443.779968:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c79f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:feaa1501-b927-4e07-baad-3200e92d7497:3648:1869685707603200:0@lo:400:kworker.0 00000100:00100000:0.0:1783071443.780388:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c79e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707603584:0@lo:400:kworker.0 00000100:00100000:1.0:1783071443.785601:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c79c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1869685707603840:0@lo:400:kworker.0 00000100:00100000:1.0:1783071443.785733:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071443.785772:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c79dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1869685707604352:0@lo:400:kworker.0 00000100:00100000:1.0:1783071443.785796:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071443.785898:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707603328 00000100:00100000:1.0:1783071443.785908:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707603328 00000100:00100000:2.0:1783071443.786199:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071443.786226:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c79e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707603968:0@lo:400:kworker.0 00000100:00100000:2.0:1783071443.786260:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071443.786282:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c79c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707604480:0@lo:400:kworker.0 00000100:00100000:2.0:1783071443.786305:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071443.787244:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707603840 00000100:00100000:1.0:1783071443.787253:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707603840 00000100:00100000:2.0:1783071443.787299:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707604352 00000100:00100000:1.0:1783071443.787305:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707603456 00000100:00100000:2.0:1783071443.787306:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707604352 00000100:00100000:1.0:1783071443.787312:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707603456 00000100:00100000:1.0:1783071443.787336:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1783071443.787346:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02e40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1869685707603328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071443.787602:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02e40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1869685707603328:12345-0@lo:400:kworker.0 Request processed in 256us (7816us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071443.789739:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1783071443.789757:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1783071443.789777:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02e41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1869685707603840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071443.789844:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1783071443.789856:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c79ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869685707603456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071443.789874:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02e41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1869685707603840:12345-0@lo:400:kworker.0 Request processed in 106us (4140us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071443.789883:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1783071443.789914:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c79ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869685707603456:12345-0@lo:400:kworker.0 Request processed in 61us (3715us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071443.790922:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071443.790982:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c79f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707604096:0@lo:400:kworker.0 00000100:00100000:0.0:1783071443.791021:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071443.791708:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c79c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707604608:0@lo:400:kworker.0 00000100:00100000:0.0:1783071443.791747:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071443.791998:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1783071443.792018:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02e41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1869685707604352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071443.792081:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02e41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1869685707604352:12345-0@lo:400:kworker.0 Request processed in 69us (6282us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071443.792088:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1783071443.792122:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707603968 00000100:00100000:2.0:1783071443.792130:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707603968 00000100:00100000:2.0:1783071443.792163:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707604480 00000100:00100000:2.0:1783071443.792166:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707604480 00000100:00100000:2.0:1783071443.792178:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707604096 00000100:00100000:2.0:1783071443.792180:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707604096 00000100:00100000:1.0:1783071443.794528:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1783071443.794888:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c79ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869685707603328:0@lo:400:kworker.0 00010000:00080000:1.0:1783071443.794910:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c79c380 x1869685707603840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071443.794921:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c79c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1869685707603840:0@lo:400:kworker.0 00010000:00080000:1.0:1783071443.794936:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c79dc00 x1869685707604352/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071443.794944:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c79dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1869685707604352:0@lo:400:kworker.0 00000100:00100000:3.0:1783071443.795036:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071443.795089:0:8910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707604608 00000100:00100000:3.0:1783071443.795101:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c79fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1869685707603712:0@lo:400:kworker.0 00000100:00100000:3.0:1783071443.795149:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071443.795175:0:8910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707604608 00000100:00100000:3.0:1783071443.795181:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707603712 00000100:00100000:1.0:1783071443.795218:0:8910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1783071443.795227:0:8910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03905880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707603968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071443.795247:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707603712 00000100:00100000:3.0:1783071443.795289:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1783071443.795300:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a038b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869685707603712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071443.795309:0:8910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03905880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707603968:12345-0@lo:400:kworker.0 Request processed in 82us (9046us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071443.795318:0:8910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1783071443.795334:0:8910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1783071443.795348:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a038b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869685707603712:12345-0@lo:400:kworker.0 Request processed in 47us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071443.795348:0:8910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03905180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707604480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071443.795383:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1783071443.795415:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c79fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1869685707603712:0@lo:400:kworker.0 00000100:00100000:3.0:1783071443.795423:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c79ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1869685707604224:0@lo:400:kworker.0 00000100:00100000:3.0:1783071443.795445:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071443.795464:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707604224 00000100:00100000:3.0:1783071443.795467:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707604224 00000100:00100000:3.0:1783071443.795487:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1783071443.795493:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a038b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869685707604224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071443.795520:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a038b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869685707604224:12345-0@lo:400:kworker.0 Request processed in 28us (75us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071443.795526:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1783071443.795566:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c79ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1869685707604224:0@lo:400:kworker.0 00000100:00100000:1.0:1783071443.795601:0:8910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03905180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707604480:12345-0@lo:400:kworker.0 Request processed in 258us (9293us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071443.795609:0:8910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1783071443.795619:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c79f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869685707603456:0@lo:400:kworker.0 00010000:00080000:3.0:1783071443.795648:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c79e680 x1869685707603968/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071443.795659:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c79e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707603968:0@lo:400:kworker.0 00000100:00100000:1.0:1783071443.795693:0:8910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1783071443.795700:0:8910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b08873480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707604608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071443.795739:0:8910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b08873480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707604608:12345-0@lo:400:kworker.0 Request processed in 40us (3992us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071443.795747:0:8910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:3.0:1783071443.795856:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c79c000 x1869685707604480/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071443.795866:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c79c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707604480:0@lo:400:kworker.0 00000100:00080000:3.0:1783071443.795893:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783071443.795897:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783071443.795900:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783071443.795902:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783071443.796060:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707603584 00000100:00100000:1.0:1783071443.796066:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707603584 00000100:00100000:1.0:1783071443.796111:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1783071443.796118:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b08872680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707603584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071443.796158:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b08872680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707603584:12345-0@lo:400:kworker.0 Request processed in 39us (5240us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071443.796164:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1783071443.796195:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c79e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707603584:0@lo:400:kworker.0 00010000:00080000:0.0:1783071443.796214:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c79c700 x1869685707604608/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071443.796226:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c79c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707604608:0@lo:400:kworker.0 00000100:00100000:2.0:1783071443.797041:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1783071443.797055:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b08872d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707604096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071443.797127:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b08872d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707604096:12345-0@lo:400:kworker.0 Request processed in 76us (6104us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071443.797134:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1783071443.797161:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707603200 00000100:00100000:2.0:1783071443.797166:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707603200 00000100:00100000:2.0:1783071443.797213:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1783071443.797220:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18685c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+20:3648:x1869685707603200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071443.797386:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18685c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+20:3648:x1869685707603200:12345-0@lo:400:kworker.0 Request processed in 42us (2330us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071443.797395:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00010000:00080000:0.0:1783071443.797419:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c79f100 x1869685707604096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071443.797433:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c79f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707604096:0@lo:400:kworker.0 00000100:00100000:2.0:1783071443.797446:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c79f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:feaa1501-b927-4e07-baad-3200e92d7497:3648:1869685707603200:0@lo:400:kworker.0 00000100:00100000:1.0:1783071444.056007:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071444.056148:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692844032 00000100:00100000:0.0:1783071444.056160:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692844032 00000100:00100000:0.0:1783071444.056233:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 312 00000100:00100000:0.0:1783071444.056243:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18686050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e4e7df8-beb0-40df-a2a1-9decaa005633+11:6172:x1869685692844032:12345-192.168.204.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783071444.056262:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071444.056285:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b00030c00/0x6b58994c2cbdc112 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98d17 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071444.056315:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b00030c00/0x6b58994c2cbdc112 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d17 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071444.056327:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b00030c00/0x6b58994c2cbdc112 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d17 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071444.056337:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b00030c00, rc 0) 00000100:00100000:0.0:1783071444.056425:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18686050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e4e7df8-beb0-40df-a2a1-9decaa005633+12:6172:x1869685692844032:12345-192.168.204.38@tcp:101:ll_cfg_requeue.0 Request processed in 183us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071444.056431:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 312 00000100:00100000:3.0:1783071444.058845:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071444.059789:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692844160 00000100:00100000:2.0:1783071444.059800:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692844160 00000100:00100000:2.0:1783071444.059870:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 313 00000100:00100000:2.0:1783071444.059880:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18687c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e4e7df8-beb0-40df-a2a1-9decaa005633+12:6172:x1869685692844160:12345-192.168.204.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783071444.060038:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18687c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e4e7df8-beb0-40df-a2a1-9decaa005633+12:6172:x1869685692844160:12345-192.168.204.38@tcp:501:ll_cfg_requeue.0 Request processed in 159us (1214us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071444.060046:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 313 00000100:00100000:0.0:1783071444.062588:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071444.062701:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692844288 00000100:00100000:1.0:1783071444.062712:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692844288 00000100:00100000:1.0:1783071444.062773:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 314 00000100:00100000:1.0:1783071444.062784:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18685450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e4e7df8-beb0-40df-a2a1-9decaa005633+12:6172:x1869685692844288:12345-192.168.204.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783071444.062952:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18685450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e4e7df8-beb0-40df-a2a1-9decaa005633+12:6172:x1869685692844288:12345-192.168.204.38@tcp:503:ll_cfg_requeue.0 Request processed in 169us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071444.062966:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 314 00000100:00100000:1.0:1783071444.067307:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071444.067403:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692844416 00000100:00100000:0.0:1783071444.067413:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692844416 00000100:00100000:0.0:1783071444.067461:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 315 00000100:00100000:0.0:1783071444.067470:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18687450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e4e7df8-beb0-40df-a2a1-9decaa005633+12:6172:x1869685692844416:12345-192.168.204.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783071444.067487:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071444.067505:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b00031a00/0x6b58994c2cbdc119 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98d1e expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071444.067532:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b00031a00/0x6b58994c2cbdc119 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d1e expref: 13 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071444.067543:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b00031a00/0x6b58994c2cbdc119 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d1e expref: 13 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071444.067553:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b00031a00, rc 0) 00000100:00100000:0.0:1783071444.067607:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18687450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:6172:x1869685692844416:12345-192.168.204.38@tcp:101:ll_cfg_requeue.0 Request processed in 138us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071444.067615:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 315 00000100:00100000:0.0:1783071444.079165:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071444.085067:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692844544 00000100:00100000:2.0:1783071444.085085:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692844544 00000100:00100000:2.0:1783071444.085156:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 316 00000100:00100000:2.0:1783071444.085168:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18687850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:6172:x1869685692844544:12345-192.168.204.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783071444.085342:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18687850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:6172:x1869685692844544:12345-192.168.204.38@tcp:501:ll_cfg_requeue.0 Request processed in 175us (6214us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071444.085351:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 316 00000100:00100000:2.0:1783071444.088481:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071444.088547:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692844672 00000100:00100000:1.0:1783071444.088557:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692844672 00000100:00100000:1.0:1783071444.088617:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 317 00000100:00100000:1.0:1783071444.088628:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18685850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:6172:x1869685692844672:12345-192.168.204.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783071444.088797:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18685850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:6172:x1869685692844672:12345-192.168.204.38@tcp:503:ll_cfg_requeue.0 Request processed in 171us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071444.088805:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 317 00010000:00010000:2.0:1783071444.227227:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071444.290669:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a038b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707604736:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783071444.290744:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071444.290867:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b08870000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707604864:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783071444.290893:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071444.290913:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783071444.290919:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b08871c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707604992:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783071444.290940:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071444.290968:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707604736 00000100:00100000:0.0:1783071444.290983:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707604736 00000100:00100000:0.0:1783071444.291019:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707604864 00000100:00100000:0.0:1783071444.291022:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707604864 00000100:00100000:0.0:1783071444.291034:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707604992 00000100:00100000:0.0:1783071444.291036:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707604992 00000100:00100000:0.0:1783071444.291050:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1783071444.291057:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b08873100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707604736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783071444.291089:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783071444.291139:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b08873100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707604736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071444.291148:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1783071444.291166:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783071444.291172:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b078da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707604864:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783071444.291188:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783071444.291216:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b078da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707604864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071444.291222:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783071444.291233:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1783071444.291239:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b078d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707604992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783071444.291248:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783071444.291268:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b078d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707604992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 29us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071444.291273:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:0.0:1783071444.291305:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b08871c00 x1869685707604992/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071460 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071444.291322:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b08871c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707604992:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1783071444.291343:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b08870000 x1869685707604864/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071460 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071444.291354:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b08870000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707604864:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1783071444.291405:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a038b8380 x1869685707604736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071460 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071444.291416:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a038b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707604736:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783071444.291655:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783071444.291665:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a038bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707605120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783071444.291693:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071444.296789:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707605120 00000100:00100000:3.0:1783071444.296804:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707605120 00000100:00100000:3.0:1783071444.307107:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1783071444.307123:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b078d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707605120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783071444.307153:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783071444.307254:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b078d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707605120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 134us (15559us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071444.307261:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:1.0:1783071444.307417:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a038bb800 x1869685707605120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071460 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071444.307438:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a038bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707605120:0@lo:13:osp-pre-0-0.0 10000000:01000000:2.0:1783071444.932885:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783071444.932893:0:6513:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8f8b34e49800 from 7 10000000:01000000:2.0:1783071444.932899:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783071444.932954:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67000/0x6b58994c2cbdc120 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071444.932967:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67000/0x6b58994c2cbdc120 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071444.932978:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67000/0x6b58994c2cbdc120 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071444.933003:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03907b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707605248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783071444.933074:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071444.933147:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0317e180 going to sleep for 11 seconds 00000100:00100000:0.0:1783071444.933420:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707605248 00000100:00100000:0.0:1783071444.933428:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707605248 00000100:00100000:0.0:1783071444.933485:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1783071444.933495:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18684c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+20:6513:x1869685707605248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783071444.933507:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071444.933521:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b00031600/0x6b58994c2cbdc127 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdc120 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071444.933544:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b00031600/0x6b58994c2cbdc127 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdc120 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071444.933554:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b00031600/0x6b58994c2cbdc127 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdc120 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071444.933563:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b00031600, rc 0) 00000100:00100000:0.0:1783071444.933603:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18684c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+21:6513:x1869685707605248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071444.933626:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1783071444.933786:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03907b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707605248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783071444.933801:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67000/0x6b58994c2cbdc120 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc127 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071444.933823:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67000/0x6b58994c2cbdc120 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdc127 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071444.933890:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02e42d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707605376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783071444.933916:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071444.933945:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0394fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1783071444.934006:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707605376 00000100:00100000:2.0:1783071444.934011:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707605376 00000100:00100000:2.0:1783071444.934044:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1783071444.934051:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18684850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+21:6513:x1869685707605376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783071444.934163:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18684850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+21:6513:x1869685707605376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 111us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071444.934170:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1783071444.934210:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02e42d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707605376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783071444.934250:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03907b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707605504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783071444.934290:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071444.934303:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0317ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1783071444.934320:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707605504 00000100:00100000:2.0:1783071444.934324:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707605504 00000100:00100000:2.0:1783071444.934339:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1783071444.934344:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07695850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+21:6513:x1869685707605504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783071444.934448:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07695850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+21:6513:x1869685707605504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 103us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071444.934454:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1783071444.934491:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03907b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707605504:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783071444.935138:0:13240:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1783071444.935190:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1783071444.935211:0:6513:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783071444.935220:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67000/0x6b58994c2cbdc120 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc127 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071444.935230:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67000/0x6b58994c2cbdc120 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc127 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071444.935240:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783071444.935243:0:6513:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8f8b069b2000 from 7 10000000:01000000:2.0:1783071444.935246:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783071444.935269:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66200/0x6b58994c2cbdc12e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071444.935276:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66200/0x6b58994c2cbdc12e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071444.935285:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66200/0x6b58994c2cbdc12e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071444.935299:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03907b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707605632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783071444.935339:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071444.935355:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0317e180 going to sleep for 11 seconds 00000100:00100000:2.0:1783071444.935389:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707605632 00000100:00100000:2.0:1783071444.935394:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707605632 00000100:00100000:2.0:1783071444.935428:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1783071444.935434:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07697850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+21:6513:x1869685707605632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783071444.935443:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071444.935453:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b2fd67800/0x6b58994c2cbdc135 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdc12e expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071444.935471:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b2fd67800/0x6b58994c2cbdc135 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdc12e expref: 22 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071444.935482:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b2fd67800/0x6b58994c2cbdc135 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdc12e expref: 22 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071444.935489:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b2fd67800, rc 0) 00000100:00100000:2.0:1783071444.935519:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07697850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+22:6513:x1869685707605632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 84us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071444.935525:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1783071444.935554:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03907b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707605632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783071444.935564:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66200/0x6b58994c2cbdc12e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc135 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071444.935572:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66200/0x6b58994c2cbdc12e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdc135 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071444.935608:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03907b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707605760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783071444.935637:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071444.935650:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0317e180 going to sleep for 11 seconds 00000100:00100000:2.0:1783071444.935661:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707605760 00000100:00100000:2.0:1783071444.935664:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707605760 00000100:00100000:2.0:1783071444.935681:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1783071444.935686:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07697450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+22:6513:x1869685707605760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783071444.935765:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07697450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+22:6513:x1869685707605760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 78us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071444.935772:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1783071444.935798:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03907b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707605760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783071444.935832:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03907b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707605888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783071444.935868:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071444.935880:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0317e180 going to sleep for 11 seconds 00000100:00100000:2.0:1783071444.935891:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707605888 00000100:00100000:2.0:1783071444.935894:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707605888 00000100:00100000:2.0:1783071444.935909:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1783071444.935915:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07695450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+22:6513:x1869685707605888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783071444.935975:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07695450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+22:6513:x1869685707605888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 59us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071444.935982:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1783071444.936016:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03907b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707605888:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783071444.939793:0:13241:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1783071444.942670:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1783071444.942708:0:6513:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783071444.942720:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66200/0x6b58994c2cbdc12e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc135 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071444.942749:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66200/0x6b58994c2cbdc12e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc135 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071444.942761:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783071444.942764:0:6513:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8f8b3447b000 from 7 10000000:01000000:2.0:1783071444.942767:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783071444.942817:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66400/0x6b58994c2cbdc13c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071444.942826:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66400/0x6b58994c2cbdc13c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071444.942836:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66400/0x6b58994c2cbdc13c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071444.942861:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03907b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707606016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783071444.942924:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071444.942968:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0317ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1783071444.943080:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707606016 00000100:00100000:3.0:1783071444.943088:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707606016 00000100:00100000:3.0:1783071444.943144:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1783071444.943153:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07697c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+22:6513:x1869685707606016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783071444.943175:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071444.943188:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b014b8800/0x6b58994c2cbdc143 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdc13c expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071444.943213:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b014b8800/0x6b58994c2cbdc143 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdc13c expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071444.943226:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b014b8800/0x6b58994c2cbdc143 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdc13c expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071444.943235:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b014b8800, rc 0) 00000100:00100000:3.0:1783071444.943274:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07697c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+23:6513:x1869685707606016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071444.943281:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1783071444.943435:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03907b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707606016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783071444.943451:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66400/0x6b58994c2cbdc13c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc143 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071444.943460:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66400/0x6b58994c2cbdc13c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdc143 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071444.943513:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03907b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707606144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783071444.943540:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071444.943564:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0317ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1783071444.943616:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707606144 00000100:00100000:0.0:1783071444.943620:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707606144 00000100:00100000:0.0:1783071444.943647:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1783071444.943654:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07696050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+23:6513:x1869685707606144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783071444.943773:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07696050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+23:6513:x1869685707606144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071444.943779:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1783071444.943850:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03907b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707606144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783071444.943879:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03907b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707606272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783071444.943916:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071444.943976:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0317ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1783071444.945588:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707606272 00000100:00100000:0.0:1783071444.945601:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707606272 00000100:00100000:0.0:1783071444.945665:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1783071444.945675:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07695c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+23:6513:x1869685707606272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783071444.945829:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07695c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+23:6513:x1869685707606272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 155us (1911us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071444.945837:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1783071444.945945:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03907b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707606272:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783071444.946893:0:13242:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1783071444.947112:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1783071444.947134:0:6513:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783071444.947144:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66400/0x6b58994c2cbdc13c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc143 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071444.947156:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66400/0x6b58994c2cbdc13c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc143 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783071444.947167:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783071444.947169:0:6513:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8f8b10f7e000 from 7 10000000:01000000:0.0:1783071444.947172:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783071444.947203:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b00031200/0x6b58994c2cbdc14a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071444.947219:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8b00031200/0x6b58994c2cbdc14a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071444.947230:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8b00031200/0x6b58994c2cbdc14a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071444.947252:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b078d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707606400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783071444.947305:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071444.947339:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b3b6403c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783071444.947356:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707606400 00000100:00100000:0.0:1783071444.947360:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707606400 00000100:00100000:0.0:1783071444.947410:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1783071444.947417:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07696450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+23:6513:x1869685707606400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783071444.947430:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071444.947441:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b00030800/0x6b58994c2cbdc151 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdc14a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071444.947464:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b00030800/0x6b58994c2cbdc151 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdc14a expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071444.947473:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b00030800/0x6b58994c2cbdc151 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdc14a expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071444.947481:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b00030800, rc 0) 00000100:00100000:0.0:1783071444.947514:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07696450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+24:6513:x1869685707606400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071444.947520:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1783071444.947570:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b078d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707606400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783071444.947587:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8b00031200/0x6b58994c2cbdc14a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc151 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071444.947595:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8b00031200/0x6b58994c2cbdc14a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdc151 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071444.948917:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b078d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707606528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783071444.948965:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071444.949007:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b06dbca80 going to sleep for 11 seconds 00000100:00100000:2.0:1783071444.949074:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707606528 00000100:00100000:2.0:1783071444.949080:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707606528 00000100:00100000:2.0:1783071444.949124:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1783071444.949133:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07697050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+24:6513:x1869685707606528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783071444.949245:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07697050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+24:6513:x1869685707606528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 113us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071444.949252:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1783071444.949570:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b078d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707606528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783071444.949603:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b078d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707606656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783071444.949651:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071444.949676:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b06dbca80 going to sleep for 11 seconds 00000100:00100000:2.0:1783071444.949726:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707606656 00000100:00100000:2.0:1783071444.949730:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707606656 00000100:00100000:2.0:1783071444.949763:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1783071444.949770:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07694450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+24:6513:x1869685707606656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783071444.949858:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07694450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+24:6513:x1869685707606656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 88us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071444.949865:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1783071444.949940:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b078d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707606656:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783071444.950768:0:13243:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1783071444.950935:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1783071444.950955:0:6513:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783071444.950965:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b00031200/0x6b58994c2cbdc14a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc151 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071444.950987:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8b00031200/0x6b58994c2cbdc14a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc151 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071445.251627:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071445.314693:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b078d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707606784:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783071445.314771:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071445.314917:0:9413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707606784 00000100:00100000:0.0:1783071445.314925:0:9413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707606784 00000100:00100000:0.0:1783071445.314988:0:9413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1783071445.314999:0:9413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02e42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707606784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783071445.315034:0:9413:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783071445.315097:0:9413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02e42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707606784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071445.315106:0:9413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1783071445.315437:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b078d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707606784:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1783071446.280465:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783071447.182182:0:13382:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg438-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1783071447.299624:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071447.322771:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071447.322849:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071447.322879:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071447.322899:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071447.322920:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071447.322928:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692845056 00000100:00100000:3.0:1783071447.322939:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692845056 00000100:00100000:1.0:1783071447.322955:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692845312 00000100:00100000:1.0:1783071447.322959:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692845312 00000100:00100000:3.0:1783071447.322998:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692844928 00000100:00100000:3.0:1783071447.323002:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692844928 00000100:00100000:0.0:1783071447.323271:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692844800 00000100:00100000:0.0:1783071447.323276:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692844800 00000100:00100000:0.0:1783071447.323320:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 330 00000100:00100000:0.0:1783071447.323329:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07694050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:2405:x1869685692844800:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1783071447.323420:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07694050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:2405:x1869685692844800:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 92us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071447.323428:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 330 00000100:00100000:2.0:1783071447.323497:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692845184 00000100:00100000:2.0:1783071447.323502:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692845184 00000100:00100000:3.0:1783071447.326533:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 178 00000100:00100000:3.0:1783071447.326555:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02e41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+5:2405:x1869685692845056:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1783071447.326596:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 179 00000100:00100000:0.0:1783071447.326609:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02e43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+6:2405:x1869685692844928:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1783071447.326665:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02e41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+5:2405:x1869685692845056:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 119us (3819us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071447.326674:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 178 00000100:00080000:3.0:1783071447.326700:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783071447.326706:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783071447.327039:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02e43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+6:2405:x1869685692844928:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 432us (4137us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071447.327048:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 179 00000100:00100000:2.0:1783071447.329332:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 180 00000100:00100000:2.0:1783071447.329349:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02e42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2405:x1869685692845184:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1783071447.330777:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02e42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2405:x1869685692845184:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 1416us (7837us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071447.330791:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 180 00000100:00100000:0.0:1783071447.335151:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 181 00000100:00100000:0.0:1783071447.335173:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02e42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2405:x1869685692845312:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1783071447.335274:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02e42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2405:x1869685692845312:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 109us (12393us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071447.335281:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 181 00010000:00010000:2.0:1783071448.323740:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071448.899442:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03907b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707606912:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783071448.899519:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071448.900217:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707606912 00000100:00100000:1.0:1783071448.900225:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707606912 00000100:00100000:1.0:1783071448.900306:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1783071448.900315:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0380bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707606912:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783071448.900375:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1783071448.900426:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0380bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707606912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071448.900434:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1783071448.901308:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c79f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869685707607168:0@lo:400:kworker.0 00000100:00100000:2.0:1783071448.901394:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071448.901439:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c79c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1869685707607680:0@lo:400:kworker.0 00000100:00100000:2.0:1783071448.901459:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071448.901477:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c79fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1869685707608192:0@lo:400:kworker.0 00000100:00100000:2.0:1783071448.901498:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071448.901524:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1783071448.901531:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c79f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869685707607296:0@lo:400:kworker.0 00000100:00100000:2.0:1783071448.901570:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071448.901585:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c79e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707607808:0@lo:400:kworker.0 00000100:00100000:2.0:1783071448.901609:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071448.901635:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c79dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707608320:0@lo:400:kworker.0 00000100:00100000:2.0:1783071448.901656:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071448.901694:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707607168 00000100:00100000:2.0:1783071448.901700:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707607168 00000100:00100000:2.0:1783071448.901741:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707607680 00000100:00100000:2.0:1783071448.901744:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707607680 00000100:00100000:2.0:1783071448.901768:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707608192 00000100:00100000:2.0:1783071448.901771:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707608192 00000100:00100000:2.0:1783071448.901784:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707607296 00000100:00100000:2.0:1783071448.901786:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707607296 00000100:00100000:2.0:1783071448.901799:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1783071448.901805:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03808000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869685707607168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071448.901854:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03808000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869685707607168:12345-0@lo:400:kworker.0 Request processed in 48us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071448.901860:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1783071448.901876:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1783071448.901882:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0380ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869685707607680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071448.901910:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0380ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869685707607680:12345-0@lo:400:kworker.0 Request processed in 29us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071448.901916:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1783071448.901927:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1783071448.901932:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0380aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869685707608192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071448.901958:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0380aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869685707608192:12345-0@lo:400:kworker.0 Request processed in 26us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071448.901974:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1783071448.901988:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1783071448.901994:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869685707607296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071448.902023:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869685707607296:12345-0@lo:400:kworker.0 Request processed in 29us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071448.902029:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1783071448.902051:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707607808 00000100:00100000:2.0:1783071448.902055:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707607808 00000100:00100000:2.0:1783071448.902078:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707608320 00000100:00100000:2.0:1783071448.902081:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707608320 00000100:00100000:2.0:1783071448.902098:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1783071448.902104:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707607808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071448.902134:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707607808:12345-0@lo:400:kworker.0 Request processed in 31us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071448.902139:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1783071448.902149:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1783071448.902155:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707608320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071448.902180:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707608320:12345-0@lo:400:kworker.0 Request processed in 25us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071448.902185:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:0.0:1783071448.902573:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783071448.902578:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783071448.902580:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783071448.902593:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02e43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:feaa1501-b927-4e07-baad-3200e92d7497:3646:1869685707607040:0@lo:400:kworker.0 00000100:00100000:0.0:1783071448.902631:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071448.902658:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c79e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1869685707607552:0@lo:400:kworker.0 00000100:00100000:0.0:1783071448.902682:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071448.902700:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c79ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1869685707608064:0@lo:400:kworker.0 00000100:00100000:0.0:1783071448.902721:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071448.902762:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1783071448.902769:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c79c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707607424:0@lo:400:kworker.0 00000100:00100000:0.0:1783071448.902796:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071448.902813:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c79f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707607936:0@lo:400:kworker.0 00000100:00100000:0.0:1783071448.902836:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071448.902846:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c79c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707608448:0@lo:400:kworker.0 00000100:00100000:0.0:1783071448.902862:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071448.902881:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707607040 00000100:00100000:0.0:1783071448.902885:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707607040 00000100:00100000:2.0:1783071448.902961:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707607936 00000100:00100000:2.0:1783071448.902964:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707607936 00000100:00100000:2.0:1783071448.902985:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707608448 00000100:00100000:2.0:1783071448.902988:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707608448 00000100:00100000:2.0:1783071448.903002:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1783071448.903009:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b08870000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707607936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071448.903060:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b08870000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707607936:12345-0@lo:400:kworker.0 Request processed in 51us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071448.903065:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1783071448.903075:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1783071448.903080:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b08871c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707608448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071448.903103:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b08871c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707608448:12345-0@lo:400:kworker.0 Request processed in 23us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071448.903109:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:2.0:1783071448.903124:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783071448.903126:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783071448.903132:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707607552 00000100:00100000:2.0:1783071448.903134:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707607552 00000100:00100000:2.0:1783071448.903152:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707608064 00000100:00100000:2.0:1783071448.903154:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707608064 00000100:00100000:2.0:1783071448.903166:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1783071448.903171:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b078d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869685707607552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071448.903391:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1783071448.903401:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b078d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869685707608064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071448.904020:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1783071448.904030:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07696850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+24:3646:x1869685707607040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071448.908088:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b078d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869685707608064:12345-0@lo:400:kworker.0 Request processed in 4680us (5355us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071448.908104:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1783071448.908157:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707607424 00000100:00100000:1.0:1783071448.908166:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707607424 00000100:00100000:1.0:1783071448.908224:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1783071448.908232:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b078d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707607424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071448.908285:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b078d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707607424:12345-0@lo:400:kworker.0 Request processed in 55us (5488us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071448.908291:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1783071448.919332:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b078d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869685707607552:12345-0@lo:400:kworker.0 Request processed in 16149us (16638us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071448.919769:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00080000:2.0:1783071448.919820:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783071448.922687:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c79c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707607424:0@lo:400:kworker.0 00010000:00080000:0.0:1783071448.922725:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c79f480 x1869685707607936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071448.922746:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c79f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707607936:0@lo:400:kworker.0 00010000:00080000:0.0:1783071448.922762:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c79c380 x1869685707608448/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071448.922770:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c79c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707608448:0@lo:400:kworker.0 00000100:00100000:0.0:1783071448.922783:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c79e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1869685707607552:0@lo:400:kworker.0 00000100:00100000:0.0:1783071448.922796:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c79ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1869685707608064:0@lo:400:kworker.0 00000100:00100000:0.0:1783071448.922957:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03907b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707606912:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783071448.922997:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c79f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869685707607296:0@lo:400:kworker.0 00010000:00080000:0.0:1783071448.923024:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c79e680 x1869685707607808/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071448.923033:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c79e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707607808:0@lo:400:kworker.0 00010000:00080000:0.0:1783071448.923046:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c79dc00 x1869685707608320/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071448.923053:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c79dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707608320:0@lo:400:kworker.0 00000100:00100000:0.0:1783071448.923065:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c79f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869685707607168:0@lo:400:kworker.0 00010000:00080000:0.0:1783071448.923077:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c79c000 x1869685707607680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071448.923084:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c79c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1869685707607680:0@lo:400:kworker.0 00010000:00080000:0.0:1783071448.923097:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c79fb80 x1869685707608192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071448.923105:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c79fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1869685707608192:0@lo:400:kworker.0 00000100:00100000:0.0:1783071448.923176:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07696850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+24:3646:x1869685707607040:12345-0@lo:400:kworker.0 Request processed in 19147us (20542us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071448.923187:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1783071448.924260:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02e43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:feaa1501-b927-4e07-baad-3200e92d7497:3646:1869685707607040:0@lo:400:kworker.0 00010000:00010000:2.0:1783071449.347120:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071449.411304:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03907b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707608576:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783071449.411404:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783071449.411432:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071449.411509:0:12254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707608576 00000100:00100000:2.0:1783071449.411517:0:12254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707608576 00000100:00100000:3.0:1783071449.411550:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a038bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707608704:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783071449.411563:0:12254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1783071449.411582:0:12254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707608576:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783071449.411590:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1783071449.411618:0:12254:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783071449.411623:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707608704 00000100:00100000:3.0:1783071449.411629:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707608704 00000100:00100000:3.0:1783071449.411653:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1783071449.411660:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a038b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707608704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783071449.411677:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783071449.411715:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a038b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707608704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071449.411734:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1783071449.411770:0:12254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707608576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 190us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071449.411777:0:12254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:3.0:1783071449.411788:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a038bb480 x1869685707608704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071465 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071449.411795:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00080000:2.0:1783071449.411808:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a03907b80 x1869685707608576/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071465 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071449.411808:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c79ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707608832:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783071449.411813:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a038bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707608704:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783071449.411831:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03907b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707608576:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783071449.411840:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071449.411872:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707608832 00000100:00100000:2.0:1783071449.411876:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707608832 00000100:00100000:2.0:1783071449.411896:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1783071449.411902:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c79fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707608832:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783071449.411913:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783071449.411946:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c79fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707608832:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071449.411951:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a038bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707608960:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783071449.411952:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1783071449.411981:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071449.412001:0:12254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707608960 00010000:00080000:0.0:1783071449.412004:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c79ed80 x1869685707608832/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071465 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071449.412006:0:12254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707608960 00000100:00100000:0.0:1783071449.412022:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c79ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707608832:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783071449.412030:0:12254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1783071449.412038:0:12254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c79c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707608960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783071449.412048:0:12254:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783071449.414260:0:12254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c79c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707608960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2215us (2271us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071449.414274:0:12254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:1.0:1783071449.414387:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a038bb480 x1869685707608960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071465 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071449.414409:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a038bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707608960:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1783071450.372661:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071450.438756:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03907b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707609088:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783071450.438844:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071450.438925:0:9413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707609088 00000100:00100000:0.0:1783071450.438933:0:9413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707609088 00000100:00100000:0.0:1783071450.438985:0:9413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1783071450.438995:0:9413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3b4d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707609088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783071450.439033:0:9413:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783071450.439079:0:9413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3b4d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707609088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071450.439086:0:9413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1783071450.439131:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03907b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707609088:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1783071451.395786:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071452.424659:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071452.439531:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071452.439597:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071452.439633:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071452.439652:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071452.439689:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071452.439727:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692845568 00000100:00100000:2.0:1783071452.439842:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692845440 00000100:00100000:2.0:1783071452.439865:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692845440 00000100:00100000:3.0:1783071452.440215:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692845824 00000100:00100000:3.0:1783071452.440220:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692845824 00000100:00100000:3.0:1783071452.440279:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692845696 00000100:00100000:3.0:1783071452.440282:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692845696 00000100:00100000:2.0:1783071452.440427:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 332 00000100:00100000:2.0:1783071452.440439:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07695050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:2405:x1869685692845440:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1783071452.440539:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07695050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:2405:x1869685692845440:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 102us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071452.440547:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 332 00000100:00100000:2.0:1783071452.440586:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692845952 00000100:00100000:2.0:1783071452.440590:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692845952 00000100:00100000:2.0:1783071452.440614:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 188 00000100:00100000:2.0:1783071452.440620:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c79dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2405:x1869685692845824:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1783071452.440653:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c79dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2405:x1869685692845824:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 34us (1020us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071452.440659:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 188 00000100:00100000:2.0:1783071452.440686:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 189 00000100:00100000:2.0:1783071452.440692:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c79e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+5:2405:x1869685692845696:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1783071452.440716:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c79e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+5:2405:x1869685692845696:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 25us (1064us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071452.440723:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 189 00000100:00100000:2.0:1783071452.440735:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 190 00000100:00100000:1.0:1783071452.441003:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692845568 00000100:00100000:1.0:1783071452.441034:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 191 00000100:00100000:1.0:1783071452.441040:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c79f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+6:2405:x1869685692845568:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1783071452.441072:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c79f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+6:2405:x1869685692845568:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 32us (1475us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071452.441078:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 191 00000100:00100000:2.0:1783071452.443438:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c79f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2405:x1869685692845952:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1783071452.443562:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c79f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2405:x1869685692845952:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 2815us (3866us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071452.443575:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 190 00000100:00080000:1.0:1783071452.443759:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783071452.443766:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1783071452.811823:0:13531:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 05:37:31 (1783071451) === 00000100:00100000:1.0:1783071453.001969:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071453.002083:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692846208 00000100:00100000:0.0:1783071453.002093:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692846208 00000100:00100000:0.0:1783071453.002226:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2 00000100:00100000:0.0:1783071453.002238:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c79ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:bf7532e4-6153-424a-9f4e-84941256b41f+6:10512:x1869685692846208:12345-192.168.204.38@tcp:700:mkdir.0 00000100:00100000:0.0:1783071453.002337:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c79ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:bf7532e4-6153-424a-9f4e-84941256b41f+6:10512:x1869685692846208:12345-192.168.204.38@tcp:700:mkdir.0 Request processed in 101us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071453.002345:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2 00000100:00100000:2.0:1783071453.008349:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071453.008443:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692846080 00000100:00100000:1.0:1783071453.008455:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692846080 00000100:00100000:1.0:1783071453.008525:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 22 00000100:00100000:1.0:1783071453.008549:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+6:2405:x1869685692846080:12345-192.168.204.38@tcp:41:mkdir.0 00000004:00000024:1.0:1783071453.008612:0:10292:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1783071453.008712:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+6:2405:x1869685692846080:12345-192.168.204.38@tcp:41:mkdir.0 Request processed in 164us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071453.008720:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 22 00000100:00100000:2.0:1783071453.009130:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071453.010045:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692846464 00000100:00100000:3.0:1783071453.010055:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692846464 00000100:00100000:3.0:1783071453.010102:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 23 00000100:00100000:3.0:1783071453.010111:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+6:10512:x1869685692846464:12345-192.168.204.38@tcp:36:mkdir.0 00010000:00010000:3.0:1783071453.010163:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071453.010235:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b10966200/0x6b58994c2cbdbffa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98c92 expref: 6 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.010255:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8b13c4e000) 00010000:00010000:3.0:1783071453.010266:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783071453.010359:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9400/0x6b58994c2cbdc158 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.010394:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9400/0x6b58994c2cbdc158 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.010404:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9400/0x6b58994c2cbdc158 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.010432:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9200/0x6b58994c2cbdc15f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.010439:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9200/0x6b58994c2cbdc15f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.010446:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9200/0x6b58994c2cbdc15f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.011405:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdc166 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.011422:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdc166 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.011430:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdc166 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783071453.011447:0:6517:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000034bbd06b reply state 000000008a4ef53e transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdc166 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.011458:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdc166 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.011465:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f8a0179ff00) 00010000:00010000:3.0:1783071453.011473:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783071453.011477:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1783071453.011495:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1783071453.011504:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9400/0x6b58994c2cbdc158 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.011511:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9400/0x6b58994c2cbdc158 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.011518:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9400/0x6b58994c2cbdc158 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.011674:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b014b9400 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071453.011679:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9400/0x6b58994c2cbdc158 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.011688:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9400/0x6b58994c2cbdc158 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.011700:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8a0179fe00) 00010000:00010000:3.0:1783071453.011702:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071453.011705:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9400/0x6b58994c2cbdc158 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.012003:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9400/0x6b58994c2cbdc158 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783071453.012024:0:6517:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000034bbd06b reply state 000000008a4ef53e transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9200/0x6b58994c2cbdc15f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.012034:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9200/0x6b58994c2cbdc15f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.012053:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8f8a0179f200) 00010000:00010000:3.0:1783071453.012056:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783071453.012058:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1783071453.012168:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+7:10512:x1869685692846464:12345-192.168.204.38@tcp:36:mkdir.0 Request processed in 2054us (3036us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1783071453.014433:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 23 00000100:00100000:2.0:1783071453.021458:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071453.021694:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692846592 00000100:00100000:1.0:1783071453.021705:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692846592 00000100:00100000:1.0:1783071453.021966:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 24 00000100:00100000:1.0:1783071453.021979:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+7:10513:x1869685692846592:12345-192.168.204.38@tcp:101:chmod.0 00010000:00010000:1.0:1783071453.022004:0:10292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071453.022031:0:10292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdc16d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98d25 expref: -99 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071453.022168:0:10292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdc174 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071453.022182:0:10292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdc174 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071453.022194:0:10292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdc174 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783071453.022242:0:10292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1783071453.022246:0:10292:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783071453.022279:0:10292:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdc174 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071453.022303:0:10292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdc16d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d25 expref: 9 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071453.022337:0:10292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdc174 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d25 expref: 8 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071453.022345:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8b0a52ed00) 00010000:00010000:1.0:1783071453.022348:0:10292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783071453.022351:0:10292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a01749600, rc 0) 00000100:00100000:2.0:1783071453.023259:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+8:10513:x1869685692846592:12345-192.168.204.38@tcp:101:chmod.0 Request processed in 1280us (1807us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071453.023267:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 24 00000100:00100000:2.0:1783071453.028528:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071453.029210:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692846848 00000100:00100000:3.0:1783071453.029221:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692846848 00000100:00100000:3.0:1783071453.029284:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 25 00000100:00100000:3.0:1783071453.029295:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+8:10513:x1869685692846848:12345-192.168.204.38@tcp:36:chmod.0 00010000:00010000:3.0:1783071453.029352:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071453.029518:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdc174 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d25 expref: 8 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.029537:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8b0a52ed00) 00010000:00010000:3.0:1783071453.029549:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783071453.029739:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67e00/0x6b58994c2cbdc17b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071453.029753:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67e00/0x6b58994c2cbdc17b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071453.029763:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67e00/0x6b58994c2cbdc17b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783071453.030059:0:6517:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003ea8312b reply state 00000000b26c95db transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67e00/0x6b58994c2cbdc17b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071453.030072:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67e00/0x6b58994c2cbdc17b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071453.030079:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8b0d17f700) 00010000:00010000:2.0:1783071453.030082:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1783071453.030084:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1783071453.030092:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1783071453.030173:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+9:10513:x1869685692846848:12345-192.168.204.38@tcp:36:chmod.0 Request processed in 879us (1652us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1783071453.030180:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 25 00000100:00100000:0.0:1783071453.072155:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071453.077408:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692846976 00000100:00100000:2.0:1783071453.077439:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692846976 00000100:00100000:2.0:1783071453.077579:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 26 00000100:00100000:2.0:1783071453.077590:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3b4d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+9:10514:x1869685692846976:12345-192.168.204.38@tcp:101:chown.0 00010000:00010000:2.0:1783071453.077616:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071453.077638:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc182 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98d2c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071453.077724:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdc189 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071453.077738:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdc189 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071453.077750:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdc189 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071453.077801:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783071453.077805:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783071453.077849:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdc189 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071453.077880:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc182 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d2c expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071453.077899:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdc189 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d2c expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071453.077909:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8b0d17f700) 00010000:00010000:2.0:1783071453.077912:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783071453.077916:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b2fd67200, rc 0) 00000100:00100000:2.0:1783071453.077998:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3b4d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+10:10514:x1869685692846976:12345-192.168.204.38@tcp:101:chown.0 Request processed in 411us (5853us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071453.078005:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 26 00000100:00100000:3.0:1783071453.084090:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071453.084391:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692847104 00000100:00100000:0.0:1783071453.084400:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692847104 00000100:00100000:0.0:1783071453.084455:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 27 00000100:00100000:0.0:1783071453.084464:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a038b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+10:10514:x1869685692847104:12345-192.168.204.38@tcp:101:chown.0 00010000:00010000:0.0:1783071453.084483:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071453.084505:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864c00/0x6b58994c2cbdc190 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98d33 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.084564:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865400/0x6b58994c2cbdc197 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.084592:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865400/0x6b58994c2cbdc197 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.084604:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865400/0x6b58994c2cbdc197 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.084615:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864000/0x6b58994c2cbdc19e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.084622:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864000/0x6b58994c2cbdc19e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.084627:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864000/0x6b58994c2cbdc19e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.084733:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdc1a5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.084742:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdc1a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.084750:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdc1a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783071453.084984:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783071453.084988:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783071453.085018:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdc1a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.085035:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865400/0x6b58994c2cbdc197 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.085056:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865400/0x6b58994c2cbdc197 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.085063:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865400/0x6b58994c2cbdc197 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.085069:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03865400 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:0.0:1783071453.085074:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865400/0x6b58994c2cbdc197 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.085081:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865400/0x6b58994c2cbdc197 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.085093:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8b0d17f700) 00010000:00010000:0.0:1783071453.085097:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071453.085102:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865400/0x6b58994c2cbdc197 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.085108:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865400/0x6b58994c2cbdc197 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.085122:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864000/0x6b58994c2cbdc19e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.085129:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864000/0x6b58994c2cbdc19e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.085135:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864000/0x6b58994c2cbdc19e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.085140:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03864000 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:0.0:1783071453.085149:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864000/0x6b58994c2cbdc19e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.085155:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864000/0x6b58994c2cbdc19e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.085167:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8f8a0179f200) 00010000:00010000:0.0:1783071453.085170:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071453.085172:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864000/0x6b58994c2cbdc19e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.085177:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864000/0x6b58994c2cbdc19e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.085207:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864c00/0x6b58994c2cbdc190 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d33 expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.085220:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdc1a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d33 expref: 11 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.085359:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f8a0179ff00) 00010000:00010000:0.0:1783071453.085418:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783071453.085422:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a03865a00, rc 0) 00000100:00100000:0.0:1783071453.085480:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a038b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+11:10514:x1869685692847104:12345-192.168.204.38@tcp:101:chown.0 Request processed in 1017us (1398us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071453.085488:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 27 00000100:00100000:3.0:1783071453.092500:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071453.092622:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692847232 00000100:00100000:2.0:1783071453.092633:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692847232 00000100:00100000:2.0:1783071453.092710:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 6 00000100:00100000:2.0:1783071453.092721:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a038b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:bf7532e4-6153-424a-9f4e-84941256b41f+11:10514:x1869685692847232:12345-192.168.204.38@tcp:900:chown.0 00000100:00100000:2.0:1783071453.092822:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a038b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:bf7532e4-6153-424a-9f4e-84941256b41f+11:10514:x1869685692847232:12345-192.168.204.38@tcp:900:chown.0 Request processed in 102us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071453.092830:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 6 00000100:00100000:1.0:1783071453.103774:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071453.103874:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692847488 00000100:00100000:2.0:1783071453.103884:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692847488 00000100:00100000:2.0:1783071453.103949:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 28 00000100:00100000:2.0:1783071453.103959:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c79e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+11:10514:x1869685692847488:12345-192.168.204.38@tcp:36:chown.0 00010000:00010000:2.0:1783071453.104011:0:10292:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071453.104049:0:10292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdc1a5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d33 expref: 11 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071453.104070:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f8a0179ff00) 00010000:00010000:2.0:1783071453.104075:0:10292:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783071453.104098:0:10292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc1ac lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071453.104114:0:10292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc1ac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071453.104124:0:10292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc1ac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783071453.106516:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:3.0:1783071453.106639:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9200/0x6b58994c2cbdc15f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.106667:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9200/0x6b58994c2cbdc15f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.106676:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9200/0x6b58994c2cbdc15f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.106683:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b014b9200 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071453.106701:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9200/0x6b58994c2cbdc15f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.106711:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9200/0x6b58994c2cbdc15f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.106745:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8f8a0179f200) 00010000:00010000:3.0:1783071453.106749:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071453.106756:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9200/0x6b58994c2cbdc15f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783071453.106758:0:10292:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000440e9028 reply state 000000002454dba4 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc1ac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.106767:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9200/0x6b58994c2cbdc15f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071453.106806:0:10292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc1ac lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.106820:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdc166 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.106829:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdc166 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.106836:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdc166 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071453.106838:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f8a0179ff00) 00010000:00010000:1.0:1783071453.106852:0:10292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1783071453.106859:0:10292:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783071453.106863:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b014b9000 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071453.106869:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdc166 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783071453.106874:0:10292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1783071453.106877:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdc166 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.106890:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f8a0179ff00) 00010000:00010000:3.0:1783071453.106893:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071453.106904:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdc166 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.106912:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdc166 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.106931:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67e00/0x6b58994c2cbdc17b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.106939:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67e00/0x6b58994c2cbdc17b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.106946:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67e00/0x6b58994c2cbdc17b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.106952:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd67e00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071453.106958:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67e00/0x6b58994c2cbdc17b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.106964:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67e00/0x6b58994c2cbdc17b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.106975:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8b0d17f700) 00010000:00010000:3.0:1783071453.106978:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783071453.106981:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67e00/0x6b58994c2cbdc17b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.106987:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67e00/0x6b58994c2cbdc17b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1783071453.106989:0:10292:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1783071453.107017:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c79e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+7:10514:x1869685692847488:12345-192.168.204.38@tcp:36:chown.0 Request processed in 3054us (3248us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1783071453.107028:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 28 00010000:00010000:0.0:1783071453.107098:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc1ac lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.107110:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc1ac lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.107132:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc1ac lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.107140:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd67600 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:0.0:1783071453.107145:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc1ac lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.107154:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc1ac lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.107178:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f8a0179ff00) 00010000:00010000:0.0:1783071453.107182:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783071453.107187:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc1ac lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.107193:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc1ac lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071453.138071:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071453.140584:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692847616 00000100:00100000:1.0:1783071453.140606:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692847616 00000100:00100000:1.0:1783071453.140798:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 29 00000100:00100000:1.0:1783071453.140812:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+6:10515:x1869685692847616:12345-192.168.204.38@tcp:101:touch.500 00010000:00010000:1.0:1783071453.140850:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071453.140881:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749200/0x6b58994c2cbdc1b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98d3a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783071453.145593:0:6517:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 4619us 00010000:00010000:3.0:1783071453.172660:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdc1ba lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.172703:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdc1ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.172720:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdc1ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.172751:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9200/0x6b58994c2cbdc1c1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.172759:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9200/0x6b58994c2cbdc1c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.172765:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9200/0x6b58994c2cbdc1c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.172895:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9400/0x6b58994c2cbdc1c8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.172903:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9400/0x6b58994c2cbdc1c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.172910:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9400/0x6b58994c2cbdc1c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783071453.172946:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783071453.172951:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783071453.172996:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9400/0x6b58994c2cbdc1c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.173012:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdc1ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.173029:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdc1ba lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.173036:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdc1ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.173043:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b014b9000 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071453.173048:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdc1ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.173057:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdc1ba lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.173073:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8b0d17f700) 00010000:00010000:3.0:1783071453.173076:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071453.173081:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdc1ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.173088:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdc1ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.173102:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9200/0x6b58994c2cbdc1c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.173107:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9200/0x6b58994c2cbdc1c1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.173113:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9200/0x6b58994c2cbdc1c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.173117:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b014b9200 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071453.173126:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9200/0x6b58994c2cbdc1c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.173133:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9200/0x6b58994c2cbdc1c1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.173141:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8f8a021bdd00) 00010000:00010000:3.0:1783071453.173144:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071453.173146:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9200/0x6b58994c2cbdc1c1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.173152:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9200/0x6b58994c2cbdc1c1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.173201:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749200/0x6b58994c2cbdc1b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d3a expref: 8 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.173219:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9400/0x6b58994c2cbdc1c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d3a expref: 7 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.173227:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f8a021bd400) 00010000:00010000:3.0:1783071453.173229:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1783071453.173231:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b014b9400, rc 0) 00000100:00100000:3.0:1783071453.173335:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+7:10515:x1869685692847616:12345-192.168.204.38@tcp:101:touch.500 Request processed in 32525us (35277us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071453.173346:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 29 00000100:00100000:2.0:1783071453.177095:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071453.177230:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692847872 00000100:00100000:0.0:1783071453.177244:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692847872 00000100:00100000:0.0:1783071453.177407:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30 00000100:00100000:0.0:1783071453.177418:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+7:10515:x1869685692847872:12345-192.168.204.38@tcp:101:touch.500 00010000:00010000:0.0:1783071453.177445:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071453.177573:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864000/0x6b58994c2cbdc1cf lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98d41 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.177752:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865400/0x6b58994c2cbdc1d6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.177795:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865400/0x6b58994c2cbdc1d6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.177809:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865400/0x6b58994c2cbdc1d6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.181199:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865000/0x6b58994c2cbdc1dd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.181223:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865000/0x6b58994c2cbdc1dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.181237:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865000/0x6b58994c2cbdc1dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783071453.185592:0:6516:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:0.0:1783071453.187310:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864200/0x6b58994c2cbdc1e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.187332:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864200/0x6b58994c2cbdc1e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.187344:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864200/0x6b58994c2cbdc1e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.187396:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865400/0x6b58994c2cbdc1d6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.187403:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865400/0x6b58994c2cbdc1d6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.187411:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865400/0x6b58994c2cbdc1d6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.187428:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03865400 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:0.0:1783071453.187432:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865400/0x6b58994c2cbdc1d6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.187440:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865400/0x6b58994c2cbdc1d6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.187454:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f8a021bd400) 00010000:00010000:0.0:1783071453.187457:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071453.188768:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865400/0x6b58994c2cbdc1d6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.188790:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865400/0x6b58994c2cbdc1d6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783071453.188814:0:6516:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000864393cc reply state 00000000fd32cbbb transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865000/0x6b58994c2cbdc1dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.188829:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865000/0x6b58994c2cbdc1dd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.188838:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x8d0a4730 (ffff8f8b19837b00) 00010000:00010000:0.0:1783071453.188841:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783071453.188845:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1783071453.188904:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864000/0x6b58994c2cbdc1cf lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d41 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.188923:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864200/0x6b58994c2cbdc1e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d41 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.188950:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8f8b19837f00) 00010000:00010000:0.0:1783071453.188953:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783071453.188956:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a03864200, rc 0) 00000100:00100000:0.0:1783071453.189035:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+10:10515:x1869685692847872:12345-192.168.204.38@tcp:101:touch.500 Request processed in 11618us (11957us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1783071453.189044:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30 00000100:00100000:0.0:1783071453.193316:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071453.193476:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692848128 00000100:00100000:3.0:1783071453.193487:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692848128 00000100:00100000:3.0:1783071453.193548:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 31 00000100:00100000:3.0:1783071453.193560:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3b4da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+10:10515:x1869685692848128:12345-192.168.204.38@tcp:36:touch.500 00010000:00010000:3.0:1783071453.193854:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071453.193883:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864200/0x6b58994c2cbdc1e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d41 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.193904:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8f8b19837f00) 00010000:00010000:3.0:1783071453.193914:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783071453.193970:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9200/0x6b58994c2cbdc1f2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.193983:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9200/0x6b58994c2cbdc1f2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.193992:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9200/0x6b58994c2cbdc1f2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783071453.194090:0:6518:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c4be8f3b reply state 00000000d9ffaf97 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9200/0x6b58994c2cbdc1f2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.194102:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9200/0x6b58994c2cbdc1f2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.194108:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8f8a021bdd00) 00010000:00010000:3.0:1783071453.195050:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783071453.195054:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783071453.195164:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3b4da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+11:10515:x1869685692848128:12345-192.168.204.38@tcp:36:touch.500 Request processed in 1604us (1857us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1783071453.195173:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 31 00000100:00100000:2.0:1783071453.200824:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071453.200986:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692848256 00000100:00100000:1.0:1783071453.201002:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692848256 00000100:00100000:1.0:1783071453.201087:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 32 00000100:00100000:1.0:1783071453.201101:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+11:10515:x1869685692848256:12345-192.168.204.38@tcp:101:touch.500 00010000:00010000:1.0:1783071453.201136:0:10292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071453.201176:0:10292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749200/0x6b58994c2cbdc1f9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98d48 expref: -99 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071453.201257:0:10292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749200/0x6b58994c2cbdc1f9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d48 expref: 12 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071453.201274:0:10292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749200/0x6b58994c2cbdc1f9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d48 expref: 12 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071453.201299:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8f8a021bdd00) 00010000:00010000:1.0:1783071453.201304:0:10292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783071453.201308:0:10292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a01749200, rc 0) 00000100:00100000:1.0:1783071453.201422:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+12:10515:x1869685692848256:12345-192.168.204.38@tcp:101:touch.500 Request processed in 324us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071453.201431:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 32 00000100:00100000:2.0:1783071453.206296:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071453.206425:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692848384 00000100:00100000:0.0:1783071453.206437:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692848384 00000100:00100000:0.0:1783071453.206501:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 24 00000100:00100000:0.0:1783071453.206511:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2402:x1869685692848384:12345-192.168.204.38@tcp:8:touch.500 00010000:00080000:0.0:1783071453.206555:0:8432:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from bf7532e4-6153-424a-9f4e-84941256b41f@192.168.204.38@tcp t0 exp 0000000000000000 cur 354 last 0 00000020:00000080:0.0:1783071453.206601:0:8432:0:(genops.c:1406:class_connect()) connect: client bf7532e4-6153-424a-9f4e-84941256b41f, cookie 0x6b58994c2cbdc200 00002000:00100000:0.0:1783071453.206617:0:8432:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli bf7532e4-6153-424a-9f4e-84941256b41f/ffff8f8a038e1000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783071453.206640:0:8432:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783071453.206770:0:8432:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1783071453.206806:0:8432:0:(import.c:65:import_set_state_nolock()) ffff8f8a038e0000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783071453.206897:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf7532e4-6153-424a-9f4e-84941256b41f+6:2402:x1869685692848384:12345-192.168.204.38@tcp:8:touch.500 Request processed in 386us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071453.206905:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 24 00000100:00100000:0.0:1783071453.209683:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071453.209838:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692848512 00000100:00100000:3.0:1783071453.209851:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692848512 00000100:00100000:3.0:1783071453.209995:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 25 00000100:00100000:3.0:1783071453.210028:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b2fe7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf7532e4-6153-424a-9f4e-84941256b41f+6:0:x1869685692848512:12345-192.168.204.38@tcp:2:touch.500 00000100:00080000:1.0:1783071453.211870:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1783071453.228054:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:1.0:1783071453.228071:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bf7532e4-6153-424a-9f4e-84941256b41f 00000100:00100000:0.0:1783071453.228418:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b2fe7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf7532e4-6153-424a-9f4e-84941256b41f+5:0:x1869685692848512:12345-192.168.204.38@tcp:2:touch.500 Request processed in 18385us (18742us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1783071453.228433:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 25 00000100:00100000:3.0:1783071453.233247:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071453.233343:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692848768 00000100:00100000:2.0:1783071453.233360:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692848768 00000100:00100000:2.0:1783071453.233490:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2 00000100:00100000:2.0:1783071453.233504:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a038bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+12:10515:x1869685692848768:12345-192.168.204.38@tcp:35:touch.500 00000100:00100000:2.0:1783071453.233945:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a038bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+13:10515:x1869685692848768:12345-192.168.204.38@tcp:35:touch.500 Request processed in 443us (706us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1783071453.233956:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2 00000100:00100000:2.0:1783071453.252647:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071453.252860:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692848896 00000100:00100000:1.0:1783071453.252881:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692848896 00000100:00100000:1.0:1783071453.252957:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 33 00000100:00100000:1.0:1783071453.252996:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+13:10516:x1869685692848896:12345-192.168.204.38@tcp:101:rm.0 00010000:00010000:1.0:1783071453.253033:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071453.253061:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdc207 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98d4f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071453.253152:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748a00/0x6b58994c2cbdc20e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071453.253171:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748a00/0x6b58994c2cbdc20e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071453.253336:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748a00/0x6b58994c2cbdc20e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071453.253640:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783071453.253645:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783071453.253706:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748a00/0x6b58994c2cbdc20e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071453.253851:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdc207 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d4f expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071453.253875:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748a00/0x6b58994c2cbdc20e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d4f expref: 14 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071453.253885:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f8a021bd400) 00010000:00010000:2.0:1783071453.253888:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783071453.253902:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a01748a00, rc 0) 00000100:00100000:2.0:1783071453.253994:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+14:10516:x1869685692848896:12345-192.168.204.38@tcp:101:rm.0 Request processed in 1003us (1361us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071453.254002:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 33 00000100:00100000:2.0:1783071453.260754:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071453.260844:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692849152 00000100:00100000:0.0:1783071453.260859:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692849152 00000100:00100000:0.0:1783071453.260944:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 34 00000100:00100000:0.0:1783071453.260957:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+14:10516:x1869685692849152:12345-192.168.204.38@tcp:101:rm.0 00010000:00010000:0.0:1783071453.260991:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071453.261021:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865400/0x6b58994c2cbdc215 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98d56 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783071453.261180:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1783071453.261424:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865400/0x6b58994c2cbdc215 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d56 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.261444:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8b0d17f700) 00010000:00010000:0.0:1783071453.261447:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783071453.261454:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865400/0x6b58994c2cbdc215 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d56 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.261470:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a03865400, rc 0) 00000100:00100000:0.0:1783071453.262857:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+15:10516:x1869685692849152:12345-192.168.204.38@tcp:101:rm.0 Request processed in 1771us (1987us total) trans 4294967305 rc 301/301 00000100:00100000:0.0:1783071453.262882:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 34 00000100:00100000:2.0:1783071453.272532:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071453.272657:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692849280 00000100:00100000:0.0:1783071453.272670:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692849280 00000100:00100000:0.0:1783071453.272743:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3 00000100:00100000:0.0:1783071453.272754:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+15:10516:x1869685692849280:12345-192.168.204.38@tcp:37:rm.0 00000100:00100000:0.0:1783071453.278825:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+15:10516:x1869685692849280:12345-192.168.204.38@tcp:37:rm.0 Request processed in 6053us (6289us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071453.278860:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3 00000100:00100000:3.0:1783071453.291306:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071453.291833:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692849536 00000100:00100000:2.0:1783071453.291848:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692849536 00000100:00100000:2.0:1783071453.291940:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 4 00000100:00100000:2.0:1783071453.291956:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b41961450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+15:10516:x1869685692849536:12345-192.168.204.38@tcp:35:rm.0 00000100:00100000:2.0:1783071453.292473:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b41961450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+16:10516:x1869685692849536:12345-192.168.204.38@tcp:35:rm.0 Request processed in 520us (1181us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1783071453.292483:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 4 00000100:00100000:2.0:1783071453.303319:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071453.304153:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692849792 00000100:00100000:3.0:1783071453.304167:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692849792 00000100:00100000:3.0:1783071453.304252:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 35 00000100:00100000:3.0:1783071453.304265:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+16:10516:x1869685692849792:12345-192.168.204.38@tcp:101:rm.0 00010000:00010000:3.0:1783071453.304302:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071453.304330:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdc223 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98d5d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.305263:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdc22a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.305286:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdc22a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.305301:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdc22a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783071453.305315:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1783071453.307394:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdc223 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d5d expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.307440:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdc22a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d5d expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.307451:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f8a021bd400) 00010000:00010000:3.0:1783071453.307471:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783071453.307475:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b014b8c00, rc 0) 00000100:00100000:3.0:1783071453.307582:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+18:10516:x1869685692849792:12345-192.168.204.38@tcp:101:rm.0 Request processed in 3318us (4279us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1783071453.307594:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 35 00000100:00100000:1.0:1783071453.319487:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071453.319557:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692849920 00000100:00100000:3.0:1783071453.319571:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692849920 00000100:00100000:3.0:1783071453.319664:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 36 00000100:00100000:3.0:1783071453.319676:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c79c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+18:10516:x1869685692849920:12345-192.168.204.38@tcp:41:rm.0 00000004:00000024:3.0:1783071453.319764:0:10292:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:3.0:1783071453.320046:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c79c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+18:10516:x1869685692849920:12345-192.168.204.38@tcp:41:rm.0 Request processed in 370us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071453.320055:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 36 00000100:00100000:2.0:1783071453.328293:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071453.328410:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692850048 00000100:00100000:3.0:1783071453.328424:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692850048 00000100:00100000:3.0:1783071453.328563:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 37 00000100:00100000:3.0:1783071453.328577:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+18:10516:x1869685692850048:12345-192.168.204.38@tcp:101:rm.0 00010000:00010000:3.0:1783071453.328607:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071453.328637:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdc238 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98d64 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.328746:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9e00/0x6b58994c2cbdc23f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.328764:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9e00/0x6b58994c2cbdc23f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.328777:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9e00/0x6b58994c2cbdc23f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.328880:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdc246 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.328890:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdc246 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.328897:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdc246 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.329013:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9600/0x6b58994c2cbdc24d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.329022:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9600/0x6b58994c2cbdc24d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.329029:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9600/0x6b58994c2cbdc24d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783071453.329077:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:3.0:1783071453.329082:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783071453.329104:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9600/0x6b58994c2cbdc24d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.329117:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9600/0x6b58994c2cbdc24d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.329127:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9e00/0x6b58994c2cbdc23f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.329133:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9e00/0x6b58994c2cbdc23f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.329151:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9e00/0x6b58994c2cbdc23f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.329158:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b014b9e00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071453.329163:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9e00/0x6b58994c2cbdc23f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.329171:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9e00/0x6b58994c2cbdc23f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.329187:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f8a021bd400) 00010000:00010000:3.0:1783071453.329190:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071453.329197:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9e00/0x6b58994c2cbdc23f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.329204:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9e00/0x6b58994c2cbdc23f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.329222:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdc246 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.329229:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdc246 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.329235:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdc246 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.329240:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b014b8600 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071453.329243:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdc246 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.329260:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdc246 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.329269:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x8d0a4730 (ffff8f8b19837b00) 00010000:00010000:3.0:1783071453.329271:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071453.329274:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdc246 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.329280:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdc246 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.329314:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdc238 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d64 expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.329329:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9600/0x6b58994c2cbdc24d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d64 expref: 19 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071453.329336:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8f8a021bdd00) 00010000:00010000:3.0:1783071453.329338:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783071453.329341:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b014b9600, rc 0) 00000100:00100000:2.0:1783071453.330454:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+19:10516:x1869685692850048:12345-192.168.204.38@tcp:101:rm.0 Request processed in 1869us (2166us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071453.330466:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 37 00000100:00100000:2.0:1783071453.337715:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071453.337943:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692850304 00000100:00100000:0.0:1783071453.337968:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692850304 00000100:00100000:0.0:1783071453.338057:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 38 00000100:00100000:0.0:1783071453.338068:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+19:10516:x1869685692850304:12345-192.168.204.38@tcp:36:rm.0 00010000:00010000:0.0:1783071453.338146:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1783071453.338198:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9600/0x6b58994c2cbdc24d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d64 expref: 19 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.338227:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749200/0x6b58994c2cbdc1f9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d48 expref: 18 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.338240:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8f8a021bdd00) 00010000:00010000:0.0:1783071453.338252:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748a00/0x6b58994c2cbdc20e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d4f expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.338261:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f8a021bd400) 00010000:00010000:0.0:1783071453.338265:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783071453.338293:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865400/0x6b58994c2cbdc254 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.338308:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865400/0x6b58994c2cbdc254 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.338318:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865400/0x6b58994c2cbdc254 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.338329:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865800/0x6b58994c2cbdc25b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.338355:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865800/0x6b58994c2cbdc25b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.338567:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865800/0x6b58994c2cbdc25b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.338708:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864400/0x6b58994c2cbdc262 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.338717:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864400/0x6b58994c2cbdc262 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.338724:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864400/0x6b58994c2cbdc262 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783071453.339098:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1783071453.339111:0:6516:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 355127745606ns, next at 356127742498ns, rc = 0 00010000:00010000:0.0:1783071453.339184:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdc269 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.339195:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdc269 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.339203:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdc269 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.339212:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdc269 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.339219:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdc269 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.339240:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdc269 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.339265:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783071453.339290:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864400/0x6b58994c2cbdc262 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.339298:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864400/0x6b58994c2cbdc262 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.339305:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864400/0x6b58994c2cbdc262 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.339312:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03864400 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:0.0:1783071453.339317:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864400/0x6b58994c2cbdc262 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.339325:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864400/0x6b58994c2cbdc262 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.339337:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8f8a021bdd00) 00010000:00010000:0.0:1783071453.339340:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1783071453.339345:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864400/0x6b58994c2cbdc262 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.339352:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864400/0x6b58994c2cbdc262 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.339400:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865400/0x6b58994c2cbdc254 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.339407:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865400/0x6b58994c2cbdc254 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.339418:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865400/0x6b58994c2cbdc254 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.339424:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03865400 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:0.0:1783071453.339427:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865400/0x6b58994c2cbdc254 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.339434:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865400/0x6b58994c2cbdc254 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.339443:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f8a021bd400) 00010000:00010000:0.0:1783071453.339445:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071453.339448:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865400/0x6b58994c2cbdc254 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.339453:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865400/0x6b58994c2cbdc254 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783071453.339464:0:6516:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007480c09a reply state 00000000c83949a5 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865800/0x6b58994c2cbdc25b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.339477:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865800/0x6b58994c2cbdc25b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.339483:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x8d0a4730 (ffff8f8b19837b00) 00010000:00010000:0.0:1783071453.339486:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783071453.339489:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783071453.339591:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+18:10516:x1869685692850304:12345-192.168.204.38@tcp:36:rm.0 Request processed in 1520us (1887us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1783071453.339602:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 38 00010000:00010000:2.0:1783071453.339994:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783071453.340002:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdc269 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071453.340010:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03864e00 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:2.0:1783071453.340014:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdc269 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071453.340023:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdc269 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071453.340044:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8f8a021bdd00) 00010000:00010000:2.0:1783071453.340046:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1783071453.340050:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdc269 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071453.340056:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdc269 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071453.340070:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071453.340072:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071453.340074:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071453.344542:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071453.344678:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692850560 00000100:00100000:2.0:1783071453.344694:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692850560 00000100:00100000:2.0:1783071453.344766:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 5 00000100:00100000:2.0:1783071453.344777:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a038bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+18:10516:x1869685692850560:12345-192.168.204.38@tcp:35:rm.0 00000100:00100000:2.0:1783071453.345091:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a038bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+19:10516:x1869685692850560:12345-192.168.204.38@tcp:35:rm.0 Request processed in 316us (563us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1783071453.345100:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 5 00000100:00100000:2.0:1783071453.349527:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071453.349669:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692850816 00000100:00100000:0.0:1783071453.349683:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692850816 00000100:00100000:0.0:1783071453.349772:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 39 00000100:00100000:0.0:1783071453.349786:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+19:10516:x1869685692850816:12345-192.168.204.38@tcp:36:rm.0 00010000:00010000:0.0:1783071453.349883:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1783071453.349922:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdc22a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d5d expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.349949:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9400/0x6b58994c2cbdc1c8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d3a expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.349963:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f8a021bd400) 00010000:00010000:0.0:1783071453.349982:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdc189 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d2c expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.349992:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8b0d17f700) 00010000:00010000:0.0:1783071453.349999:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783071453.350033:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864000/0x6b58994c2cbdc270 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.350050:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864000/0x6b58994c2cbdc270 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.350061:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864000/0x6b58994c2cbdc270 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.350076:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864200/0x6b58994c2cbdc277 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.350084:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864200/0x6b58994c2cbdc277 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.350110:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864200/0x6b58994c2cbdc277 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.350931:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864c00/0x6b58994c2cbdc27e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.350953:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864c00/0x6b58994c2cbdc27e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.350962:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864c00/0x6b58994c2cbdc27e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783071453.352098:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1783071453.352125:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864c00/0x6b58994c2cbdc27e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.352134:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864c00/0x6b58994c2cbdc27e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.352142:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864c00/0x6b58994c2cbdc27e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.352149:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03864c00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:0.0:1783071453.352154:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864c00/0x6b58994c2cbdc27e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.352174:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864c00/0x6b58994c2cbdc27e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.352190:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f8b19837900) 00010000:00010000:0.0:1783071453.352194:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1783071453.352214:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864c00/0x6b58994c2cbdc27e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.352222:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864c00/0x6b58994c2cbdc27e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.352249:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864000/0x6b58994c2cbdc270 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.352256:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864000/0x6b58994c2cbdc270 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.352262:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864000/0x6b58994c2cbdc270 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.352267:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03864000 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:0.0:1783071453.352270:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864000/0x6b58994c2cbdc270 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.352276:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864000/0x6b58994c2cbdc270 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.352284:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8b19837f00) 00010000:00010000:0.0:1783071453.352286:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071453.352289:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864000/0x6b58994c2cbdc270 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.352295:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864000/0x6b58994c2cbdc270 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783071453.352307:0:6518:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002b5bf1ef reply state 00000000ff8cd5de transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864200/0x6b58994c2cbdc277 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.352334:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864200/0x6b58994c2cbdc277 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071453.352341:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8f8b19837000) 00010000:00010000:0.0:1783071453.352343:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783071453.352346:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783071453.352496:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+18:10516:x1869685692850816:12345-192.168.204.38@tcp:36:rm.0 Request processed in 2708us (2986us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1783071453.352507:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 39 00010000:00010000:1.0:1783071453.442717:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071454.020132:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783071454.020168:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02e41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707609216:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783071454.020267:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071454.020353:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707609216 00000100:00100000:3.0:1783071454.020407:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707609216 00000100:00100000:2.0:1783071454.020632:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1783071454.020654:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02e40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707609216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783071454.020890:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1783071454.020966:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02e40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707609216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 313us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071454.020989:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1783071454.021323:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02e41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707609216:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783071454.021400:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3b4d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:feaa1501-b927-4e07-baad-3200e92d7497:3648:1869685707609344:0@lo:400:kworker.0 00000100:00100000:3.0:1783071454.021481:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071454.021519:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3b4dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869685707609472:0@lo:400:kworker.0 00000100:00100000:3.0:1783071454.021545:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3b4daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1869685707609856:0@lo:400:kworker.0 00000100:00100000:0.0:1783071454.021572:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071454.021609:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b078daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1869685707609984:0@lo:400:kworker.0 00000100:00100000:3.0:1783071454.021619:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071454.021680:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0380b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1869685707610368:0@lo:400:kworker.0 00000100:00100000:2.0:1783071454.021699:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3b4d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707609728:0@lo:400:kworker.0 00000100:00100000:3.0:1783071454.021714:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071454.021760:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071454.021771:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707609472 00000100:00100000:3.0:1783071454.021779:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707609472 00000100:00100000:2.0:1783071454.021794:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03808e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707610240:0@lo:400:kworker.0 00000100:00100000:2.0:1783071454.021822:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071454.021829:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707609856 00000100:00100000:3.0:1783071454.021835:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707609856 00000100:00100000:2.0:1783071454.021850:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b08873480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707610752:0@lo:400:kworker.0 00000100:00100000:3.0:1783071454.021882:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707610368 00000100:00100000:2.0:1783071454.021890:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071454.021891:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707610368 00000100:00100000:3.0:1783071454.021926:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1783071454.021941:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b08872d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1869685707609472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071454.021944:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707610240 00000100:00100000:2.0:1783071454.021954:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707610240 00000100:00100000:2.0:1783071454.021993:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707610752 00000100:00100000:2.0:1783071454.021997:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707610752 00000100:00100000:2.0:1783071454.022018:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1783071454.022026:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02e41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707610240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071454.022070:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02e41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707610240:12345-0@lo:400:kworker.0 Request processed in 45us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071454.022077:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1783071454.022091:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1783071454.022097:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02e43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707610752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071454.022123:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02e43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707610752:12345-0@lo:400:kworker.0 Request processed in 27us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071454.022129:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:2.0:1783071454.022166:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a03808e00 x1869685707610240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071454.022179:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03808e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707610240:0@lo:400:kworker.0 00010000:00080000:2.0:1783071454.022190:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b08873480 x1869685707610752/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071454.022209:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b08873480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707610752:0@lo:400:kworker.0 00000100:00100000:2.0:1783071454.022264:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1783071454.022274:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a038baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869685707609856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071454.022318:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a038baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869685707609856:12345-0@lo:400:kworker.0 Request processed in 46us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071454.022325:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1783071454.022342:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1783071454.022349:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a038bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869685707610368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071454.022946:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a038bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869685707610368:12345-0@lo:400:kworker.0 Request processed in 595us (1230us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071454.022955:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00080000:2.0:1783071454.022995:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783071454.023001:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783071454.023004:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783071454.023037:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0380b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1869685707610368:0@lo:400:kworker.0 00000100:00100000:2.0:1783071454.023050:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3b4daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1869685707609856:0@lo:400:kworker.0 00000100:00100000:2.0:1783071454.023106:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707609344 00000100:00100000:2.0:1783071454.023112:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707609344 00000100:00100000:2.0:1783071454.023150:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1783071454.023156:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+24:3648:x1869685707609344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071454.023198:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+24:3648:x1869685707609344:12345-0@lo:400:kworker.0 Request processed in 42us (1722us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071454.023205:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1783071454.023244:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3b4dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869685707609600:0@lo:400:kworker.0 00000100:00100000:2.0:1783071454.023290:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071454.023312:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03808700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707610112:0@lo:400:kworker.0 00000100:00100000:2.0:1783071454.023337:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071454.023357:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03808a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707610624:0@lo:400:kworker.0 00000100:00100000:2.0:1783071454.023407:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071454.023447:0:8910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707610112 00000100:00100000:2.0:1783071454.023451:0:8910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707610112 00000100:00100000:2.0:1783071454.023479:0:8910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707610624 00000100:00100000:2.0:1783071454.023482:0:8910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707610624 00000100:00100000:2.0:1783071454.023502:0:8910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1783071454.023508:0:8910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3b4daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707610112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071454.023547:0:8910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3b4daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707610112:12345-0@lo:400:kworker.0 Request processed in 40us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071454.023553:0:8910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1783071454.023563:0:8910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1783071454.023569:0:8910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0380b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707610624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071454.023596:0:8910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0380b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707610624:12345-0@lo:400:kworker.0 Request processed in 27us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071454.023602:0:8910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:2.0:1783071454.023614:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783071454.023616:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783071454.023646:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a03808700 x1869685707610112/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071454.023657:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03808700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707610112:0@lo:400:kworker.0 00010000:00080000:2.0:1783071454.023668:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a03808a80 x1869685707610624/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071454.023688:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03808a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707610624:0@lo:400:kworker.0 00000100:00100000:2.0:1783071454.023791:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3b4d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:feaa1501-b927-4e07-baad-3200e92d7497:3648:1869685707609344:0@lo:400:kworker.0 00000100:00100000:2.0:1783071454.023813:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707609600 00000100:00100000:2.0:1783071454.023816:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707609600 00000100:00100000:2.0:1783071454.023836:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1783071454.023842:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02e41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869685707609600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071454.023878:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02e41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869685707609600:12345-0@lo:400:kworker.0 Request processed in 37us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071454.023884:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1783071454.023907:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3b4dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869685707609600:0@lo:400:kworker.0 00000100:00100000:0.0:1783071454.023944:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071454.023981:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03809180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1869685707610496:0@lo:400:kworker.0 00000100:00100000:0.0:1783071454.024018:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071454.024067:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707609728 00000100:00100000:0.0:1783071454.024072:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707609728 00000100:00100000:2.0:1783071454.024079:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b08872d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1869685707609472:12345-0@lo:400:kworker.0 Request processed in 2143us (2507us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071454.024087:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1783071454.024106:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707609984 00000100:00100000:2.0:1783071454.024110:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707609984 00000100:00100000:0.0:1783071454.024114:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1783071454.024124:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02e40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707609728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071454.024138:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707610496 00000100:00100000:2.0:1783071454.024143:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707610496 00000100:00100000:2.0:1783071454.024163:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1783071454.024172:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b08870000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1869685707609984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071454.024215:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b08870000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1869685707609984:12345-0@lo:400:kworker.0 Request processed in 42us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071454.024225:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1783071454.024241:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1783071454.024246:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b08871c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1869685707610496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071454.024286:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b08871c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1869685707610496:12345-0@lo:400:kworker.0 Request processed in 40us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071454.024292:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00080000:2.0:1783071454.024309:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783071454.024434:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3b4d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707609728:0@lo:400:kworker.0 00000100:00100000:0.0:1783071454.024891:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02e40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707609728:12345-0@lo:400:kworker.0 Request processed in 766us (3129us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071454.024900:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1783071454.024946:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3b4dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869685707609472:0@lo:400:kworker.0 00010000:00080000:0.0:1783071454.024961:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b078daa00 x1869685707609984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071454.024987:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b078daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1869685707609984:0@lo:400:kworker.0 00010000:00080000:0.0:1783071454.025003:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a03809180 x1869685707610496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071454.025012:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03809180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1869685707610496:0@lo:400:kworker.0 00010000:00010000:2.0:1783071454.467490:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071454.530646:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b08873480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707610880:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783071454.530698:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c79f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707611008:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783071454.530763:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071454.530810:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071454.530898:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707610880 00000100:00100000:1.0:1783071454.530909:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707610880 00000100:00100000:1.0:1783071454.530967:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707611008 00000100:00100000:1.0:1783071454.530970:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707611008 00000100:00100000:1.0:1783071454.530990:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1783071454.531001:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b078daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707610880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783071454.531043:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783071454.531099:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b078daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707610880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071454.531107:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1783071454.531128:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1783071454.531134:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03808a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707611008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783071454.531150:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783071454.531198:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03808a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707611008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071454.531204:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000004:00080000:3.0:1783071454.531961:0:8909:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 356320595214ns, next at 357320592000ns, rc = 0 00000100:00100000:3.0:1783071454.532014:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a038ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707611136:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783071454.532061:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071454.532106:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a038bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707611264:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783071454.532133:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1783071454.532635:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c79f480 x1869685707611008/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071470 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1783071454.532794:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b08873480 x1869685707610880/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071470 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071454.532819:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b08873480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707610880:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783071454.532868:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707611136 00000100:00100000:2.0:1783071454.532871:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c79f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707611008:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783071454.532878:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707611136 00000100:00100000:2.0:1783071454.532904:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707611264 00000100:00100000:2.0:1783071454.532909:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707611264 00000100:00100000:1.0:1783071454.532926:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1783071454.532938:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a038bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707611136:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783071454.532943:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1783071454.532955:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a038bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707611264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783071454.532970:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783071454.533043:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a038bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707611136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (981us total) trans 0 rc 0/0 00002000:00000024:2.0:1783071454.533045:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783071454.533056:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00080000:3.0:1783071454.533119:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a038ba300 x1869685707611136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071470 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071454.533134:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a038ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707611136:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783071454.534167:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a038bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707611264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1194us (2013us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071454.534199:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:0.0:1783071454.535728:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a038bbb80 x1869685707611264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071470 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071454.535763:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a038bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707611264:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783071455.490646:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071455.555290:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783071455.555323:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b08873480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707611392:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783071455.556552:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071455.556672:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707611392 00000100:00100000:2.0:1783071455.556686:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707611392 00000100:00100000:2.0:1783071455.556775:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1783071455.556788:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03907800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707611392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783071455.556848:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783071455.556939:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03907800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707611392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 154us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071455.556948:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1783071455.557025:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b08873480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707611392:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1783071456.514784:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783071457.312684:0:13679:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:2.0:1783071457.538750:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071457.559234:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071457.559284:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071457.559314:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071457.559342:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071457.559403:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071457.559436:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071457.559471:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692851200 00000100:00100000:3.0:1783071457.559495:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692851200 00000100:00100000:3.0:1783071457.559559:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692851456 00000100:00100000:3.0:1783071457.559563:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692851456 00000100:00100000:3.0:1783071457.559588:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692851072 00000100:00100000:3.0:1783071457.559592:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692851072 00000100:00100000:3.0:1783071457.559606:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692851584 00000100:00100000:3.0:1783071457.559609:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692851584 00000100:00100000:3.0:1783071457.559626:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 198 00000100:00100000:3.0:1783071457.559637:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a038ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+5:2405:x1869685692851200:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1783071457.559737:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a038ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+5:2405:x1869685692851200:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 101us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071457.559746:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 198 00000100:00100000:3.0:1783071457.559766:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 199 00000100:00100000:3.0:1783071457.559774:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a038b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2405:x1869685692851456:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1783071457.559802:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a038b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2405:x1869685692851456:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 29us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071457.559808:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 199 00000100:00100000:3.0:1783071457.559821:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 200 00000100:00100000:3.0:1783071457.559827:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a038bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+18:2405:x1869685692851072:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1783071457.559967:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692850944 00000100:00100000:0.0:1783071457.559973:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692850944 00000100:00100000:0.0:1783071457.560011:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 334 00000100:00100000:0.0:1783071457.560018:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:2405:x1869685692850944:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1783071457.560046:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:2405:x1869685692850944:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 29us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071457.560064:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 334 00000100:00100000:0.0:1783071457.560126:0:8910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692851328 00000100:00100000:0.0:1783071457.560131:0:8910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692851328 00000100:00100000:0.0:1783071457.560163:0:8910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 96 00000100:00100000:0.0:1783071457.560170:0:8910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03332300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf7532e4-6153-424a-9f4e-84941256b41f+5:2405:x1869685692851328:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1783071457.560198:0:8910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03332300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf7532e4-6153-424a-9f4e-84941256b41f+5:2405:x1869685692851328:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 29us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071457.560205:0:8910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 96 00000100:00100000:0.0:1783071457.560224:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 201 00000100:00100000:0.0:1783071457.560231:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03333b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2405:x1869685692851584:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1783071457.560255:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03333b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2405:x1869685692851584:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 25us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071457.560261:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 201 00000100:00080000:0.0:1783071457.560302:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783071457.560308:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783071457.560310:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783071457.560559:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a038bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+18:2405:x1869685692851072:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 730us (1214us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071457.560566:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 200 00000020:00000080:3.0:1783071458.440353:0:13728:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffa0be5820 20000000:00000080:3.0:1783071458.440793:0:13728:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f8b3c662000 uarg=0000000000000000 20000000:01000000:3.0:1783071458.440847:0:13728:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1783071458.440854:0:13728:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1783071458.440867:0:13728:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1783071458.441511:0:13729:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1783071458.441758:0:13728:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1783071458.447889:0:13728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000004:00080000:3.0:1783071458.458704:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:3.0:1783071458.458753:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:3.0:1783071458.458766:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:3.0:1783071458.458799:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865000/0x6b58994c2cbdc1dd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071458.458811:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865000/0x6b58994c2cbdc1dd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071458.458819:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865000/0x6b58994c2cbdc1dd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071458.458825:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03865000 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071458.458829:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865000/0x6b58994c2cbdc1dd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071458.458837:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865000/0x6b58994c2cbdc1dd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071458.458858:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x8d0a4730 (ffff8f8b19837b00) 00010000:00010000:3.0:1783071458.458861:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071458.458865:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865000/0x6b58994c2cbdc1dd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071458.458871:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865000/0x6b58994c2cbdc1dd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071458.458879:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03904e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707611520:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1783071458.458891:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9200/0x6b58994c2cbdc1f2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071458.458897:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9200/0x6b58994c2cbdc1f2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071458.458915:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9200/0x6b58994c2cbdc1f2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071458.458920:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b014b9200 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071458.458922:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9200/0x6b58994c2cbdc1f2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071458.458928:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9200/0x6b58994c2cbdc1f2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071458.458935:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8f8a021bdd00) 00010000:00010000:3.0:1783071458.458937:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071458.458940:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9200/0x6b58994c2cbdc1f2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071458.458945:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9200/0x6b58994c2cbdc1f2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071458.458965:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865800/0x6b58994c2cbdc25b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071458.458972:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783071458.458983:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865800/0x6b58994c2cbdc25b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071458.458988:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865800/0x6b58994c2cbdc25b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071458.458993:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03865800 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071458.458996:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865800/0x6b58994c2cbdc25b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071458.459010:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865800/0x6b58994c2cbdc25b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071458.459018:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x8d0a4730 (ffff8f8b19837b00) 00010000:00010000:3.0:1783071458.459020:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071458.459023:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865800/0x6b58994c2cbdc25b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071458.459028:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865800/0x6b58994c2cbdc25b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x8d0a4730 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071458.459042:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864200/0x6b58994c2cbdc277 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071458.459047:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864200/0x6b58994c2cbdc277 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071458.459050:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707611520 00010000:00010000:3.0:1783071458.459052:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864200/0x6b58994c2cbdc277 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071458.459057:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03864200 already unused, calling callback (ffffffffc17944f0) 00000100:00100000:0.0:1783071458.459057:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707611520 00010000:00010000:3.0:1783071458.459059:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864200/0x6b58994c2cbdc277 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071458.459065:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864200/0x6b58994c2cbdc277 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071458.459071:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8f8b19837000) 00010000:00010000:3.0:1783071458.459074:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071458.459077:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864200/0x6b58994c2cbdc277 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071458.459087:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864200/0x6b58994c2cbdc277 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071458.459110:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783071458.459120:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03905880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707611520:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1783071458.459148:0:8431:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:0.0:1783071458.459181:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a4782dd, atime: 0x6a4782dd, ctime: 0x6a4782dd, blocks: 0x0 00010000:00010000:0.0:1783071458.459195:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ded28641/0x6b58994c2cbdc285 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071458.459210:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=360s v=(0 0) 00010000:00010000:0.0:1783071458.459214:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071458.459222:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ded28641/0x6b58994c2cbdc285 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071458.459238:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ded28641/0x6b58994c2cbdc285 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071458.459247:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ded28641/0x6b58994c2cbdc285 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071458.459255:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ded28641/0x6b58994c2cbdc285 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071458.459276:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783071458.459357:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783071458.459396:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ded28641/0x6b58994c2cbdc285 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071458.459404:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03864c00 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:3.0:1783071458.459408:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ded28641/0x6b58994c2cbdc285 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071458.459415:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ded28641/0x6b58994c2cbdc285 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071458.459428:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ded28641/0x6b58994c2cbdc285 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071458.459435:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ded28641/0x6b58994c2cbdc285 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071458.459449:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071458.459451:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071458.459453:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071458.459463:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03905880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1869685707611520:12345-0@lo:6:osp-syn-0-0.0 Request processed in 344us (491us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1783071458.459471:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1783071458.459490:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1783071458.459525:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f8a03904e00/2, rc 0, transno 4294967301 00000100:00100000:0.0:1783071458.459530:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03904e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707611520:0@lo:6:osp-syn-0-0.0 00000040:00080000:3.0:1783071458.464770:0:13728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1783071458.464836:0:13728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1783071458.464859:0:13728:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1783071458.464883:0:13728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f8b014b8000/0x6b58994c2cbdc28c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071458.464923:0:13728:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8b00030c00/0x6b58994c2cbdc112 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d17 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071458.464932:0:13728:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8b00031a00/0x6b58994c2cbdc119 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d1e expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071458.464942:0:13728:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8b00031600/0x6b58994c2cbdc127 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdc120 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071458.464949:0:13728:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8b2fd67800/0x6b58994c2cbdc135 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdc12e expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071458.464956:0:13728:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8b014b8800/0x6b58994c2cbdc143 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdc13c expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071458.464963:0:13728:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8b00030800/0x6b58994c2cbdc151 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdc14a expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071458.464971:0:13728:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f8b014b8000/0x6b58994c2cbdc28c lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071458.465079:0:13728:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8b00030800/0x6b58994c2cbdc151 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6b58994c2cbdc14a expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071458.465094:0:13728:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8b00030800/0x6b58994c2cbdc151 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6b58994c2cbdc14a expref: 23 pid: 6511 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071458.465109:0:13728:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03331c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13728:1869685707611648:0@lo:104: 00000100:00100000:3.0:1783071458.465304:0:13728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071458.465617:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:3.0:1783071458.465783:0:13728:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8b014b8800/0x6b58994c2cbdc143 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6b58994c2cbdc13c expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071458.465793:0:13728:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8b014b8800/0x6b58994c2cbdc143 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6b58994c2cbdc13c expref: 23 pid: 6508 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071458.465804:0:13728:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03332a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13728:1869685707611776:0@lo:104: 00010000:00010000:3.0:1783071458.465847:0:13728:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8b2fd67800/0x6b58994c2cbdc135 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6b58994c2cbdc12e expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071458.465855:0:13728:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8b2fd67800/0x6b58994c2cbdc135 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6b58994c2cbdc12e expref: 23 pid: 6508 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071458.465863:0:13728:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03332d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13728:1869685707611904:0@lo:104: 00010000:00010000:3.0:1783071458.465889:0:13728:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8b00031600/0x6b58994c2cbdc127 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6b58994c2cbdc120 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071458.465896:0:13728:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8b00031600/0x6b58994c2cbdc127 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6b58994c2cbdc120 expref: 23 pid: 6511 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071458.465904:0:13728:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03333800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13728:1869685707612032:0@lo:104: 00010000:00010000:3.0:1783071458.465926:0:13728:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8b00031a00/0x6b58994c2cbdc119 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d1e expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071458.465935:0:13728:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f8b00031a00/0x6b58994c2cbdc119 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d1e expref: 12 pid: 6508 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071458.465943:0:13728:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03330e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13728:1869685707612160:192.168.204.38@tcp:104: 00010000:00010000:3.0:1783071458.467565:0:13728:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8b00030c00/0x6b58994c2cbdc112 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d17 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071458.467588:0:13728:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f8b00030c00/0x6b58994c2cbdc112 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d17 expref: 12 pid: 6508 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071458.467601:0:13728:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03330000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13728:1869685707612288:192.168.204.38@tcp:104: 00000100:00100000:3.0:1783071458.467653:0:13728:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0394fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1783071458.467871:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071458.467910:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071458.467937:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071458.467959:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707611648 00000100:00100000:0.0:1783071458.467966:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707611648 00000100:00100000:1.0:1783071458.468005:0:13184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707611776 00000100:00100000:0.0:1783071458.468005:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707611904 00000100:00100000:1.0:1783071458.468008:0:13184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707611776 00000100:00100000:0.0:1783071458.468008:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707611904 00000100:00100000:0.0:1783071458.468019:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707612032 00000100:00100000:0.0:1783071458.468021:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707612032 00000100:00100000:1.0:1783071458.468026:0:13184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783071458.468034:0:13184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02e75c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:feaa1501-b927-4e07-baad-3200e92d7497+6:13728:x1869685707611648:12345-0@lo:104: 00010000:00010000:1.0:1783071458.468047:0:13184:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8f8b00031200/0x6b58994c2cbdc14a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdc151 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071458.468115:0:13184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783071458.468121:0:13184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02e75c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:feaa1501-b927-4e07-baad-3200e92d7497+6:13728:x1869685707611648:12345-0@lo:104: Request processed in 88us (2819us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071458.468183:0:13728:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03331c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13728:1869685707611648:0@lo:104: 00000100:00100000:0.0:1783071458.469869:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783071458.469886:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03907b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:feaa1501-b927-4e07-baad-3200e92d7497+6:13728:x1869685707611904:12345-0@lo:104: 00010000:00010000:0.0:1783071458.469905:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66200/0x6b58994c2cbdc12e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdc135 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071458.470863:0:13184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783071458.470923:0:13184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783071458.470936:0:13184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03905180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:feaa1501-b927-4e07-baad-3200e92d7497+5:13728:x1869685707611776:12345-0@lo:104: 00010000:00010000:1.0:1783071458.470948:0:13184:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66400/0x6b58994c2cbdc13c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdc143 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071458.476152:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783071458.476297:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8b00031200/0x6b58994c2cbdc14a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdc151 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071458.476310:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b00031200 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:2.0:1783071458.476315:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8b00031200/0x6b58994c2cbdc14a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x6b58994c2cbdc151 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071458.476326:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8b00031200/0x6b58994c2cbdc14a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x6b58994c2cbdc151 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783071458.476333:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8b00031200/0x6b58994c2cbdc14a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x6b58994c2cbdc151 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071458.476340:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783071458.476411:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8f8b00031200/0x6b58994c2cbdc14a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdc151 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071458.476418:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783071458.476443:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8b00031200/0x6b58994c2cbdc14a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdc151 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071458.476451:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8b00031200/0x6b58994c2cbdc14a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdc151 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071458.476486:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071458.476488:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071458.476490:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071458.476516:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03808700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:feaa1501-b927-4e07-baad-3200e92d7497:3646:1869685707612416:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783071458.477245:0:13184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783071458.477257:0:13184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03905180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:feaa1501-b927-4e07-baad-3200e92d7497+5:13728:x1869685707611776:12345-0@lo:104: Request processed in 6324us (9384us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071458.477268:0:13184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00010000:1.0:1783071458.477297:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783071458.477301:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66400/0x6b58994c2cbdc13c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdc143 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071458.477309:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd66400 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:1.0:1783071458.477312:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66400/0x6b58994c2cbdc13c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6b58994c2cbdc143 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071458.477320:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66400/0x6b58994c2cbdc13c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6b58994c2cbdc143 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783071458.477327:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66400/0x6b58994c2cbdc13c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6b58994c2cbdc143 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783071458.477333:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783071458.477356:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66400/0x6b58994c2cbdc13c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdc143 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071458.477716:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783071458.477739:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66400/0x6b58994c2cbdc13c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdc143 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071458.477747:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66400/0x6b58994c2cbdc13c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdc143 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071458.477772:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071458.477774:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071458.477776:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071458.477790:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c79c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:feaa1501-b927-4e07-baad-3200e92d7497:3647:1869685707612544:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783071458.477831:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071458.477890:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707612544 00000100:00100000:1.0:1783071458.477897:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707612544 00010000:00010000:1.0:1783071458.477927:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8b014b8800/0x6b58994c2cbdc143 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdc13c expref: 24 pid: 6508 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071458.477953:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783071458.477961:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c79f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:feaa1501-b927-4e07-baad-3200e92d7497+24:3647:x1869685707612544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783071458.478045:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071458.478052:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8b014b8800/0x6b58994c2cbdc143 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdc13c expref: 24 pid: 6508 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071458.478063:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8b014b8800/0x6b58994c2cbdc143 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6b58994c2cbdc13c expref: 24 pid: 6508 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071458.478082:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071458.478116:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c79f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:feaa1501-b927-4e07-baad-3200e92d7497+24:3647:x1869685707612544:12345-0@lo:103:ldlm_bl.0 Request processed in 155us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071458.478123:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783071458.478159:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c79c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:feaa1501-b927-4e07-baad-3200e92d7497:3647:1869685707612544:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783071458.478184:0:13184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783071458.478191:0:13184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab61c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:feaa1501-b927-4e07-baad-3200e92d7497+4:13728:x1869685707612032:12345-0@lo:104: 00010000:00010000:1.0:1783071458.478210:0:13184:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67000/0x6b58994c2cbdc120 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdc127 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071458.478315:0:13184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783071458.478321:0:13184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab61c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:feaa1501-b927-4e07-baad-3200e92d7497+4:13728:x1869685707612032:12345-0@lo:104: Request processed in 131us (10383us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071458.478328:0:13184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:0.0:1783071458.479704:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783071458.479718:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03907b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:feaa1501-b927-4e07-baad-3200e92d7497+3:13728:x1869685707611904:12345-0@lo:104: Request processed in 9836us (11804us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071458.479729:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:3.0:1783071458.479921:0:13728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b014b8800/0x6b58994c2cbdc143 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6b58994c2cbdc13c expref: 23 pid: 6508 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071458.479938:0:13728:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03332a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13728:1869685707611776:0@lo:104: 00000100:00100000:3.0:1783071458.479950:0:13728:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03332d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13728:1869685707611904:0@lo:104: 00000100:00100000:3.0:1783071458.479959:0:13728:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03333800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13728:1869685707612032:0@lo:104: 00010000:00010000:1.0:1783071458.480082:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783071458.480091:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67000/0x6b58994c2cbdc120 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdc127 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071458.480100:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd67000 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:1.0:1783071458.480105:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67000/0x6b58994c2cbdc120 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6b58994c2cbdc127 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071458.480115:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67000/0x6b58994c2cbdc120 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6b58994c2cbdc127 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783071458.480123:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67000/0x6b58994c2cbdc120 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6b58994c2cbdc127 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783071458.480129:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783071458.480164:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67000/0x6b58994c2cbdc120 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdc127 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071458.480171:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783071458.480199:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67000/0x6b58994c2cbdc120 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdc127 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071458.480206:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67000/0x6b58994c2cbdc120 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdc127 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071458.480237:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783071458.480241:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66200/0x6b58994c2cbdc12e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdc135 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071458.480246:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd66200 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:1.0:1783071458.480249:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66200/0x6b58994c2cbdc12e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6b58994c2cbdc135 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071458.480256:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66200/0x6b58994c2cbdc12e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6b58994c2cbdc135 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783071458.480263:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66200/0x6b58994c2cbdc12e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6b58994c2cbdc135 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783071458.480268:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783071458.480282:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66200/0x6b58994c2cbdc12e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdc135 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071458.480288:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783071458.480296:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66200/0x6b58994c2cbdc12e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdc135 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071458.480303:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66200/0x6b58994c2cbdc12e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdc135 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071458.480317:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071458.480319:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071458.480320:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071458.480634:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c79c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:feaa1501-b927-4e07-baad-3200e92d7497:3648:1869685707612672:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783071458.480694:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071458.481418:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071458.481448:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783071458.481455:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c79d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:feaa1501-b927-4e07-baad-3200e92d7497:3646:1869685707612800:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783071458.481481:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783071458.481515:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071458.481527:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707612672 00000100:00100000:2.0:1783071458.481533:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707612672 00010000:00010000:2.0:1783071458.481576:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8b00031600/0x6b58994c2cbdc127 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdc120 expref: 23 pid: 6511 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071458.481604:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707612416 00000100:00100000:2.0:1783071458.481607:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707612416 00010000:00010000:2.0:1783071458.481619:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8b00030800/0x6b58994c2cbdc151 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdc14a expref: 24 pid: 6511 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071458.481629:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707612800 00000100:00100000:2.0:1783071458.481631:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707612800 00010000:00010000:2.0:1783071458.481661:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8b2fd67800/0x6b58994c2cbdc135 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdc12e expref: 25 pid: 6508 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071458.481677:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783071458.481686:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:feaa1501-b927-4e07-baad-3200e92d7497+25:3648:x1869685707612672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783071458.481700:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1783071458.481914:0:7923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783071458.481925:0:7923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03808e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:feaa1501-b927-4e07-baad-3200e92d7497+25:3646:x1869685707612416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783071458.481936:0:7923:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071458.481941:0:7923:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8b00030800/0x6b58994c2cbdc151 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdc14a expref: 25 pid: 6511 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071458.481969:0:7923:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8b00030800/0x6b58994c2cbdc151 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6b58994c2cbdc14a expref: 25 pid: 6511 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071458.481987:0:7923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b00030800/0x6b58994c2cbdc151 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6b58994c2cbdc14a expref: 25 pid: 6511 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071458.482014:0:7923:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071458.482056:0:7923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03808e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:feaa1501-b927-4e07-baad-3200e92d7497+24:3646:x1869685707612416:12345-0@lo:103:ldlm_bl.0 Request processed in 134us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071458.482062:0:7923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783071458.482082:0:7923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783071458.482088:0:7923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03809f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:feaa1501-b927-4e07-baad-3200e92d7497+23:3646:x1869685707612800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783071458.482096:0:7923:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071458.482100:0:7923:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8b2fd67800/0x6b58994c2cbdc135 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdc12e expref: 23 pid: 6508 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071458.482109:0:7923:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8b2fd67800/0x6b58994c2cbdc135 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6b58994c2cbdc12e expref: 23 pid: 6508 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071458.482120:0:7923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b2fd67800/0x6b58994c2cbdc135 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6b58994c2cbdc12e expref: 23 pid: 6508 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071458.482128:0:7923:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071458.482163:0:7923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03809f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:feaa1501-b927-4e07-baad-3200e92d7497+22:3646:x1869685707612800:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071458.482293:0:7923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00010000:2.0:1783071458.482429:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8b00031600/0x6b58994c2cbdc127 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdc120 expref: 21 pid: 6511 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071458.482447:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8b00031600/0x6b58994c2cbdc127 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6b58994c2cbdc120 expref: 21 pid: 6511 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071458.482458:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b00031600/0x6b58994c2cbdc127 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6b58994c2cbdc120 expref: 21 pid: 6511 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071458.482469:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071458.482895:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:feaa1501-b927-4e07-baad-3200e92d7497+20:3648:x1869685707612672:12345-0@lo:103:ldlm_bl.0 Request processed in 1209us (2199us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071458.482903:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783071458.483017:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c79d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:feaa1501-b927-4e07-baad-3200e92d7497:3646:1869685707612800:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783071458.483033:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03808700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:feaa1501-b927-4e07-baad-3200e92d7497:3646:1869685707612416:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783071458.483128:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c79c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:feaa1501-b927-4e07-baad-3200e92d7497:3648:1869685707612672:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783071458.484421:0:13728:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03330e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13728:1869685707612160:192.168.204.38@tcp:104: 00000100:00100000:0.0:1783071458.484435:0:13728:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03330000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13728:1869685707612288:192.168.204.38@tcp:104: 00010000:00010000:0.0:1783071458.484479:0:13728:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f8b014b8000/0x6b58994c2cbdc28c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071458.488097:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071458.488290:0:7923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692851712 00000100:00100000:0.0:1783071458.488299:0:7923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692851712 00010000:00010000:0.0:1783071458.488336:0:7923:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8b00031a00/0x6b58994c2cbdc119 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d1e expref: 13 pid: 6508 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071458.488408:0:7923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 50 00000100:00100000:0.0:1783071458.488420:0:7923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03333100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:2405:x1869685692851712:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783071458.488437:0:7923:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071458.488444:0:7923:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8b00031a00/0x6b58994c2cbdc119 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d1e expref: 13 pid: 6508 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071458.488458:0:7923:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8b00031a00/0x6b58994c2cbdc119 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d1e expref: 13 pid: 6508 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071458.488477:0:7923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b00031a00/0x6b58994c2cbdc119 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d1e expref: 13 pid: 6508 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071458.488494:0:7923:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071458.488568:0:7923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03333100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e4e7df8-beb0-40df-a2a1-9decaa005633+12:2405:x1869685692851712:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 150us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071458.488576:0:7923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 50 00000100:00100000:3.0:1783071458.495490:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071458.495614:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692851840 00000100:00100000:2.0:1783071458.495636:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692851840 00010000:00010000:2.0:1783071458.495679:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8b00030c00/0x6b58994c2cbdc112 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d17 expref: 12 pid: 6508 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071458.495726:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 51 00000100:00100000:2.0:1783071458.495736:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03330000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e4e7df8-beb0-40df-a2a1-9decaa005633+12:2406:x1869685692851840:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783071458.495753:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071458.495759:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8b00030c00/0x6b58994c2cbdc112 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d17 expref: 12 pid: 6508 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071458.495771:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8b00030c00/0x6b58994c2cbdc112 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d17 expref: 12 pid: 6508 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071458.495789:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b00030c00/0x6b58994c2cbdc112 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d17 expref: 12 pid: 6508 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071458.495821:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f8b014b8000/0x6b58994c2cbdc28c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071458.495828:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b014b8000/0x6b58994c2cbdc28c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071458.495843:0:6501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f8b014b8000/0x6b58994c2cbdc28c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071458.495850:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f8b014b8000/0x6b58994c2cbdc28c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071458.495856:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f8b014b8000/0x6b58994c2cbdc28c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071458.495861:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f8b014b8000/0x6b58994c2cbdc28c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071458.496064:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b014b8000 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:2.0:1783071458.496068:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f8b014b8000/0x6b58994c2cbdc28c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071458.496077:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f8b014b8000/0x6b58994c2cbdc28c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071458.496090:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f8b014b8000/0x6b58994c2cbdc28c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071458.496102:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071458.496163:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03330000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e4e7df8-beb0-40df-a2a1-9decaa005633+11:2406:x1869685692851840:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 428us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071458.496177:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 51 00010000:00010000:0.0:1783071458.496812:0:13728:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f8b014b8000/0x6b58994c2cbdc28c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071458.496824:0:13728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f8b014b8000/0x6b58994c2cbdc28c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071458.496830:0:13728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b014b8000/0x6b58994c2cbdc28c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071458.563712:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071459.139011:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783071459.139038:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03808700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707612928:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783071459.139121:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071459.139234:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707612928 00000100:00100000:3.0:1783071459.139242:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707612928 00000100:00100000:3.0:1783071459.139297:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1783071459.139309:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03809500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707612928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783071459.139348:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783071459.139482:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03809500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707612928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 175us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071459.139489:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1783071459.139555:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03808700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707612928:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783071459.143205:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03333800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869685707613184:0@lo:400:kworker.0 00000100:00100000:3.0:1783071459.143282:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071459.143324:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707613696:0@lo:400:kworker.0 00000100:00100000:3.0:1783071459.143355:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071459.143402:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707614208:0@lo:400:kworker.0 00000100:00100000:3.0:1783071459.143430:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071459.143459:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1783071459.143465:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03330e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869685707613056:0@lo:400:kworker.0 00000100:00100000:3.0:1783071459.143488:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071459.143504:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03331c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1869685707613568:0@lo:400:kworker.0 00000100:00100000:3.0:1783071459.143526:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071459.143556:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707614080:0@lo:400:kworker.0 00000100:00100000:3.0:1783071459.143582:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071459.143619:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03332a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1869685707613440:0@lo:400:kworker.0 00000100:00100000:3.0:1783071459.143648:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071459.143665:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1869685707613952:0@lo:400:kworker.0 00000100:00100000:3.0:1783071459.143686:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071459.143698:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1783071459.143703:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707613312:0@lo:400:kworker.0 00000100:00100000:3.0:1783071459.143729:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071459.143748:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1869685707613824:0@lo:400:kworker.0 00000100:00100000:3.0:1783071459.143771:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071459.143800:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707613184 00000100:00100000:3.0:1783071459.143809:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707613184 00000100:00100000:3.0:1783071459.143848:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707613056 00000100:00100000:3.0:1783071459.143852:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707613056 00000100:00100000:3.0:1783071459.143876:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707613568 00000100:00100000:3.0:1783071459.143879:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707613568 00000100:00100000:3.0:1783071459.143904:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707613440 00000100:00100000:3.0:1783071459.143908:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707613440 00000100:00100000:3.0:1783071459.143917:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707613952 00000100:00100000:3.0:1783071459.143919:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707613952 00000100:00100000:3.0:1783071459.143932:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707613824 00000100:00100000:3.0:1783071459.143934:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707613824 00000100:00100000:3.0:1783071459.143951:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1783071459.143961:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869685707613184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071459.144020:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869685707613184:12345-0@lo:400:kworker.0 Request processed in 60us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071459.144028:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1783071459.144046:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1783071459.144052:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869685707613056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071459.144079:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869685707613056:12345-0@lo:400:kworker.0 Request processed in 27us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071459.144085:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1783071459.144097:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1783071459.144103:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869685707613568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071459.144133:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869685707613568:12345-0@lo:400:kworker.0 Request processed in 30us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071459.144139:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1783071459.144152:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1783071459.144158:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c668000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869685707613440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071459.144191:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c668000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869685707613440:12345-0@lo:400:kworker.0 Request processed in 33us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071459.144210:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1783071459.144225:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1783071459.144230:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c668a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869685707613952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071459.144260:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c668a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869685707613952:12345-0@lo:400:kworker.0 Request processed in 30us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071459.144266:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1783071459.144280:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1783071459.144286:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c669880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869685707613824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071459.144311:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c669880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869685707613824:12345-0@lo:400:kworker.0 Request processed in 25us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071459.144316:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1783071459.144337:0:8910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707613696 00000100:00100000:3.0:1783071459.144341:0:8910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707613696 00000100:00100000:3.0:1783071459.144392:0:8910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707614208 00000100:00100000:3.0:1783071459.144396:0:8910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707614208 00000100:00100000:3.0:1783071459.144414:0:8910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707614080 00000100:00100000:3.0:1783071459.144417:0:8910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707614080 00000100:00100000:3.0:1783071459.144438:0:8910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1783071459.144445:0:8910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707613696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071459.144477:0:8910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707613696:12345-0@lo:400:kworker.0 Request processed in 34us (1123us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071459.144483:0:8910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1783071459.144494:0:8910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1783071459.144500:0:8910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707614208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071459.144526:0:8910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707614208:12345-0@lo:400:kworker.0 Request processed in 26us (1097us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071459.144554:0:8910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1783071459.144566:0:8910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1783071459.144575:0:8910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707614080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071459.144606:0:8910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707614080:12345-0@lo:400:kworker.0 Request processed in 35us (1024us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071459.144612:0:8910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1783071459.144655:0:9413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707613312 00000100:00100000:3.0:1783071459.144659:0:9413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707613312 00000100:00100000:3.0:1783071459.144691:0:9413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1783071459.144697:0:9413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c66a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707613312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071459.144732:0:9413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c66a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707613312:12345-0@lo:400:kworker.0 Request processed in 35us (1003us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071459.144739:0:9413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:3.0:1783071459.144758:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783071459.144763:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783071459.144766:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783071459.144769:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783071459.144807:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707613312:0@lo:400:kworker.0 00000100:00100000:3.0:1783071459.144821:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1869685707613824:0@lo:400:kworker.0 00000100:00100000:3.0:1783071459.144830:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03332a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1869685707613440:0@lo:400:kworker.0 00010000:00080000:3.0:1783071459.144841:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c6a1500 x1869685707613952/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071459.144850:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1869685707613952:0@lo:400:kworker.0 00000100:00100000:3.0:1783071459.144898:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03330e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869685707613056:0@lo:400:kworker.0 00010000:00080000:3.0:1783071459.144918:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a03331c00 x1869685707613568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071459.144928:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03331c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1869685707613568:0@lo:400:kworker.0 00010000:00080000:3.0:1783071459.144939:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c6a1f80 x1869685707614080/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071459.144947:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707614080:0@lo:400:kworker.0 00000100:00100000:3.0:1783071459.144957:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03333800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869685707613184:0@lo:400:kworker.0 00000100:00100000:3.0:1783071459.144968:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707613696:0@lo:400:kworker.0 00010000:00080000:3.0:1783071459.144977:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c6a2300 x1869685707614208/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071459.144985:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707614208:0@lo:400:kworker.0 00000020:00000080:0.0:1783071459.499049:0:13777:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe4da88240 20000000:00000080:0.0:1783071459.499069:0:13777:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f8b3c6a6000 uarg=0000000000000000 20000000:01000000:0.0:1783071459.499120:0:13777:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1783071459.499127:0:13777:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1783071459.499132:0:13777:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:3.0:1783071459.500028:0:13778:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:0.0:1783071459.500219:0:13777:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:0.0:1783071459.500310:0:13777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:0.0:1783071459.500345:0:13777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:0.0:1783071459.500912:0:13777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:0.0:1783071459.500933:0:13777:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1783071459.500958:0:13777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f8a03864000/0x6b58994c2cbdc293 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071459.500976:0:13777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8a03864000/0x6b58994c2cbdc293 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071459.500989:0:13777:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f8a03864000/0x6b58994c2cbdc293 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071459.500997:0:13777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f8a03864000/0x6b58994c2cbdc293 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071459.501004:0:13777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f8a03864000/0x6b58994c2cbdc293 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071459.501012:0:13777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f8a03864000/0x6b58994c2cbdc293 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071459.501019:0:13777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03864000 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:0.0:1783071459.501024:0:13777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f8a03864000/0x6b58994c2cbdc293 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071459.501046:0:13777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f8a03864000/0x6b58994c2cbdc293 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071459.501061:0:13777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f8a03864000/0x6b58994c2cbdc293 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071459.501069:0:13777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f8a03864000/0x6b58994c2cbdc293 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071459.501076:0:13777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8a03864000/0x6b58994c2cbdc293 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071459.591550:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071459.650766:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03809180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707614336:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783071459.650842:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071459.650950:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707614336 00000100:00100000:0.0:1783071459.650959:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707614336 00000100:00100000:0.0:1783071459.651016:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1783071459.651026:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c66b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707614336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783071459.651060:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783071459.651108:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c66b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707614336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071459.651115:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:3.0:1783071459.651187:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a03809180 x1869685707614336/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071475 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071459.651205:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03809180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707614336:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783071459.651609:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c669180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707614592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783071459.651643:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071459.651677:0:12254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707614592 00000100:00100000:0.0:1783071459.651682:0:12254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707614592 00000100:00100000:0.0:1783071459.651708:0:12254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1783071459.651715:0:12254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707614592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783071459.651728:0:12254:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783071459.651775:0:12254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707614592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071459.651782:0:12254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:0.0:1783071459.651808:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c669180 x1869685707614592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071475 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071459.651821:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c669180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707614592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783071459.651864:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b0ab63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707614464:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783071459.651892:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071459.651955:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707614464 00000100:00100000:0.0:1783071459.651959:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707614464 00000100:00100000:0.0:1783071459.651989:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1783071459.651995:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c66bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707614464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783071459.652011:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783071459.652041:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c66bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707614464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 46us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071459.652047:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1783071459.652754:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783071459.652767:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03809180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707614720:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783071459.652805:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071459.652844:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707614720 00000100:00100000:2.0:1783071459.652849:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707614720 00000100:00100000:2.0:1783071459.652879:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1783071459.652886:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03808700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1869685707614720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783071459.652904:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783071459.652935:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03808700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1869685707614720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071459.652941:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1783071459.652971:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03809180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707614720:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783071459.653149:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b0ab63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707614464:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783071460.306528:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071460.307252:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692851968 00000100:00100000:2.0:1783071460.307270:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692851968 00000100:00100000:2.0:1783071460.307454:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 335 00000100:00100000:2.0:1783071460.307465:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e4e7df8-beb0-40df-a2a1-9decaa005633+11:6172:x1869685692851968:12345-192.168.204.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783071460.307484:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071460.307528:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b2fd67000/0x6b58994c2cbdc29a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98d6b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071460.307575:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b2fd67000/0x6b58994c2cbdc29a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d6b expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071460.307587:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b2fd67000/0x6b58994c2cbdc29a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d6b expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071460.307595:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b2fd67000, rc 0) 00000100:00100000:2.0:1783071460.307677:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e4e7df8-beb0-40df-a2a1-9decaa005633+12:6172:x1869685692851968:12345-192.168.204.38@tcp:101:ll_cfg_requeue.0 Request processed in 213us (1174us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071460.307684:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 335 00000100:00100000:3.0:1783071460.312111:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071460.312156:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692852096 00000100:00100000:0.0:1783071460.313478:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692852096 00000100:00100000:0.0:1783071460.313956:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 336 00000100:00100000:0.0:1783071460.313969:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e4e7df8-beb0-40df-a2a1-9decaa005633+12:6172:x1869685692852096:12345-192.168.204.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783071460.314173:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e4e7df8-beb0-40df-a2a1-9decaa005633+12:6172:x1869685692852096:12345-192.168.204.38@tcp:501:ll_cfg_requeue.0 Request processed in 197us (2072us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071460.314182:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 336 00000100:00100000:3.0:1783071460.322840:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071460.322937:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692852224 00000100:00100000:0.0:1783071460.322952:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692852224 00000100:00100000:0.0:1783071460.323032:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 337 00000100:00100000:0.0:1783071460.323041:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e4e7df8-beb0-40df-a2a1-9decaa005633+12:6172:x1869685692852224:12345-192.168.204.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783071460.323209:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e4e7df8-beb0-40df-a2a1-9decaa005633+12:6172:x1869685692852224:12345-192.168.204.38@tcp:503:ll_cfg_requeue.0 Request processed in 168us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071460.323223:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 337 00000100:00100000:3.0:1783071460.335098:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071460.336301:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692852352 00000100:00100000:1.0:1783071460.336348:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692852352 00000100:00100000:1.0:1783071460.336469:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 338 00000100:00100000:1.0:1783071460.336482:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e4e7df8-beb0-40df-a2a1-9decaa005633+12:10802:x1869685692852352:12345-192.168.204.38@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783071460.337296:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e4e7df8-beb0-40df-a2a1-9decaa005633+12:10802:x1869685692852352:12345-192.168.204.38@tcp:502:llog_process_th.0 Request processed in 809us (2208us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071460.337310:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 338 00000100:00100000:3.0:1783071460.352953:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071460.353222:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692852480 00000100:00100000:2.0:1783071460.353239:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692852480 00000100:00100000:2.0:1783071460.353317:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 339 00000100:00100000:2.0:1783071460.353328:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e4e7df8-beb0-40df-a2a1-9decaa005633+12:10802:x1869685692852480:12345-192.168.204.38@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783071460.353920:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e4e7df8-beb0-40df-a2a1-9decaa005633+12:10802:x1869685692852480:12345-192.168.204.38@tcp:502:llog_process_th.0 Request processed in 591us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071460.353929:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 339 00000100:00100000:3.0:1783071460.377057:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071460.377468:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692852608 00000100:00100000:1.0:1783071460.377485:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692852608 00000100:00100000:1.0:1783071460.377600:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 340 00000100:00100000:1.0:1783071460.377614:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e4e7df8-beb0-40df-a2a1-9decaa005633+12:6172:x1869685692852608:12345-192.168.204.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783071460.377642:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071460.377669:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8a01748a00/0x6b58994c2cbdc2a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98d72 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071460.377882:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8a01748a00/0x6b58994c2cbdc2a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d72 expref: 13 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071460.377905:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8a01748a00/0x6b58994c2cbdc2a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d72 expref: 13 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071460.377917:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a01748a00, rc 0) 00000100:00100000:1.0:1783071460.378014:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:6172:x1869685692852608:12345-192.168.204.38@tcp:101:ll_cfg_requeue.0 Request processed in 402us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071460.378023:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 340 00000100:00100000:3.0:1783071460.382578:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071460.384851:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692852736 00000100:00100000:0.0:1783071460.384877:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692852736 00000100:00100000:0.0:1783071460.385140:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 341 00000100:00100000:0.0:1783071460.385154:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:6172:x1869685692852736:12345-192.168.204.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783071460.385783:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:6172:x1869685692852736:12345-192.168.204.38@tcp:501:ll_cfg_requeue.0 Request processed in 629us (3217us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071460.385793:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 341 00000100:00100000:2.0:1783071460.390039:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071460.390765:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692852864 00000100:00100000:1.0:1783071460.390781:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692852864 00000100:00100000:1.0:1783071460.390847:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 342 00000100:00100000:1.0:1783071460.390859:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:6172:x1869685692852864:12345-192.168.204.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783071460.391095:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:6172:x1869685692852864:12345-192.168.204.38@tcp:503:ll_cfg_requeue.0 Request processed in 237us (1071us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071460.391104:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 342 00000100:00100000:0.0:1783071460.408252:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071460.410969:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692852992 00000100:00100000:1.0:1783071460.411002:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692852992 00000100:00100000:0.0:1783071460.413227:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 343 00000100:00100000:0.0:1783071460.413251:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:10805:x1869685692852992:12345-192.168.204.38@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783071460.413573:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:10805:x1869685692852992:12345-192.168.204.38@tcp:502:llog_process_th.0 Request processed in 329us (5353us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071460.413582:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 343 00000100:00100000:2.0:1783071460.419544:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071460.420447:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692853120 00000100:00100000:0.0:1783071460.420466:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692853120 00000100:00100000:0.0:1783071460.420561:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 344 00000100:00100000:0.0:1783071460.420575:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:10805:x1869685692853120:12345-192.168.204.38@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783071460.422103:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:10805:x1869685692853120:12345-192.168.204.38@tcp:502:llog_process_th.0 Request processed in 1517us (2573us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071460.422119:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 344 10000000:01000000:2.0:1783071460.483041:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783071460.483055:0:6513:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8f8b34e49800 from 7 10000000:01000000:2.0:1783071460.483061:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783071460.483140:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66000/0x6b58994c2cbdc2a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071460.483157:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66000/0x6b58994c2cbdc2a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071460.483199:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66000/0x6b58994c2cbdc2a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071460.483352:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03809180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707614848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783071460.483494:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071460.483585:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a038cae40 going to sleep for 11 seconds 00000100:00100000:0.0:1783071460.484495:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707614848 00000100:00100000:0.0:1783071460.484509:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707614848 00000100:00100000:0.0:1783071460.484612:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1783071460.484637:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+20:6513:x1869685707614848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783071460.484659:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071460.484920:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8a03864c00/0x6b58994c2cbdc2af lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdc2a8 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071460.484970:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8a03864c00/0x6b58994c2cbdc2af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdc2a8 expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071460.484985:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8a03864c00/0x6b58994c2cbdc2af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdc2a8 expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071460.484998:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a03864c00, rc 0) 00000100:00100000:0.0:1783071460.485100:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+21:6513:x1869685707614848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 465us (1606us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071460.485108:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1783071460.485438:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03809180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707614848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783071460.485465:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66000/0x6b58994c2cbdc2a8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc2af expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071460.485476:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66000/0x6b58994c2cbdc2a8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdc2af expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071460.485606:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c79ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707614976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783071460.485650:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071460.485923:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b0511bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1783071460.486088:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707614976 00000100:00100000:0.0:1783071460.486094:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707614976 00000100:00100000:0.0:1783071460.486143:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1783071460.486152:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+21:6513:x1869685707614976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783071460.486612:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+21:6513:x1869685707614976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 460us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071460.486621:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1783071460.494743:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c79ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707614976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783071460.494856:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c66b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707615104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783071460.494977:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071460.495105:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0394ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1783071460.495228:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707615104 00000100:00100000:0.0:1783071460.495239:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707615104 00000100:00100000:0.0:1783071460.495473:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1783071460.495571:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+21:6513:x1869685707615104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783071460.495752:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+21:6513:x1869685707615104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 186us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071460.495769:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1783071460.495873:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c66b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707615104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783071460.496416:0:13790:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c66b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:13790:1869685707615232:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783071460.496465:0:13790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071460.497014:0:13790:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0394f840 going to sleep for 11 seconds 00000100:00100000:2.0:1783071460.497097:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707615232 00000100:00100000:2.0:1783071460.497105:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707615232 00000100:00100000:2.0:1783071460.497147:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1783071460.497154:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+21:13790:x1869685707615232:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783071460.497533:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+21:13790:x1869685707615232:12345-0@lo:502:llog_process_th.0 Request processed in 377us (1064us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071460.497541:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1783071460.497745:0:13790:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c66b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:13790:1869685707615232:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783071460.497784:0:13790:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783071460.497797:0:13790:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071460.497800:0:13790:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783071460.497808:0:13790:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f8b34e49800 00000020:00000080:3.0:1783071460.497811:0:13790:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783071460.497906:0:13790:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783071460.497911:0:13790:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071460.497913:0:13790:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783071460.497915:0:13790:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783071460.497918:0:13790:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071460.497919:0:13790:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1783071460.497923:0:13790:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f8b34e49800 00000020:00000080:3.0:1783071460.497934:0:13790:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783071460.497983:0:13790:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c66b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:13790:1869685707615360:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783071460.498034:0:13790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071460.498062:0:13790:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0394f840 going to sleep for 11 seconds 00000100:00100000:0.0:1783071460.501547:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707615360 00000100:00100000:0.0:1783071460.501567:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707615360 00000100:00100000:0.0:1783071460.501655:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1783071460.501668:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+21:13790:x1869685707615360:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783071460.501935:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+21:13790:x1869685707615360:12345-0@lo:502:llog_process_th.0 Request processed in 269us (3899us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071460.501944:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1783071460.503059:0:13790:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c66b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:13790:1869685707615360:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783071460.503123:0:13790:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783071460.503138:0:13790:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071460.503141:0:13790:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1783071460.503147:0:13790:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1783071460.503716:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1783071460.503758:0:6513:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783071460.503779:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66000/0x6b58994c2cbdc2a8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc2af expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071460.503795:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66000/0x6b58994c2cbdc2a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc2af expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783071460.503808:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783071460.503811:0:6513:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8f8b069b2000 from 7 10000000:01000000:1.0:1783071460.503815:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783071460.503871:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8a01749200/0x6b58994c2cbdc2b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071460.505189:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8a01749200/0x6b58994c2cbdc2b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071460.505210:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8a01749200/0x6b58994c2cbdc2b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071460.505260:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c79ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707615488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783071460.505663:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071460.505716:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b0511bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783071460.505862:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707615488 00000100:00100000:0.0:1783071460.505873:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707615488 00000100:00100000:0.0:1783071460.506013:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1783071460.506025:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+21:6513:x1869685707615488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783071460.506048:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071460.506073:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8a03864200/0x6b58994c2cbdc2bd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdc2b6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071460.506112:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8a03864200/0x6b58994c2cbdc2bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdc2b6 expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071460.506126:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8a03864200/0x6b58994c2cbdc2bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdc2b6 expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071460.506137:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a03864200, rc 0) 00000100:00100000:0.0:1783071460.506203:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+22:6513:x1869685707615488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 179us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071460.506211:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1783071460.507660:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c79ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707615488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783071460.507697:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8a01749200/0x6b58994c2cbdc2b6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc2bd expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071460.507713:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8a01749200/0x6b58994c2cbdc2b6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdc2bd expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071460.507846:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c66b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707615616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783071460.508586:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071460.509008:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0394f840 going to sleep for 11 seconds 00000100:00100000:0.0:1783071460.509047:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707615616 00000100:00100000:0.0:1783071460.509058:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707615616 00000100:00100000:0.0:1783071460.509141:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1783071460.509153:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+22:6513:x1869685707615616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783071460.510795:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+22:6513:x1869685707615616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1630us (2200us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071460.510812:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1783071460.511158:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c66b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707615616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783071460.511247:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c79c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707615744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783071460.511429:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071460.511474:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b0511be40 going to sleep for 11 seconds 00000100:00100000:3.0:1783071460.511587:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707615744 00000100:00100000:3.0:1783071460.511596:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707615744 00000100:00100000:3.0:1783071460.511658:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1783071460.511668:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+22:6513:x1869685707615744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783071460.511787:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+22:6513:x1869685707615744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 121us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071460.511795:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1783071460.511975:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c79c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707615744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783071460.516690:0:13791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c79c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:13791:1869685707615872:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783071460.516824:0:13791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071460.516920:0:13791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b0511bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1783071460.517078:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707615872 00000100:00100000:3.0:1783071460.517089:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707615872 00000100:00100000:3.0:1783071460.517165:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1783071460.517178:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+22:13791:x1869685707615872:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783071460.517353:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+22:13791:x1869685707615872:12345-0@lo:502:llog_process_th.0 Request processed in 177us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071460.517384:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1783071460.518449:0:13791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c79c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:13791:1869685707615872:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783071460.518510:0:13791:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783071460.518536:0:13791:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783071460.518539:0:13791:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783071460.518550:0:13791:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f8b069b2000 00000020:00000080:1.0:1783071460.518554:0:13791:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783071460.518645:0:13791:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783071460.518649:0:13791:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783071460.518657:0:13791:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783071460.518661:0:13791:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783071460.518664:0:13791:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783071460.518666:0:13791:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1783071460.518669:0:13791:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f8b069b2000 00000020:00000080:1.0:1783071460.518671:0:13791:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1783071460.518728:0:13791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c79c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:13791:1869685707616000:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783071460.518799:0:13791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071460.518846:0:13791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b0511bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1783071460.519406:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707616000 00000100:00100000:3.0:1783071460.519417:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707616000 00000100:00100000:3.0:1783071460.519488:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1783071460.519500:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+22:13791:x1869685707616000:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783071460.519648:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+22:13791:x1869685707616000:12345-0@lo:502:llog_process_th.0 Request processed in 150us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071460.519656:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1783071460.521111:0:13791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c79c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:13791:1869685707616000:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783071460.521162:0:13791:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783071460.521173:0:13791:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783071460.521175:0:13791:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1783071460.521182:0:13791:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1783071460.526639:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1783071460.526705:0:6513:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783071460.526724:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8a01749200/0x6b58994c2cbdc2b6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc2bd expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071460.526741:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8a01749200/0x6b58994c2cbdc2b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc2bd expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783071460.533573:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783071460.533587:0:6513:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8f8b3447b000 from 7 10000000:01000000:3.0:1783071460.533593:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783071460.533664:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b014b9200/0x6b58994c2cbdc2c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071460.533679:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8b014b9200/0x6b58994c2cbdc2c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071460.533717:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8b014b9200/0x6b58994c2cbdc2c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071460.533752:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c668380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707616128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783071460.533872:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071460.533940:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0394f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783071460.535955:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707616128 00000100:00100000:0.0:1783071460.535976:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707616128 00000100:00100000:0.0:1783071460.536065:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1783071460.536078:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+22:6513:x1869685707616128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783071460.536105:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071460.536131:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8a03865800/0x6b58994c2cbdc2cb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdc2c4 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071460.536167:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8a03865800/0x6b58994c2cbdc2cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdc2c4 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071460.536180:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8a03865800/0x6b58994c2cbdc2cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdc2c4 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071460.536190:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a03865800, rc 0) 00000100:00100000:0.0:1783071460.536305:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+23:6513:x1869685707616128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 229us (2432us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071460.536313:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1783071460.537258:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c668380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707616128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783071460.537289:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8b014b9200/0x6b58994c2cbdc2c4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc2cb expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071460.537303:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8b014b9200/0x6b58994c2cbdc2c4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdc2cb expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071460.537463:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03809180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707616256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783071460.537549:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071460.537606:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a038cac00 going to sleep for 11 seconds 00000100:00100000:0.0:1783071460.538054:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707616256 00000100:00100000:0.0:1783071460.538063:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707616256 00000100:00100000:0.0:1783071460.538137:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1783071460.538146:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+23:6513:x1869685707616256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783071460.538341:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+23:6513:x1869685707616256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 196us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071460.538349:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1783071460.538782:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03809180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707616256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783071460.538837:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03809180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707616384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783071460.538897:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071460.538935:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a038cac00 going to sleep for 11 seconds 00000100:00100000:3.0:1783071460.538965:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707616384 00000100:00100000:3.0:1783071460.538972:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707616384 00000100:00100000:3.0:1783071460.539024:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1783071460.539033:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+23:6513:x1869685707616384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783071460.539150:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+23:6513:x1869685707616384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 119us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071460.539158:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1783071460.543181:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03809180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707616384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783071460.543867:0:13794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c66a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:13794:1869685707616512:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783071460.543975:0:13794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071460.544023:0:13794:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0394f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783071460.544116:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707616512 00000100:00100000:0.0:1783071460.544124:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707616512 00000100:00100000:0.0:1783071460.544183:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1783071460.544193:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+23:13794:x1869685707616512:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783071460.544354:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+23:13794:x1869685707616512:12345-0@lo:502:llog_process_th.0 Request processed in 161us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071460.544535:0:13794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c66a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:13794:1869685707616512:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783071460.544571:0:13794:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783071460.544585:0:13794:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071460.544587:0:13794:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783071460.544594:0:13794:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f8b3447b000 00000020:00000080:3.0:1783071460.544597:0:13794:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783071460.544678:0:13794:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783071460.544680:0:13794:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071460.544682:0:13794:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783071460.544684:0:13794:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783071460.544694:0:13794:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071460.544695:0:13794:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1783071460.544699:0:13794:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f8b3447b000 00000020:00000080:3.0:1783071460.544701:0:13794:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783071460.544734:0:13794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c66a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:13794:1869685707616640:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783071460.544773:0:13794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071460.544802:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707616640 00000100:00100000:3.0:1783071460.544807:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707616640 00000100:00100000:3.0:1783071460.544829:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1783071460.544835:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+24:13794:x1869685707616640:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783071460.544912:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+24:13794:x1869685707616640:12345-0@lo:502:llog_process_th.0 Request processed in 76us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071460.544921:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1783071460.544970:0:13794:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0394f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071460.544983:0:13794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c66a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:13794:1869685707616640:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783071460.545001:0:13794:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783071460.545005:0:13794:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071460.545006:0:13794:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1783071460.545010:0:13794:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000100:00100000:0.0:1783071460.545309:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000020:01000000:2.0:1783071460.546165:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1783071460.546200:0:6513:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783071460.546216:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b014b9200/0x6b58994c2cbdc2c4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc2cb expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071460.546232:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8b014b9200/0x6b58994c2cbdc2c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc2cb expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071460.546246:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783071460.546250:0:6513:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8f8b10f7e000 from 7 10000000:01000000:2.0:1783071460.546253:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783071460.546300:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67a00/0x6b58994c2cbdc2d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071460.546310:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67a00/0x6b58994c2cbdc2d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071460.546321:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67a00/0x6b58994c2cbdc2d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071460.546342:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03809180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707616768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783071460.546573:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071460.546626:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a038cac00 going to sleep for 11 seconds 00000100:00100000:3.0:1783071460.546847:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707616768 00000100:00100000:3.0:1783071460.546856:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707616768 00000100:00100000:3.0:1783071460.546931:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1783071460.546941:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+23:6513:x1869685707616768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783071460.546960:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071460.546982:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b014b8800/0x6b58994c2cbdc2d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdc2d2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071460.547021:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b014b8800/0x6b58994c2cbdc2d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdc2d2 expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071460.547051:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b014b8800/0x6b58994c2cbdc2d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdc2d2 expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071460.547061:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b014b8800, rc 0) 00000100:00100000:3.0:1783071460.547115:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+24:6513:x1869685707616768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 175us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071460.547121:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1783071460.548695:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03809180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707616768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783071460.548734:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67a00/0x6b58994c2cbdc2d2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc2d9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071460.548767:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67a00/0x6b58994c2cbdc2d2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdc2d9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071460.548880:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03809180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707616896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783071460.548948:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071460.549004:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a038cac00 going to sleep for 11 seconds 00000100:00100000:0.0:1783071460.549100:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707616896 00000100:00100000:0.0:1783071460.549108:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707616896 00000100:00100000:0.0:1783071460.549161:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1783071460.549171:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+24:6513:x1869685707616896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783071460.549342:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+24:6513:x1869685707616896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 170us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071460.549351:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1783071460.549688:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03809180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707616896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783071460.549731:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03809180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707617024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783071460.549781:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071460.549810:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a038cac00 going to sleep for 11 seconds 00000100:00100000:0.0:1783071460.549854:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707617024 00000100:00100000:0.0:1783071460.549860:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707617024 00000100:00100000:0.0:1783071460.549922:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1783071460.549930:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+24:6513:x1869685707617024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783071460.550030:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+24:6513:x1869685707617024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 99us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071460.550038:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1783071460.550103:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03809180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:feaa1501-b927-4e07-baad-3200e92d7497:6513:1869685707617024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783071460.551899:0:13795:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03809180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:13795:1869685707617152:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783071460.552005:0:13795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071460.552214:0:13795:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a038cacc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071460.552284:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707617152 00000100:00100000:3.0:1783071460.552295:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707617152 00000100:00100000:3.0:1783071460.552345:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1783071460.552354:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+24:13795:x1869685707617152:12345-0@lo:502:llog_process_th.0 00000040:00080000:2.0:1783071460.555304:0:13796:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1783071460.567521:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+24:13795:x1869685707617152:12345-0@lo:502:llog_process_th.0 Request processed in 15142us (15490us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071460.567542:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1783071460.570435:0:13795:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03809180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:13795:1869685707617152:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783071460.570506:0:13795:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783071460.570529:0:13795:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071460.570532:0:13795:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783071460.570541:0:13795:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f8b10f7e000 00000020:00000080:3.0:1783071460.570543:0:13795:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783071460.570618:0:13795:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783071460.570621:0:13795:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071460.570622:0:13795:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783071460.570625:0:13795:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783071460.570628:0:13795:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071460.570629:0:13795:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1783071460.570632:0:13795:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f8b10f7e000 00000020:00000080:3.0:1783071460.570634:0:13795:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783071460.570690:0:13795:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c66a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:13795:1869685707617280:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783071460.570781:0:13795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071460.570841:0:13795:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0394fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783071460.570993:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707617280 00000100:00100000:1.0:1783071460.571003:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707617280 00000100:00100000:1.0:1783071460.571076:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1783071460.571088:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0690ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+24:13795:x1869685707617280:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783071460.571242:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0690ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+24:13795:x1869685707617280:12345-0@lo:502:llog_process_th.0 Request processed in 155us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071460.571253:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1783071460.573411:0:13795:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c66a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:feaa1501-b927-4e07-baad-3200e92d7497:13795:1869685707617280:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783071460.573550:0:13795:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783071460.573563:0:13795:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071460.573566:0:13795:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1783071460.573572:0:13795:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1783071460.577660:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1783071460.577720:0:6513:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783071460.577737:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67a00/0x6b58994c2cbdc2d2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc2d9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071460.577751:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67a00/0x6b58994c2cbdc2d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc2d9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783071460.604207:0:13798:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1783071460.610689:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071460.675297:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783071460.675329:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03809180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707617408:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783071460.675461:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071460.675547:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707617408 00000100:00100000:1.0:1783071460.675557:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707617408 00000100:00100000:1.0:1783071460.675615:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1783071460.675625:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c79c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707617408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783071460.675692:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783071460.675748:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c79c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707617408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 123us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071460.675756:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1783071460.675822:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03809180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707617408:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1783071461.571219:0:13796:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1783071461.634752:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783071461.635516:0:13798:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1783071462.659861:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071462.676485:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071462.676544:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071462.676588:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071462.676631:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071462.676653:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071462.676687:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071462.676701:0:8910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692853632 00000100:00100000:3.0:1783071462.676715:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692853376 00000100:00100000:1.0:1783071462.676717:0:8910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692853632 00000100:00100000:3.0:1783071462.676721:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692853376 00000100:00100000:0.0:1783071462.676751:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692853888 00000100:00100000:0.0:1783071462.676779:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692853888 00000100:00100000:2.0:1783071462.676805:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692853504 00000100:00100000:2.0:1783071462.676811:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692853504 00000100:00100000:3.0:1783071462.677087:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692853760 00000100:00100000:3.0:1783071462.677091:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692853760 00000100:00100000:1.0:1783071462.679354:0:8910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 100 00000100:00100000:1.0:1783071462.679399:0:8910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c668380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf7532e4-6153-424a-9f4e-84941256b41f+5:2404:x1869685692853632:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1783071462.679540:0:8910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c668380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf7532e4-6153-424a-9f4e-84941256b41f+5:2404:x1869685692853632:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 157us (2993us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071462.679549:0:8910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 100 00000100:00080000:1.0:1783071462.679623:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783071462.679629:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783071462.679686:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783071462.679708:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 208 00000100:00100000:1.0:1783071462.679718:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c66a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+5:2404:x1869685692853376:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1783071462.679766:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c66a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+5:2404:x1869685692853376:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 50us (3306us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071462.679772:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 208 00000100:00100000:1.0:1783071462.679813:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692853248 00000100:00100000:1.0:1783071462.679825:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692853248 00000100:00100000:1.0:1783071462.679943:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 365 00000100:00100000:1.0:1783071462.679951:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0d1cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:2404:x1869685692853248:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1783071462.679978:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0d1cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:2404:x1869685692853248:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 29us (3347us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071462.680005:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 365 00000100:00100000:2.0:1783071462.683092:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 209 00000100:00100000:2.0:1783071462.683113:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c669180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+5:2404:x1869685692853504:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1783071462.683240:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c669180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+5:2404:x1869685692853504:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 134us (6585us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071462.683248:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 209 00000100:00100000:0.0:1783071462.683539:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 210 00000100:00100000:0.0:1783071462.683686:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c66b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2404:x1869685692853888:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1783071462.683845:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c66b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2404:x1869685692853888:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 164us (7254us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071462.683852:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 210 00000100:00100000:3.0:1783071462.692438:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 211 00000100:00100000:3.0:1783071462.692463:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2404:x1869685692853760:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1783071462.692619:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2404:x1869685692853760:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 166us (15931us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071462.693055:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 211 00010000:00010000:2.0:1783071463.682578:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071464.259109:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03809180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707617536:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783071464.259286:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071464.259699:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707617536 00000100:00100000:3.0:1783071464.259708:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707617536 00000100:00100000:3.0:1783071464.259758:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1783071464.259768:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c79d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707617536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783071464.259808:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783071464.259877:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c79d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707617536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071464.259894:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1783071464.260067:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03809180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707617536:0@lo:41:osp-pre-0-1.0 00000001:00080000:2.0:1783071464.260844:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:2.0:1783071464.261041:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b0ab60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:feaa1501-b927-4e07-baad-3200e92d7497:3647:1869685707617664:0@lo:400:kworker.0 00000100:00100000:2.0:1783071464.261102:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071464.261116:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b0ab62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869685707617920:0@lo:400:kworker.0 00000100:00100000:2.0:1783071464.261146:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783071464.261155:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b0ab61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869685707617792:0@lo:400:kworker.0 00000100:00100000:1.0:1783071464.261163:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071464.261196:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071464.261378:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707617664 00000100:00100000:3.0:1783071464.261385:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707617664 00000100:00100000:3.0:1783071464.261427:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1783071464.261436:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b13f99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+24:3647:x1869685707617664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071464.261501:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b13f99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+24:3647:x1869685707617664:12345-0@lo:400:kworker.0 Request processed in 66us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071464.261508:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1783071464.261554:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b0ab60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:feaa1501-b927-4e07-baad-3200e92d7497:3647:1869685707617664:0@lo:400:kworker.0 00000100:00100000:3.0:1783071464.261610:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707617920 00000100:00100000:3.0:1783071464.261614:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707617920 00000100:00100000:3.0:1783071464.261647:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707617792 00000100:00100000:3.0:1783071464.261651:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707617792 00000100:00100000:2.0:1783071464.261671:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1783071464.261682:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c79ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1869685707617920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071464.261687:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1783071464.261698:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03809180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869685707617792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071464.261745:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03809180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869685707617792:12345-0@lo:400:kworker.0 Request processed in 49us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071464.261751:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1783071464.261777:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b0ab61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869685707617792:0@lo:400:kworker.0 00000100:00100000:3.0:1783071464.262698:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b0ab60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707618048:0@lo:400:kworker.0 00000100:00100000:3.0:1783071464.262748:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071464.262789:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c79ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1869685707617920:12345-0@lo:400:kworker.0 Request processed in 1108us (1626us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071464.262800:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1783071464.262815:0:9413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707618048 00000100:00100000:3.0:1783071464.262821:0:9413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707618048 00000100:00100000:3.0:1783071464.262860:0:9413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1783071464.262868:0:9413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707618048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071464.263119:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b0ab62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869685707617920:0@lo:400:kworker.0 00000100:00100000:2.0:1783071464.263963:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b0ab60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707618048:0@lo:400:kworker.0 00000100:00100000:3.0:1783071464.263964:0:9413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707618048:12345-0@lo:400:kworker.0 Request processed in 1090us (1209us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071464.263977:0:9413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1783071464.266117:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b0ab61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1869685707618176:0@lo:400:kworker.0 00000100:00100000:0.0:1783071464.266117:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b0ab62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707618560:0@lo:400:kworker.0 00000100:00100000:0.0:1783071464.266198:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071464.266234:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b2fcb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707619072:0@lo:400:kworker.0 00000100:00100000:3.0:1783071464.266242:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071464.266265:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071464.266288:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1783071464.266294:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b0ab60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707618432:0@lo:400:kworker.0 00000100:00100000:0.0:1783071464.266315:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071464.266332:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b0ab63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707618944:0@lo:400:kworker.0 00000100:00100000:3.0:1783071464.266348:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b0ab61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1869685707618688:0@lo:400:kworker.0 00000100:00100000:0.0:1783071464.266392:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071464.266404:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071464.266431:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707618560 00000100:00100000:3.0:1783071464.266432:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1783071464.266439:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707618560 00000100:00100000:3.0:1783071464.266441:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b0ab61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1869685707618304:0@lo:400:kworker.0 00000100:00100000:3.0:1783071464.266481:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071464.266502:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b0ab60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1869685707618816:0@lo:400:kworker.0 00000100:00100000:0.0:1783071464.266504:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707619072 00000100:00100000:0.0:1783071464.266509:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707619072 00000100:00100000:0.0:1783071464.266527:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707618432 00000100:00100000:0.0:1783071464.266530:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707618432 00000100:00100000:3.0:1783071464.266534:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071464.266551:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707618944 00000100:00100000:0.0:1783071464.266554:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707618944 00000100:00100000:3.0:1783071464.266573:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1783071464.266584:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b2fcb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707618560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071464.266771:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1783071464.266782:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b2fcb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707619072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071464.266856:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b2fcb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707619072:12345-0@lo:400:kworker.0 Request processed in 76us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071464.266864:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1783071464.266882:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1783071464.266888:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b2fcb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707618432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071464.266914:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b2fcb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707618432:12345-0@lo:400:kworker.0 Request processed in 27us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071464.266920:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:1.0:1783071464.266937:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783071464.266941:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783071464.266996:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b0ab60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707618432:0@lo:400:kworker.0 00010000:00080000:1.0:1783071464.267009:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b2fcb0700 x1869685707619072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071464.267019:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b2fcb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707619072:0@lo:400:kworker.0 00000100:00100000:1.0:1783071464.267078:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707618176 00000100:00100000:1.0:1783071464.267082:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707618176 00000100:00100000:1.0:1783071464.267112:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707618688 00000100:00100000:1.0:1783071464.267116:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707618688 00000100:00100000:1.0:1783071464.267132:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707618304 00000100:00100000:1.0:1783071464.267135:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707618304 00000100:00100000:1.0:1783071464.267148:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707618816 00000100:00100000:1.0:1783071464.267150:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707618816 00000100:00100000:1.0:1783071464.267163:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1783071464.267168:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869685707618176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071464.267207:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869685707618176:12345-0@lo:400:kworker.0 Request processed in 39us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071464.267214:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1783071464.267228:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1783071464.267234:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869685707618688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071464.267263:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869685707618688:12345-0@lo:400:kworker.0 Request processed in 30us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071464.267269:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1783071464.267280:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1783071464.267286:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869685707618304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071464.267310:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869685707618304:12345-0@lo:400:kworker.0 Request processed in 25us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071464.267314:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1783071464.267328:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1783071464.267329:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b2fcb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707618560:12345-0@lo:400:kworker.0 Request processed in 743us (1128us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071464.267337:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03333800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869685707618816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071464.267344:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1783071464.267408:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03333800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869685707618816:12345-0@lo:400:kworker.0 Request processed in 72us (874us total) trans 0 rc 0/0 00010000:00080000:3.0:1783071464.267410:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b0ab61880 x1869685707618304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071464.267426:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b0ab61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1869685707618304:0@lo:400:kworker.0 00000100:00100000:1.0:1783071464.267432:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00010000:00080000:3.0:1783071464.267452:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b0ab60a80 x1869685707618816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783071464.267462:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783071464.267463:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b0ab60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1869685707618816:0@lo:400:kworker.0 00000100:00080000:1.0:1783071464.267468:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783071464.267481:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b0ab61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1869685707618176:0@lo:400:kworker.0 00000100:00100000:3.0:1783071464.267507:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b0ab61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1869685707618688:0@lo:400:kworker.0 00000100:00100000:3.0:1783071464.267537:0:3646:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1783071464.267542:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f8a03904e00, transno 4294967301 00000100:00100000:3.0:1783071464.267561:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b0ab62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707618560:0@lo:400:kworker.0 00000100:00100000:0.0:1783071464.267994:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1783071464.268003:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b2fcb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707618944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071464.268049:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b2fcb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707618944:12345-0@lo:400:kworker.0 Request processed in 48us (1693us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071464.268066:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00010000:00080000:1.0:1783071464.268263:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b0ab63100 x1869685707618944/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071464.268275:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b0ab63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707618944:0@lo:400:kworker.0 00000100:00080000:3.0:1783071464.268350:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1783071464.706717:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071464.770720:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03331c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707619200:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783071464.770766:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b0ab63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707619328:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783071464.770795:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071464.770923:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707619200 00000100:00100000:2.0:1783071464.770946:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707619200 00000100:00100000:2.0:1783071464.770998:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1783071464.771008:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b2fcb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707619200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783071464.771041:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783071464.771339:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b08873480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707619456:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783071464.772832:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b2fcb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707619200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1820us (2032us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071464.772844:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1783071464.772893:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03330e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707619584:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783071464.772949:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071464.773017:0:12254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707619584 00000100:00100000:2.0:1783071464.773024:0:12254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707619584 00000100:00100000:2.0:1783071464.773067:0:12254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1783071464.773075:0:12254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3b4dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707619584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783071464.773102:0:12254:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783071464.773141:0:12254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3b4dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707619584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071464.773147:0:12254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1783071464.773188:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03330e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707619584:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783071464.777971:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071464.778054:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707619456 00000100:00100000:3.0:1783071464.778064:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707619456 00000100:00100000:3.0:1783071464.778109:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1783071464.778119:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03332a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707619456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783071464.778159:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783071464.778203:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03332a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707619456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071464.778210:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00080000:3.0:1783071464.778253:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b08873480 x1869685707619456/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071480 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071464.778274:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b08873480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707619456:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1783071464.782603:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a03331c00 x1869685707619200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071480 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071464.782636:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03331c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707619200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783071464.783661:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071464.785215:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707619328 00000100:00100000:2.0:1783071464.785226:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707619328 00000100:00100000:2.0:1783071464.785410:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1783071464.785424:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707619328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783071464.785462:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783071464.785607:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707619328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 186us (1950us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071464.785615:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1783071464.785783:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b0ab63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707619328:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1783071465.730554:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071465.795875:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783071465.795904:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3b4d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707619712:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783071465.795989:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071465.796169:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707619712 00000100:00100000:3.0:1783071465.796178:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707619712 00000100:00100000:3.0:1783071465.796238:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1783071465.796249:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707619712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783071465.796290:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783071465.796361:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707619712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 113us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071465.796387:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1783071465.796603:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3b4d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707619712:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1783071466.754600:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071467.778554:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071467.797920:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071467.797962:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071467.798009:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071467.798114:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692854016 00000100:00100000:1.0:1783071467.798125:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692854016 00000100:00100000:3.0:1783071467.798166:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071467.798186:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 367 00000100:00100000:3.0:1783071467.798201:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071467.798201:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b02bf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:2403:x1869685692854016:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1783071467.798320:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b02bf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:2403:x1869685692854016:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 124us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071467.798328:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 367 00000100:00100000:1.0:1783071467.798416:0:8910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692854400 00000100:00100000:1.0:1783071467.798420:0:8910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692854400 00000100:00100000:1.0:1783071467.798459:0:8910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 105 00000100:00100000:1.0:1783071467.798465:0:8910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03330e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf7532e4-6153-424a-9f4e-84941256b41f+5:2404:x1869685692854400:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1783071467.798511:0:8910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03330e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf7532e4-6153-424a-9f4e-84941256b41f+5:2404:x1869685692854400:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 46us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071467.798519:0:8910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 105 00000100:00080000:1.0:1783071467.798657:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783071467.801205:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071467.803906:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692854144 00000100:00100000:2.0:1783071467.803923:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692854144 00000100:00100000:0.0:1783071467.804543:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692854272 00000100:00100000:0.0:1783071467.804550:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692854272 00000100:00100000:0.0:1783071467.804613:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692854528 00000100:00100000:0.0:1783071467.804618:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692854528 00000100:00100000:0.0:1783071467.804650:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 218 00000100:00100000:0.0:1783071467.804660:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03331c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+5:2403:x1869685692854272:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1783071467.804753:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03331c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+5:2403:x1869685692854272:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 94us (6742us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071467.804762:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 218 00000100:00100000:0.0:1783071467.804782:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 219 00000100:00100000:0.0:1783071467.804789:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b08873480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2403:x1869685692854528:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1783071467.804817:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b08873480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2403:x1869685692854528:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 28us (6620us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071467.804823:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 219 00000100:00080000:0.0:1783071467.805209:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783071467.805213:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783071467.806847:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 220 00000100:00100000:2.0:1783071467.806866:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03332d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+5:2404:x1869685692854144:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1783071467.806973:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03332d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+5:2404:x1869685692854144:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 106us (9001us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071467.806981:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 220 00000100:00100000:1.0:1783071467.808542:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692854656 00000100:00100000:1.0:1783071467.808657:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692854656 00000100:00100000:1.0:1783071467.808768:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 221 00000100:00100000:1.0:1783071467.808789:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37a60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2404:x1869685692854656:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1783071467.808880:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37a60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2404:x1869685692854656:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 94us (7683us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071467.808889:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 221 00000100:00080000:2.0:1783071467.809343:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1783071468.803466:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071469.380216:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3b4dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707619840:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783071469.380295:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071469.380454:0:9413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707619840 00000100:00100000:2.0:1783071469.380462:0:9413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707619840 00000100:00100000:2.0:1783071469.380513:0:9413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1783071469.380522:0:9413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707619840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783071469.380559:0:9413:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1783071469.380613:0:9413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707619840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071469.380622:0:9413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1783071469.380718:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3b4dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707619840:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783071469.381328:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37a63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:feaa1501-b927-4e07-baad-3200e92d7497:3645:1869685707619968:0@lo:400:kworker.0 00000100:00100000:0.0:1783071469.381407:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071469.381504:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707619968 00000100:00100000:1.0:1783071469.381510:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707619968 00000100:00100000:1.0:1783071469.381554:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1783071469.381561:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b06199c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+24:3645:x1869685707619968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071469.381722:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37a61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869685707620096:0@lo:400:kworker.0 00000100:00100000:2.0:1783071469.381773:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071469.381811:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707620096 00000100:00100000:2.0:1783071469.381815:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707620096 00000100:00100000:2.0:1783071469.381847:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1783071469.381854:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3b4d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869685707620096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071469.381897:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3b4d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869685707620096:12345-0@lo:400:kworker.0 Request processed in 42us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071469.381903:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1783071469.381942:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37a61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869685707620096:0@lo:400:kworker.0 00000100:00100000:1.0:1783071469.386394:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b06199c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+24:3645:x1869685707619968:12345-0@lo:400:kworker.0 Request processed in 4822us (4975us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071469.386411:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1783071469.386937:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37a60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1869685707620608:0@lo:400:kworker.0 00000100:00100000:3.0:1783071469.387000:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071469.387032:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02c09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1869685707621120:0@lo:400:kworker.0 00000100:00100000:3.0:1783071469.387052:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071469.387073:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1783071469.387078:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37a62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1869685707620480:0@lo:400:kworker.0 00000100:00100000:3.0:1783071469.387097:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071469.387112:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02c0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1869685707620992:0@lo:400:kworker.0 00000100:00100000:3.0:1783071469.387132:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071469.387162:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707620608 00000100:00100000:3.0:1783071469.387169:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707620608 00000100:00100000:3.0:1783071469.387211:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707621120 00000100:00100000:3.0:1783071469.387215:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707621120 00000100:00100000:3.0:1783071469.387228:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707620480 00000100:00100000:3.0:1783071469.387231:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707620480 00000100:00100000:3.0:1783071469.387243:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707620992 00000100:00100000:3.0:1783071469.387245:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707620992 00000100:00100000:3.0:1783071469.387260:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1783071469.387267:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02c09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869685707620608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071469.387332:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02c09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869685707620608:12345-0@lo:400:kworker.0 Request processed in 64us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071469.387338:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1783071469.387384:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1783071469.387391:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02c0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869685707621120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071469.387419:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02c0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869685707621120:12345-0@lo:400:kworker.0 Request processed in 29us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071469.387425:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1783071469.387437:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1783071469.387443:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02c0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869685707620480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071469.387467:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02c0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869685707620480:12345-0@lo:400:kworker.0 Request processed in 24us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071469.387472:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1783071469.387483:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1783071469.387489:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c68b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869685707620992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071469.387513:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c68b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869685707620992:12345-0@lo:400:kworker.0 Request processed in 25us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071469.387519:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1783071469.387556:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37a62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1869685707620480:0@lo:400:kworker.0 00000100:00100000:3.0:1783071469.387568:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02c0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1869685707620992:0@lo:400:kworker.0 00010000:00080000:3.0:1783071469.387579:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b37a60a80 x1869685707620608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071469.387589:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37a60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1869685707620608:0@lo:400:kworker.0 00010000:00080000:3.0:1783071469.387609:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a02c09c00 x1869685707621120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071469.387618:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02c09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1869685707621120:0@lo:400:kworker.0 00000100:00100000:3.0:1783071469.387648:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37a63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707620352:0@lo:400:kworker.0 00000100:00100000:3.0:1783071469.387678:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071469.387697:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37a61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707620864:0@lo:400:kworker.0 00000100:00100000:3.0:1783071469.387719:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071469.387735:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02c09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707621376:0@lo:400:kworker.0 00000100:00100000:3.0:1783071469.387751:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071469.387769:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1783071469.387775:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37a61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869685707620224:0@lo:400:kworker.0 00000100:00100000:3.0:1783071469.387795:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071469.387811:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37a60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707620736:0@lo:400:kworker.0 00000100:00100000:3.0:1783071469.387831:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071469.387846:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02c08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707621248:0@lo:400:kworker.0 00000100:00100000:3.0:1783071469.387864:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071469.387887:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707620352 00000100:00100000:3.0:1783071469.387891:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707620352 00000100:00100000:3.0:1783071469.387914:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1783071469.387920:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c68a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707620352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071469.387958:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c68a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707620352:12345-0@lo:400:kworker.0 Request processed in 37us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071469.387964:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1783071469.387983:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707620864 00000100:00100000:3.0:1783071469.387993:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707620864 00000100:00100000:3.0:1783071469.388014:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707621376 00000100:00100000:3.0:1783071469.388017:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707621376 00000100:00100000:3.0:1783071469.388029:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707620736 00000100:00100000:3.0:1783071469.388031:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707620736 00000100:00100000:3.0:1783071469.388043:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707621248 00000100:00100000:3.0:1783071469.388045:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707621248 00000100:00100000:3.0:1783071469.388058:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1783071469.388064:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c688000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707620864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071469.388095:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c688000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707620864:12345-0@lo:400:kworker.0 Request processed in 31us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071469.388101:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1783071469.388111:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1783071469.388117:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c688a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707621376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071469.388143:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c688a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707621376:12345-0@lo:400:kworker.0 Request processed in 27us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071469.388149:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1783071469.388159:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1783071469.388165:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c68aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707620736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071469.388188:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c68aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707620736:12345-0@lo:400:kworker.0 Request processed in 24us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071469.388194:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1783071469.388205:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1783071469.388211:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c68b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707621248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071469.388236:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c68b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707621248:12345-0@lo:400:kworker.0 Request processed in 25us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071469.388241:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1783071469.388263:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707620224 00000100:00100000:3.0:1783071469.388267:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707620224 00000100:00100000:3.0:1783071469.388283:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1783071469.388288:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c689880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869685707620224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071469.388314:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c689880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869685707620224:12345-0@lo:400:kworker.0 Request processed in 26us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071469.388319:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1783071469.388358:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37a61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869685707620224:0@lo:400:kworker.0 00000100:00100000:3.0:1783071469.388390:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37a60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707620736:0@lo:400:kworker.0 00010000:00080000:3.0:1783071469.388400:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a02c08000 x1869685707621248/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071469.388409:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02c08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707621248:0@lo:400:kworker.0 00000100:00100000:3.0:1783071469.388417:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37a63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707620352:0@lo:400:kworker.0 00000100:00100000:3.0:1783071469.388426:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37a61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707620864:0@lo:400:kworker.0 00010000:00080000:3.0:1783071469.388434:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a02c09500 x1869685707621376/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071469.388443:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02c09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707621376:0@lo:400:kworker.0 00000100:00080000:2.0:1783071469.388577:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783071469.388581:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783071469.388584:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783071469.388586:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783071469.393534:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37a63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:feaa1501-b927-4e07-baad-3200e92d7497:3645:1869685707619968:0@lo:400:kworker.0 00010000:00010000:2.0:1783071469.826580:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071469.890596:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b0ab61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707621504:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783071469.890681:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071469.890813:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783071469.890822:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b2fcb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707621632:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783071469.890860:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071469.890896:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707621504 00000100:00100000:0.0:1783071469.890905:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707621504 00000100:00100000:0.0:1783071469.890958:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707621632 00000100:00100000:0.0:1783071469.890962:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707621632 00000100:00100000:0.0:1783071469.891002:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1783071469.891021:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b2fcb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707621504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783071469.891053:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783071469.891099:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b2fcb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707621504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071469.891108:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1783071469.891134:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1783071469.891144:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707621632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783071469.891174:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783071469.891209:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707621632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071469.891216:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:0.0:1783071469.891275:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b2fcb0700 x1869685707621632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071485 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071469.891296:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b2fcb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707621632:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783071469.891320:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b0ab61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707621504:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783071469.891696:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3b4dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707621760:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783071469.891738:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071469.891791:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783071469.891811:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707621888:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783071469.891843:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071469.891883:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707621760 00000100:00100000:0.0:1783071469.891889:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707621760 00000100:00100000:2.0:1783071469.891891:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707621888 00000100:00100000:2.0:1783071469.891897:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707621888 00000100:00100000:0.0:1783071469.891925:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1783071469.891932:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1783071469.891938:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3b4d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707621760:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783071469.891947:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c5aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707621888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783071469.891953:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:2.0:1783071469.891962:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783071469.892020:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3b4d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707621760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071469.892028:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1783071469.892113:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c5aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707621888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 168us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071469.892122:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1783071469.892171:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707621888:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1783071469.892189:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3b4dad80 x1869685707621760/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071485 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071469.892205:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3b4dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707621760:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783071470.851529:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071470.914768:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783071470.914795:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c5af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707622016:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783071470.914870:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071470.922911:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707622016 00000100:00100000:1.0:1783071470.922932:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707622016 00000100:00100000:1.0:1783071470.923102:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1783071470.923113:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c68b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707622016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783071470.923154:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783071470.923248:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c68b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707622016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 137us (8378us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071470.923256:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1783071470.923405:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c5af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707622016:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1783071471.811111:0:13796:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1783071471.877037:0:13798:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1783071471.877495:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071472.898900:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071472.917207:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071472.917263:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071472.917310:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071472.917348:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071472.917404:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071472.917429:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071472.917459:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692854784 00000100:00100000:0.0:1783071472.917469:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692854784 00000100:00100000:1.0:1783071472.917688:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692855168 00000100:00100000:1.0:1783071472.917693:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692855168 00000100:00100000:1.0:1783071472.917750:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 110 00000100:00100000:1.0:1783071472.917760:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf7532e4-6153-424a-9f4e-84941256b41f+5:2404:x1869685692855168:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1783071472.917833:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf7532e4-6153-424a-9f4e-84941256b41f+5:2404:x1869685692855168:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 74us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071472.917841:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 110 00000100:00080000:1.0:1783071472.917863:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783071472.918006:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 369 00000100:00100000:0.0:1783071472.918015:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b06198c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:2404:x1869685692854784:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1783071472.918044:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b06198c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:2404:x1869685692854784:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 32us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071472.918051:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 369 00000100:00100000:2.0:1783071472.918226:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692854912 00000100:00100000:2.0:1783071472.918231:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692854912 00000100:00100000:2.0:1783071472.918294:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692855424 00000100:00100000:2.0:1783071472.918297:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692855424 00000100:00100000:2.0:1783071472.918313:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692855040 00000100:00100000:2.0:1783071472.918316:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692855040 00000100:00100000:2.0:1783071472.918329:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692855296 00000100:00100000:2.0:1783071472.918332:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692855296 00000100:00100000:2.0:1783071472.918347:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 228 00000100:00100000:2.0:1783071472.918354:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+5:2404:x1869685692854912:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1783071472.918413:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+5:2404:x1869685692854912:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 59us (1218us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071472.918420:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 228 00000100:00100000:2.0:1783071472.918435:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 229 00000100:00100000:2.0:1783071472.918442:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2404:x1869685692855424:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1783071472.918467:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2404:x1869685692855424:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 25us (1156us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071472.918473:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 229 00000100:00100000:2.0:1783071472.918483:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 230 00000100:00100000:2.0:1783071472.918503:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+5:2404:x1869685692855040:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1783071472.918529:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+5:2404:x1869685692855040:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 40us (1124us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071472.918536:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 230 00000100:00100000:2.0:1783071472.918548:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 231 00000100:00100000:2.0:1783071472.918554:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2404:x1869685692855296:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1783071472.918584:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2404:x1869685692855296:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 30us (1155us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071472.918601:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 231 00000100:00080000:1.0:1783071472.919020:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783071472.919025:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783071473.922885:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071474.498684:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c688700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:feaa1501-b927-4e07-baad-3200e92d7497:3646:1869685707622144:0@lo:400:kworker.0 00000100:00100000:3.0:1783071474.498774:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c68ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707622400:0@lo:400:kworker.0 00000100:00100000:3.0:1783071474.498827:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071474.498827:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071474.498912:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c68bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869685707622272:0@lo:400:kworker.0 00000100:00100000:3.0:1783071474.499006:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c689c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1869685707622912:0@lo:400:kworker.0 00000100:00100000:0.0:1783071474.499019:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c689500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707622656:0@lo:400:kworker.0 00000100:00100000:1.0:1783071474.499035:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c689f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869685707622528:0@lo:400:kworker.0 00000100:00100000:3.0:1783071474.499054:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071474.499061:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071474.499092:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02c0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1869685707623424:0@lo:400:kworker.0 00000100:00100000:0.0:1783071474.499109:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02c08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707623168:0@lo:400:kworker.0 00000100:00100000:3.0:1783071474.499146:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071474.499180:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707622144 00000100:00100000:1.0:1783071474.499190:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707622144 00000100:00100000:3.0:1783071474.499208:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707622912 00000100:00100000:3.0:1783071474.499217:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707622912 00000100:00100000:1.0:1783071474.499274:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1783071474.499285:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18686850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+24:3646:x1869685707622144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071474.499293:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707623424 00000100:00100000:3.0:1783071474.499299:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707623424 00000100:00100000:3.0:1783071474.499328:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1783071474.499338:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37a60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869685707622912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071474.499393:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18686850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+24:3646:x1869685707622144:12345-0@lo:400:kworker.0 Request processed in 82us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071474.499403:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1783071474.499435:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071474.499445:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37a60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869685707622912:12345-0@lo:400:kworker.0 Request processed in 105us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071474.499456:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1783071474.499466:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c68a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1869685707622784:0@lo:400:kworker.0 00000100:00100000:2.0:1783071474.499506:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783071474.499506:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783071474.499528:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02c09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1869685707623296:0@lo:400:kworker.0 00000100:00100000:1.0:1783071474.499531:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071474.499628:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071474.499650:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b0ab60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707623808:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783071474.499675:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071474.499711:0:9413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707622400 00000100:00100000:2.0:1783071474.499716:0:9413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707622400 00000100:00100000:2.0:1783071474.499740:0:9413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707622656 00000100:00100000:2.0:1783071474.499743:0:9413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707622656 00000100:00100000:2.0:1783071474.499755:0:9413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707623808 00000100:00100000:2.0:1783071474.499757:0:9413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707623808 00000100:00100000:2.0:1783071474.499769:0:9413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1783071474.499775:0:9413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37a63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3648:x1869685707622400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071474.499883:0:9413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37a63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3648:x1869685707622400:12345-0@lo:400:kworker.0 Request processed in 107us (1060us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071474.499890:0:9413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1783071474.499916:0:9413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1783071474.499922:0:9413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707622656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071474.499950:0:9413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707622656:12345-0@lo:400:kworker.0 Request processed in 29us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071474.499956:0:9413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1783071474.499976:0:9413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1783071474.499982:0:9413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c5ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707623808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783071474.500013:0:9413:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1783071474.500049:0:9413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c5ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707623808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071474.500056:0:9413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1783071474.500413:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707622272 00000100:00100000:3.0:1783071474.500420:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707622272 00000100:00100000:3.0:1783071474.500439:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707622784 00000100:00100000:3.0:1783071474.500442:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707622784 00000100:00100000:3.0:1783071474.500465:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707622528 00000100:00100000:3.0:1783071474.500481:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707622528 00000100:00100000:3.0:1783071474.500495:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707623296 00000100:00100000:3.0:1783071474.500498:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707623296 00000100:00100000:3.0:1783071474.500513:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1783071474.500525:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37a61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869685707623424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071474.500570:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37a61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869685707623424:12345-0@lo:400:kworker.0 Request processed in 45us (1424us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071474.500579:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1783071474.500598:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1783071474.500598:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b0ab60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707623808:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783071474.500606:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c5aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869685707622272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071474.500662:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1783071474.500667:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c5aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869685707622272:12345-0@lo:400:kworker.0 Request processed in 61us (1235us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071474.500675:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c5adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869685707622784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071474.500681:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1783071474.500699:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1783071474.500707:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1869685707622528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071474.500723:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c5adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869685707622784:12345-0@lo:400:kworker.0 Request processed in 51us (1219us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071474.500730:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1783071474.500753:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1783071474.500754:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1869685707622528:12345-0@lo:400:kworker.0 Request processed in 45us (1222us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071474.500763:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c5ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869685707623296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071474.500767:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00080000:3.0:1783071474.500794:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783071474.500819:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c68ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707622400:0@lo:400:kworker.0 00000100:00100000:2.0:1783071474.500979:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c5ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869685707623296:12345-0@lo:400:kworker.0 Request processed in 218us (1350us total) trans 0 rc 0/0 00010000:00080000:3.0:1783071474.500982:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c689c00 x1869685707622912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071474.500990:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1783071474.501002:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c689c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1869685707622912:0@lo:400:kworker.0 00010000:00080000:3.0:1783071474.501019:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a02c0bb80 x1869685707623424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071474.501030:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02c0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1869685707623424:0@lo:400:kworker.0 00000100:00100000:2.0:1783071474.501036:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c68bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869685707622272:0@lo:400:kworker.0 00000100:00100000:2.0:1783071474.501054:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c68a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1869685707622784:0@lo:400:kworker.0 00000100:00100000:2.0:1783071474.501068:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02c09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1869685707623296:0@lo:400:kworker.0 00000100:00100000:1.0:1783071474.502324:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c689f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869685707622528:0@lo:400:kworker.0 00000100:00100000:1.0:1783071474.502351:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02c09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707623040:0@lo:400:kworker.0 00000100:00100000:0.0:1783071474.502352:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071474.502509:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37a61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707623680:0@lo:400:kworker.0 00000100:00100000:0.0:1783071474.502555:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071474.502714:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c688700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:feaa1501-b927-4e07-baad-3200e92d7497:3646:1869685707622144:0@lo:400:kworker.0 00000100:00100000:1.0:1783071474.502773:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071474.502782:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c689500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707622656:0@lo:400:kworker.0 00000100:00100000:2.0:1783071474.502991:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707623168 00000100:00100000:2.0:1783071474.503001:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707623168 00000100:00100000:2.0:1783071474.503127:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707623680 00000100:00100000:2.0:1783071474.503131:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707623680 00000100:00080000:0.0:1783071474.503341:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783071474.503346:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783071474.503402:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1783071474.503413:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707623168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071474.503485:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707623168:12345-0@lo:400:kworker.0 Request processed in 74us (1146us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071474.503493:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1783071474.503533:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02c08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707623168:0@lo:400:kworker.0 00000100:00100000:2.0:1783071474.503741:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1783071474.503749:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707623680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071474.503813:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707623680:12345-0@lo:400:kworker.0 Request processed in 65us (1257us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071474.503820:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00010000:00080000:0.0:1783071474.504046:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b37a61500 x1869685707623680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071474.504057:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37a61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707623680:0@lo:400:kworker.0 00000100:00100000:1.0:1783071474.504740:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37a63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707623552:0@lo:400:kworker.0 00000100:00100000:1.0:1783071474.504797:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071474.505381:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707623040 00000100:00100000:2.0:1783071474.505391:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707623040 00000100:00100000:2.0:1783071474.505463:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707623552 00000100:00100000:2.0:1783071474.505467:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707623552 00000100:00100000:2.0:1783071474.505497:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1783071474.505506:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707623040:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1783071474.505552:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783071474.505577:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707623040:12345-0@lo:400:kworker.0 Request processed in 71us (2809us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071474.505585:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1783071474.505602:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1783071474.505608:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707623552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071474.505634:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707623552:12345-0@lo:400:kworker.0 Request processed in 28us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071474.505641:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:3.0:1783071474.505798:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783071474.505811:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02c09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707623040:0@lo:400:kworker.0 00010000:00080000:1.0:1783071474.505832:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b37a63b80 x1869685707623552/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071474.505843:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37a63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707623552:0@lo:400:kworker.0 00010000:00010000:1.0:1783071474.946540:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071475.010869:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783071475.010870:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783071475.010889:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783071475.010915:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707623936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783071475.010915:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b0ab61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707624192:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783071475.010915:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c5aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707624064:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783071475.011066:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783071475.011077:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37a60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707624320:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783071475.013823:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071475.014449:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707624192 00000100:00100000:1.0:1783071475.014458:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707624192 00000100:00100000:1.0:1783071475.014508:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1783071475.014517:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a038ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707624192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783071475.014548:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783071475.014592:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a038ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707624192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071475.014598:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1783071475.014646:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b0ab61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707624192:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783071475.015759:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071475.015857:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071475.016092:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071475.017685:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707623936 00000100:00100000:1.0:1783071475.017697:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707623936 00000100:00100000:1.0:1783071475.017743:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707624064 00000100:00100000:1.0:1783071475.017762:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707624064 00000100:00100000:1.0:1783071475.017776:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707624320 00000100:00100000:1.0:1783071475.017779:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707624320 00000100:00100000:1.0:1783071475.017795:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1783071475.017804:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c5af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707623936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783071475.017837:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783071475.017961:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c5af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707623936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 158us (2206us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071475.017970:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1783071475.017988:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1783071475.018068:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b2fcb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707624064:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783071475.018083:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783071475.018117:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b2fcb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707624064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 122us (2266us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071475.018124:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1783071475.018322:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1783071475.018331:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37a62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707624320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783071475.018344:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783071475.018405:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37a62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707624320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (2314us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071475.018411:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00080000:1.0:1783071475.018544:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c5aed80 x1869685707624064/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071491 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071475.018564:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c5aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707624064:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783071475.018692:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37a60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707624320:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1783071475.018794:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a01764a80 x1869685707623936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071491 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071475.018808:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707623936:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783071475.970625:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071476.035027:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783071476.035058:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c5ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707624448:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783071476.035131:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071476.036070:0:9413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707624448 00000100:00100000:2.0:1783071476.036080:0:9413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707624448 00000100:00100000:2.0:1783071476.036143:0:9413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1783071476.036153:0:9413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37a60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707624448:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783071476.036190:0:9413:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783071476.036594:0:9413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37a60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707624448:12345-0@lo:41:osp-pre-1-0.0 Request processed in 441us (1461us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071476.036602:0:9413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1783071476.041652:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c5ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707624448:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1783071476.995534:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071478.020946:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071478.035095:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071478.035154:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071478.035219:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071478.035332:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692855808 00000100:00100000:2.0:1783071478.035345:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692855808 00000100:00100000:2.0:1783071478.035469:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692855680 00000100:00100000:2.0:1783071478.035473:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692855680 00000100:00100000:2.0:1783071478.035501:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 238 00000100:00100000:2.0:1783071478.035513:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+5:2403:x1869685692855808:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1783071478.035627:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+5:2403:x1869685692855808:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 116us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071478.035635:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 238 00000100:00100000:2.0:1783071478.035655:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 239 00000100:00100000:2.0:1783071478.035662:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+5:2403:x1869685692855680:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1783071478.035690:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+5:2403:x1869685692855680:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 29us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071478.035698:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 239 00000100:00100000:1.0:1783071478.035862:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692855552 00000100:00100000:1.0:1783071478.035868:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692855552 00000100:00100000:1.0:1783071478.035919:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 371 00000100:00100000:1.0:1783071478.035926:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18684050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:2403:x1869685692855552:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1783071478.035956:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18684050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:2403:x1869685692855552:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 32us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071478.035963:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 371 00000100:00080000:0.0:1783071478.036298:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783071478.036305:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783071478.054775:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071478.054907:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692856064 00000100:00100000:2.0:1783071478.054925:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692856064 00000100:00100000:2.0:1783071478.055033:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 240 00000100:00100000:2.0:1783071478.055047:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37a63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2404:x1869685692856064:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1783071478.055197:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37a63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2404:x1869685692856064:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 142us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071478.055207:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 240 00000100:00080000:0.0:1783071478.055929:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783071478.069974:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071478.070024:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071478.070133:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692855936 00000100:00100000:2.0:1783071478.070166:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692855936 00000100:00080000:0.0:1783071478.070639:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783071478.070687:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 27 00000100:00100000:2.0:1783071478.070702:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf7532e4-6153-424a-9f4e-84941256b41f+5:2402:x1869685692855936:12345-192.168.204.38@tcp:9:kworker.0 00000020:00000080:2.0:1783071478.070743:0:8431:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6b58994c2cbdc200 00000100:00080000:2.0:1783071478.070756:0:8431:0:(import.c:65:import_set_state_nolock()) ffff8f8a038e0000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783071478.070826:0:8431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:2.0:1783071478.071042:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf7532e4-6153-424a-9f4e-84941256b41f+2:2402:x1869685692855936:12345-192.168.204.38@tcp:9:kworker.0 Request processed in 343us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071478.071051:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 27 00010000:00010000:0.0:1783071478.071308:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071478.073022:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692856192 00000100:00100000:3.0:1783071478.073043:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692856192 00000100:00100000:3.0:1783071478.073177:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 241 00000100:00100000:3.0:1783071478.073210:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2403:x1869685692856192:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1783071478.073311:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2403:x1869685692856192:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 107us (3352us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071478.073319:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 241 00000100:00080000:0.0:1783071478.076252:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1783071479.042653:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071479.621561:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c5af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869685707624960:0@lo:400:kworker.0 00000100:00100000:0.0:1783071479.621634:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c5ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869685707624704:0@lo:400:kworker.0 00000100:00100000:0.0:1783071479.621727:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071479.621803:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a021ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1869685707625216:0@lo:400:kworker.0 00000100:00100000:0.0:1783071479.621823:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071479.622072:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c5ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:feaa1501-b927-4e07-baad-3200e92d7497:3645:1869685707624576:0@lo:400:kworker.0 00000100:00100000:3.0:1783071479.622099:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c5aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707624832:0@lo:400:kworker.0 00000100:00100000:2.0:1783071479.622116:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071479.622146:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071479.622164:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3b4dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707625088:0@lo:400:kworker.0 00000100:00100000:3.0:1783071479.622185:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a021edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1869685707625344:0@lo:400:kworker.0 00000100:00100000:2.0:1783071479.622194:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071479.622217:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a021ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707625600:0@lo:400:kworker.0 00000100:00100000:3.0:1783071479.622228:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707624832 00000100:00100000:3.0:1783071479.622238:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707624832 00000100:00100000:2.0:1783071479.622246:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071479.622261:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a021ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707626112:0@lo:400:kworker.0 00000100:00100000:2.0:1783071479.622280:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071479.622310:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707625088 00000100:00100000:3.0:1783071479.622314:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707625088 00000100:00100000:3.0:1783071479.622332:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1783071479.622345:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37a61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707624832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071479.622360:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707624576 00000100:00100000:1.0:1783071479.622389:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707624576 00000100:00100000:1.0:1783071479.622426:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1783071479.622433:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18684450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+24:3645:x1869685707624576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071479.622473:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18684450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+24:3645:x1869685707624576:12345-0@lo:400:kworker.0 Request processed in 41us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071479.622480:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1783071479.622516:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1783071479.622522:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707625088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071479.622549:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707625088:12345-0@lo:400:kworker.0 Request processed in 27us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071479.622555:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1783071479.622572:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707625600 00000100:00100000:1.0:1783071479.622575:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707625600 00000100:00100000:1.0:1783071479.622619:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707626112 00000100:00100000:1.0:1783071479.622622:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707626112 00000100:00100000:1.0:1783071479.622638:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1783071479.622643:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707625600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071479.622687:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707625600:12345-0@lo:400:kworker.0 Request processed in 45us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071479.622694:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1783071479.622703:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1783071479.622708:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707626112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071479.622728:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707626112:12345-0@lo:400:kworker.0 Request processed in 20us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071479.622733:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:1.0:1783071479.622754:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783071479.622758:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783071479.623673:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37a61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707624832:12345-0@lo:400:kworker.0 Request processed in 1319us (1518us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071479.623699:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1783071479.623792:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c5ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:feaa1501-b927-4e07-baad-3200e92d7497:3645:1869685707624576:0@lo:400:kworker.0 00000100:00100000:3.0:1783071479.623809:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3b4dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707625088:0@lo:400:kworker.0 00000100:00100000:3.0:1783071479.623821:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a021ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707625600:0@lo:400:kworker.0 00010000:00080000:3.0:1783071479.623836:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a021ed180 x1869685707626112/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071479.623847:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a021ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707626112:0@lo:400:kworker.0 00000100:00100000:2.0:1783071479.624902:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707624704 00000100:00100000:3.0:1783071479.624915:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707625216 00000100:00100000:2.0:1783071479.624918:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707624704 00000100:00100000:3.0:1783071479.624921:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707625216 00000100:00100000:2.0:1783071479.624977:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1783071479.624985:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869685707624704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071479.625096:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1783071479.625104:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869685707625216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071479.625315:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071479.625358:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a021ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1869685707625856:0@lo:400:kworker.0 00000100:00100000:1.0:1783071479.625432:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071479.625473:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c5aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707624832:0@lo:400:kworker.0 00000100:00100000:1.0:1783071479.625507:0:6517:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1783071479.625518:0:6517:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:0.0:1783071479.626020:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a021ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1869685707625728:0@lo:400:kworker.0 00000100:00100000:0.0:1783071479.626061:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071479.626073:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b0ab61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707626240:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783071479.626101:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071479.626262:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071479.626286:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a021ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707625472:0@lo:400:kworker.0 00000100:00100000:1.0:1783071479.626326:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071479.626347:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a021eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707625984:0@lo:400:kworker.0 00000100:00100000:1.0:1783071479.626392:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071479.626429:0:8910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707625472 00000100:00100000:1.0:1783071479.626435:0:8910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707625472 00000100:00100000:1.0:1783071479.626478:0:8910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707625984 00000100:00100000:1.0:1783071479.626481:0:8910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707625984 00000100:00100000:1.0:1783071479.626503:0:8910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1783071479.626510:0:8910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c68e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707625472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071479.626664:0:8910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c68e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707625472:12345-0@lo:400:kworker.0 Request processed in 154us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071479.626672:0:8910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1783071479.626691:0:8910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1783071479.626698:0:8910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c68f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707625984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071479.626728:0:8910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c68f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707625984:12345-0@lo:400:kworker.0 Request processed in 31us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071479.626734:0:8910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1783071479.626950:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a021ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707625472:0@lo:400:kworker.0 00010000:00080000:1.0:1783071479.626967:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a021eca80 x1869685707625984/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071479.626979:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a021eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707625984:0@lo:400:kworker.0 00000100:00100000:1.0:1783071479.627150:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707625344 00000100:00100000:1.0:1783071479.627164:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707625344 00000100:00100000:1.0:1783071479.627195:0:6517:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1783071479.627202:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707625856 00000100:00100000:1.0:1783071479.627205:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707625856 00000100:00100000:1.0:1783071479.627221:0:6517:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1783071479.627225:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707625728 00000100:00100000:1.0:1783071479.627227:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707625728 00000100:00100000:1.0:1783071479.627239:0:6517:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1783071479.627243:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707624960 00000100:00100000:1.0:1783071479.627245:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707624960 00000100:00100000:1.0:1783071479.627254:0:6517:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1783071479.627260:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1783071479.627267:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03904e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869685707625344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071479.627316:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03904e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869685707625344:12345-0@lo:400:kworker.0 Request processed in 49us (2001us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071479.627332:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1783071479.627346:0:6517:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1783071479.627351:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1783071479.627356:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03906d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869685707625856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071479.627410:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03906d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869685707625856:12345-0@lo:400:kworker.0 Request processed in 53us (1977us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071479.627416:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1783071479.627426:0:6517:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1783071479.627431:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1783071479.627437:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869685707625728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071479.628982:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707626240 00000100:00100000:0.0:1783071479.628998:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707626240 00000100:00100000:0.0:1783071479.629079:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1783071479.629089:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707626240:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783071479.629272:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1783071479.629397:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707626240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 310us (3295us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071479.629405:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1783071479.629481:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b0ab61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707626240:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783071479.630140:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869685707624704:12345-0@lo:400:kworker.0 Request processed in 5150us (8408us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071479.630162:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1783071479.630189:0:6518:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1783071479.630199:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1783071479.630227:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c68c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869685707624960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071479.630286:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c68c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869685707624960:12345-0@lo:400:kworker.0 Request processed in 61us (4024us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071479.630293:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1783071479.630337:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c5af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869685707624960:0@lo:400:kworker.0 00000100:00100000:3.0:1783071479.630396:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869685707625216:12345-0@lo:400:kworker.0 Request processed in 5289us (8567us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071479.630408:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:2.0:1783071479.630411:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783071479.630421:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783071479.630426:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783071479.630430:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783071479.630937:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c5ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869685707624704:0@lo:400:kworker.0 00000100:00100000:0.0:1783071479.630967:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a021ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1869685707625216:0@lo:400:kworker.0 00010000:00080000:3.0:1783071479.631340:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a021edf80 x1869685707625344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071479.631355:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a021edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1869685707625344:0@lo:400:kworker.0 00010000:00080000:3.0:1783071479.631400:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a021ec700 x1869685707625856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071479.631412:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a021ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1869685707625856:0@lo:400:kworker.0 00000100:00100000:1.0:1783071479.631835:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869685707625728:12345-0@lo:400:kworker.0 Request processed in 4393us (5769us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071479.631847:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1783071479.632020:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a021ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1869685707625728:0@lo:400:kworker.0 00010000:00010000:3.0:1783071480.069547:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071480.131622:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707626368:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783071480.131844:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071480.134263:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707626368 00000100:00100000:1.0:1783071480.134282:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707626368 00000100:00100000:1.0:1783071480.134351:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1783071480.134391:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707626368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783071480.134443:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783071480.134542:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707626368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 181us (2700us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071480.134551:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00010000:00080000:1.0:1783071480.134709:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a032c8700 x1869685707626368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071496 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071480.134734:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707626368:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783071480.134758:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783071480.134779:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c68dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707626496:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783071480.134826:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071480.134868:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c68c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707626624:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783071480.134895:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071480.134923:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783071480.134929:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0178d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707626752:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783071480.134951:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071480.134977:0:12254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707626496 00000100:00100000:1.0:1783071480.134981:0:12254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707626496 00000100:00100000:1.0:1783071480.134998:0:12254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707626624 00000100:00100000:1.0:1783071480.135001:0:12254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707626624 00000100:00100000:1.0:1783071480.135011:0:12254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707626752 00000100:00100000:1.0:1783071480.135013:0:12254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707626752 00000100:00100000:1.0:1783071480.135026:0:12254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1783071480.135033:0:12254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0178c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707626496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783071480.135056:0:12254:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783071480.135093:0:12254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0178c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707626496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071480.135099:0:12254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1783071480.135112:0:12254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1783071480.135118:0:12254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0178e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707626624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783071480.135130:0:12254:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783071480.135170:0:12254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0178e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707626624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071480.135176:0:12254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1783071480.135187:0:12254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1783071480.135193:0:12254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0178c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707626752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783071480.135212:0:12254:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783071480.135236:0:12254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0178c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707626752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071480.135243:0:12254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1783071480.135275:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0178d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707626752:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1783071480.135286:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c68c700 x1869685707626624/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071496 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071480.135296:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c68c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707626624:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783071480.135328:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c68dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707626496:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1783071481.033221:0:13796:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1783071481.096271:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783071481.099920:0:13798:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1783071481.155781:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783071481.155812:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a021ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707626880:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783071481.155912:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071481.155991:0:9413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707626880 00000100:00100000:3.0:1783071481.156001:0:9413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707626880 00000100:00100000:3.0:1783071481.156060:0:9413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1783071481.156070:0:9413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a021ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707626880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783071481.156118:0:9413:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783071481.156193:0:9413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a021ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707626880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 123us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071481.156215:0:9413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1783071481.156285:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a021ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707626880:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1783071482.117940:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071483.138832:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071483.156218:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071483.156494:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071483.156710:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071483.156734:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071483.156832:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692856448 00000100:00100000:0.0:1783071483.156845:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692856448 00000100:00100000:0.0:1783071483.156926:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692856704 00000100:00100000:0.0:1783071483.156930:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692856704 00000100:00100000:0.0:1783071483.156961:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 248 00000100:00100000:0.0:1783071483.156973:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0178d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+5:2403:x1869685692856448:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1783071483.157084:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0178d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+5:2403:x1869685692856448:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 113us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071483.157105:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 248 00000100:00100000:0.0:1783071483.157129:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 249 00000100:00100000:0.0:1783071483.157138:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0178fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2403:x1869685692856704:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1783071483.157164:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0178fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2403:x1869685692856704:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 28us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071483.157170:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 249 00000100:00100000:1.0:1783071483.157649:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071483.158006:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692856320 00000100:00100000:1.0:1783071483.158013:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692856320 00000100:00100000:1.0:1783071483.158055:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 373 00000100:00100000:1.0:1783071483.158064:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18687050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:2403:x1869685692856320:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1783071483.158121:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18687050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:2403:x1869685692856320:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 59us (1412us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071483.158128:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 373 00000100:00100000:0.0:1783071483.158213:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692856576 00000100:00100000:0.0:1783071483.158218:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692856576 00000100:00100000:0.0:1783071483.158488:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692856832 00000100:00100000:0.0:1783071483.158492:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692856832 00000100:00100000:1.0:1783071483.158547:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 250 00000100:00100000:1.0:1783071483.158556:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0178ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+5:2403:x1869685692856576:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1783071483.158597:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0178ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+5:2403:x1869685692856576:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 42us (1862us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071483.158613:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 250 00000100:00100000:1.0:1783071483.158630:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 251 00000100:00100000:1.0:1783071483.158636:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0178ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2403:x1869685692856832:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1783071483.158666:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0178ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2403:x1869685692856832:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 29us (1018us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071483.158672:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 251 00000100:00080000:2.0:1783071483.158766:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783071483.158773:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783071484.165910:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783071484.241594:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bf7532e4-6153-424a-9f4e-84941256b41f 00000020:00000080:2.0:1783071484.241606:0:8425:0:(genops.c:906:class_export_put()) final put ffff8f8a038e1000/bf7532e4-6153-424a-9f4e-84941256b41f 00000020:00000080:0.0:1783071484.241789:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8a038e1000/bf7532e4-6153-424a-9f4e-84941256b41f for lustre-OST0000 00000020:00000080:0.0:1783071484.242290:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f8a038e0000 for lustre-OST0000 00000100:00100000:3.0:1783071484.739527:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:feaa1501-b927-4e07-baad-3200e92d7497:3648:1869685707627008:0@lo:400:kworker.0 00000100:00100000:3.0:1783071484.739613:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071484.739744:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707627008 00000100:00100000:0.0:1783071484.739755:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707627008 00000100:00100000:0.0:1783071484.739815:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1783071484.739826:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18686450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+24:3648:x1869685707627008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071484.741549:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0178d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707627520:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783071484.741616:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071484.742543:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18686450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+24:3648:x1869685707627008:12345-0@lo:400:kworker.0 Request processed in 2714us (2924us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071484.742556:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1783071484.742644:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707627520 00000100:00100000:0.0:1783071484.742654:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707627520 00000100:00100000:0.0:1783071484.742703:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1783071484.742711:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a021ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707627520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783071484.742745:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1783071484.742796:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a021ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707627520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (1179us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071484.742802:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1783071484.742849:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869685707627136:0@lo:400:kworker.0 00000100:00100000:0.0:1783071484.742885:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071484.742914:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783071484.742921:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707627264:0@lo:400:kworker.0 00000100:00100000:0.0:1783071484.742944:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071484.742972:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869685707627392:0@lo:400:kworker.0 00000100:00100000:0.0:1783071484.742994:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071484.743023:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707627264 00000100:00100000:0.0:1783071484.743027:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707627264 00000100:00100000:0.0:1783071484.743054:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1783071484.743072:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707627264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071484.743108:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707627264:12345-0@lo:400:kworker.0 Request processed in 37us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071484.743119:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1783071484.743165:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707627264:0@lo:400:kworker.0 00000100:00100000:0.0:1783071484.743216:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707627136 00000100:00100000:0.0:1783071484.743220:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707627136 00000100:00100000:0.0:1783071484.744519:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707627392 00000100:00100000:0.0:1783071484.744528:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707627392 00000100:00100000:0.0:1783071484.744556:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1783071484.744565:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1869685707627136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071484.744755:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1869685707627136:12345-0@lo:400:kworker.0 Request processed in 190us (1869us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071484.744763:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1783071484.744781:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1783071484.744789:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869685707627392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071484.744827:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869685707627392:12345-0@lo:400:kworker.0 Request processed in 40us (1831us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071484.744833:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1783071484.744882:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869685707627392:0@lo:400:kworker.0 00000100:00100000:0.0:1783071484.744915:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869685707627136:0@lo:400:kworker.0 00000100:00100000:2.0:1783071484.745193:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1869685707627904:0@lo:400:kworker.0 00000100:00100000:2.0:1783071484.745378:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071484.745405:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1869685707628416:0@lo:400:kworker.0 00000100:00100000:2.0:1783071484.745429:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071484.745448:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1783071484.745455:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707628032:0@lo:400:kworker.0 00000100:00100000:2.0:1783071484.745481:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071484.745582:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707628544:0@lo:400:kworker.0 00000100:00100000:2.0:1783071484.745606:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071484.745708:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707627904 00000100:00100000:2.0:1783071484.745714:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707627904 00000100:00100000:2.0:1783071484.745767:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707628416 00000100:00100000:2.0:1783071484.745771:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707628416 00000100:00100000:2.0:1783071484.745793:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1783071484.745800:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c78fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869685707627904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071484.745843:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c78fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869685707627904:12345-0@lo:400:kworker.0 Request processed in 43us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071484.745849:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1783071484.745863:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1783071484.745868:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c78c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869685707628416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071484.745896:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c78c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869685707628416:12345-0@lo:400:kworker.0 Request processed in 27us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071484.745902:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1783071484.745922:0:8910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707628032 00000100:00100000:2.0:1783071484.745926:0:8910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707628032 00000100:00100000:2.0:1783071484.745960:0:8910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707628544 00000100:00100000:2.0:1783071484.745963:0:8910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707628544 00000100:00100000:2.0:1783071484.745984:0:8910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1783071484.745991:0:8910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c78df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707628032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071484.746021:0:8910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c78df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707628032:12345-0@lo:400:kworker.0 Request processed in 31us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071484.746028:0:8910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1783071484.746039:0:8910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1783071484.746045:0:8910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c78e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707628544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071484.746082:0:8910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c78e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707628544:12345-0@lo:400:kworker.0 Request processed in 38us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071484.746088:0:8910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:2.0:1783071484.746107:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783071484.746118:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783071484.746121:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783071484.746421:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707628032:0@lo:400:kworker.0 00010000:00080000:2.0:1783071484.746435:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a032ca680 x1869685707628544/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071484.746446:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707628544:0@lo:400:kworker.0 00010000:00080000:2.0:1783071484.746457:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a032cb100 x1869685707627904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071484.746466:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1869685707627904:0@lo:400:kworker.0 00010000:00080000:2.0:1783071484.746477:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a032c8a80 x1869685707628416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071484.746604:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1869685707627776:0@lo:400:kworker.0 00000100:00100000:0.0:1783071484.746652:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071484.746673:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1869685707628288:0@lo:400:kworker.0 00000100:00100000:0.0:1783071484.746696:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071484.746717:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1783071484.746724:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707627648:0@lo:400:kworker.0 00000100:00100000:0.0:1783071484.746748:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071484.746768:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707628160:0@lo:400:kworker.0 00000100:00100000:0.0:1783071484.746802:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071484.746819:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707628672:0@lo:400:kworker.0 00000100:00100000:0.0:1783071484.746839:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071484.746865:0:9413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707627648 00000100:00100000:0.0:1783071484.746869:0:9413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707627648 00000100:00100000:0.0:1783071484.746898:0:9413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1783071484.746905:0:9413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c685f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707627648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071484.746945:0:9413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c685f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707627648:12345-0@lo:400:kworker.0 Request processed in 41us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071484.746951:0:9413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1783071484.746980:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707627648:0@lo:400:kworker.0 00000100:00100000:2.0:1783071484.747079:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1869685707628416:0@lo:400:kworker.0 00000100:00100000:2.0:1783071484.747108:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707627776 00000100:00100000:2.0:1783071484.747112:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707627776 00000100:00100000:2.0:1783071484.747221:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707628288 00000100:00100000:2.0:1783071484.747224:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707628288 00000100:00100000:1.0:1783071484.747328:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1783071484.747339:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869685707627776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071484.747401:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869685707627776:12345-0@lo:400:kworker.0 Request processed in 65us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071484.747407:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1783071484.747597:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:feaa1501-b927-4e07-baad-3200e92d7497:3648:1869685707627008:0@lo:400:kworker.0 00000100:00100000:3.0:1783071484.747696:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0178d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707627520:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783071484.747726:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707628160 00000100:00100000:3.0:1783071484.747729:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707628160 00000100:00100000:3.0:1783071484.747754:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707628672 00000100:00100000:3.0:1783071484.747764:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707628672 00000100:00100000:3.0:1783071484.747789:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1783071484.747795:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c685c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707628160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071484.747829:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c685c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707628160:12345-0@lo:400:kworker.0 Request processed in 34us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071484.747836:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1783071484.747846:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1783071484.747852:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c684700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707628672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071484.747878:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c684700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707628672:12345-0@lo:400:kworker.0 Request processed in 26us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071484.747884:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1783071484.747967:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1783071484.747974:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c685500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869685707628288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071484.748007:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c685500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869685707628288:12345-0@lo:400:kworker.0 Request processed in 34us (1310us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071484.748013:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00080000:0.0:1783071484.748124:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783071484.748128:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783071484.748131:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783071484.748217:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707628160:0@lo:400:kworker.0 00010000:00080000:0.0:1783071484.748304:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a032c8700 x1869685707628672/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071484.748327:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707628672:0@lo:400:kworker.0 00000100:00100000:0.0:1783071484.748343:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1869685707627776:0@lo:400:kworker.0 00000100:00100000:0.0:1783071484.748354:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1869685707628288:0@lo:400:kworker.0 00010000:00010000:3.0:1783071485.187296:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071485.254542:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707628928:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783071485.254641:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071485.254735:0:12254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707628928 00000100:00100000:2.0:1783071485.254742:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783071485.254746:0:12254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707628928 00000100:00100000:2.0:1783071485.254752:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a021ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707629056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783071485.254794:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071485.254905:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a021edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707628800:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783071485.254937:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071485.259119:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c685180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707629184:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783071485.266310:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071485.267012:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707629056 00000100:00100000:1.0:1783071485.267028:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707629056 00000100:00100000:1.0:1783071485.267101:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707628800 00000100:00100000:1.0:1783071485.267106:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707628800 00000100:00100000:1.0:1783071485.267126:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1783071485.267140:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c78f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707628928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783071485.267197:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783071485.269009:0:12254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1783071485.269033:0:12254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c78f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707629056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783071485.269078:0:12254:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783071485.269213:0:12254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c78f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707629056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 190us (14417us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071485.269223:0:12254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1783071485.269251:0:12254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1783071485.269260:0:12254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c686d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707628800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783071485.269282:0:12254:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783071485.269325:0:12254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c686d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707628800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (14386us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071485.269332:0:12254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00010000:00080000:3.0:1783071485.270238:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a021ed500 x1869685707629056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071501 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071485.270269:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a021ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707629056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783071485.270701:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c78f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707628928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3561us (16056us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071485.270711:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1783071485.270738:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707629184 00000100:00100000:1.0:1783071485.270747:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707629184 00000100:00100000:1.0:1783071485.270800:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1783071485.270829:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c686680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707629184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783071485.270867:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783071485.270915:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c686680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707629184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (4614us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071485.270922:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:3.0:1783071485.271197:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c78d880 x1869685707628928/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071501 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071485.271218:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707628928:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783071485.271647:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c685180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707629184:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783071485.272089:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a021edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707628800:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1783071485.797906:0:14057:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 05:38:05 (1783071485) 00010000:00010000:3.0:1783071486.210741:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071486.274771:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783071486.274796:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a021ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707629312:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783071486.274871:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071486.275500:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707629312 00000100:00100000:3.0:1783071486.275509:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707629312 00000100:00100000:3.0:1783071486.275624:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1783071486.275635:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0178f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707629312:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783071486.275671:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783071486.275953:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0178f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707629312:12345-0@lo:41:osp-pre-1-0.0 Request processed in 319us (1081us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071486.275961:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1783071486.276066:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a021ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707629312:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1783071487.235862:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071487.461305:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071487.461421:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692856960 00000100:00100000:1.0:1783071487.461449:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692856960 00000100:00100000:1.0:1783071487.461563:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 40 00000100:00100000:1.0:1783071487.461576:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a021eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+5:11095:x1869685692856960:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783071487.461608:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071487.461632:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748600/0x6b58994c2cbdc2e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98d79 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071487.461719:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdc2e7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071487.461734:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdc2e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071487.461745:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdc2e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783071487.462133:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1783071487.462138:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783071487.462193:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdc2e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071487.462224:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748600/0x6b58994c2cbdc2e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d79 expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071487.462245:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdc2e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d79 expref: 6 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071487.462255:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8b0a52e300) 00010000:00010000:1.0:1783071487.462258:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783071487.462262:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a01749c00, rc 0) 00000100:00100000:1.0:1783071487.462536:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a021eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+6:11095:x1869685692856960:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 961us (1244us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071487.462544:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 40 00000100:00080000:0.0:1783071487.463196:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783071487.476583:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071487.480913:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692857088 00000100:00100000:3.0:1783071487.480936:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692857088 00000100:00100000:3.0:1783071487.481104:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 41 00000100:00100000:3.0:1783071487.481118:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c685880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+6:11096:x1869685692857088:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783071487.481140:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071487.481162:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdc2ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98d80 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071487.481241:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdc2f5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071487.481270:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdc2f5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071487.481283:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdc2f5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071487.481301:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9e00/0x6b58994c2cbdc2fc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071487.481319:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9e00/0x6b58994c2cbdc2fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071487.481327:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9e00/0x6b58994c2cbdc2fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071487.481421:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9a00/0x6b58994c2cbdc303 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071487.481430:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9a00/0x6b58994c2cbdc303 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071487.481438:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9a00/0x6b58994c2cbdc303 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783071487.481494:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783071487.481499:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783071487.481522:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9a00/0x6b58994c2cbdc303 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071487.481535:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdc2f5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071487.481550:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdc2f5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071487.481566:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdc2f5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071487.481573:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b014b9000 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071487.481577:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdc2f5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071487.481585:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdc2f5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071487.481598:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8b0a52e300) 00010000:00010000:3.0:1783071487.481602:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071487.481607:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdc2f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071487.481613:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdc2f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071487.481628:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9e00/0x6b58994c2cbdc2fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071487.481634:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9e00/0x6b58994c2cbdc2fc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071487.481640:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9e00/0x6b58994c2cbdc2fc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071487.481645:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b014b9e00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071487.481654:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9e00/0x6b58994c2cbdc2fc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071487.481661:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9e00/0x6b58994c2cbdc2fc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071487.481669:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8f8a0179f500) 00010000:00010000:3.0:1783071487.481671:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071487.481675:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9e00/0x6b58994c2cbdc2fc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071487.481680:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9e00/0x6b58994c2cbdc2fc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071487.481710:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdc2ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d80 expref: 8 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071487.481723:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9a00/0x6b58994c2cbdc303 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d80 expref: 7 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071487.481730:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8f8a0179f000) 00010000:00010000:3.0:1783071487.481732:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783071487.481734:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b014b9a00, rc 0) 00000100:00100000:3.0:1783071487.481816:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c685880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+7:11096:x1869685692857088:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 701us (5394us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071487.481823:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 41 00000100:00100000:3.0:1783071487.492090:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071487.492207:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692857216 00000100:00100000:0.0:1783071487.492220:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692857216 00000100:00100000:0.0:1783071487.492293:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 7 00000100:00100000:0.0:1783071487.492305:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a021ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:bf7532e4-6153-424a-9f4e-84941256b41f+7:11096:x1869685692857216:12345-192.168.204.38@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1783071487.492455:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a021ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:bf7532e4-6153-424a-9f4e-84941256b41f+7:11096:x1869685692857216:12345-192.168.204.38@tcp:900:lhsmtool_posix.0 Request processed in 151us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071487.492472:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 7 00000100:00100000:1.0:1783071487.509408:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071487.511265:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692857472 00000100:00100000:3.0:1783071487.511293:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692857472 00000100:00100000:3.0:1783071487.511484:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 42 00000100:00100000:3.0:1783071487.511522:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0178ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+7:11096:x1869685692857472:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783071487.511555:0:13815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071487.511586:0:13815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdc30a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98d87 expref: -99 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071487.511692:0:13815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9e00/0x6b58994c2cbdc311 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071487.511711:0:13815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9e00/0x6b58994c2cbdc311 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071487.511725:0:13815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9e00/0x6b58994c2cbdc311 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071487.515452:0:13815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdc318 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071487.515481:0:13815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdc318 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071487.515495:0:13815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdc318 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071487.515697:0:13815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67800/0x6b58994c2cbdc31f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071487.515706:0:13815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67800/0x6b58994c2cbdc31f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071487.515713:0:13815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67800/0x6b58994c2cbdc31f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071487.515727:0:13815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1783071487.517124:0:13815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9e00/0x6b58994c2cbdc311 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071487.517152:0:13815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9e00/0x6b58994c2cbdc311 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071487.517285:0:13815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9e00/0x6b58994c2cbdc311 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071487.517294:0:13815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b014b9e00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:2.0:1783071487.517300:0:13815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9e00/0x6b58994c2cbdc311 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071487.517340:0:13815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9e00/0x6b58994c2cbdc311 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071487.517464:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8f8a0179f000) 00010000:00010000:2.0:1783071487.517468:0:13815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071487.517476:0:13815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9e00/0x6b58994c2cbdc311 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071487.517483:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9e00/0x6b58994c2cbdc311 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071487.517511:0:13815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdc318 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071487.517516:0:13815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdc318 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071487.517522:0:13815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdc318 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071487.517527:0:13815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd67400 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:2.0:1783071487.517530:0:13815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdc318 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071487.517535:0:13815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdc318 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071487.517544:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8f8b0d17f500) 00010000:00010000:2.0:1783071487.517546:0:13815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071487.517549:0:13815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdc318 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071487.517567:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdc318 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071487.519975:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdc30a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d87 expref: 10 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071487.520022:0:13815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67800/0x6b58994c2cbdc31f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d87 expref: 9 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071487.520034:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f8b0d17fa00) 00010000:00010000:2.0:1783071487.520037:0:13815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071487.520041:0:13815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b2fd67800, rc 0) 00000100:00100000:2.0:1783071487.520150:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0178ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+9:11096:x1869685692857472:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 8630us (10788us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1783071487.520172:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 42 00000100:00100000:1.0:1783071487.532714:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071487.533090:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692857600 00000100:00100000:0.0:1783071487.533103:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692857600 00000100:00100000:0.0:1783071487.533705:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 43 00000100:00100000:0.0:1783071487.533733:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0178d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+9:11096:x1869685692857600:12345-192.168.204.38@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1783071487.533902:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0178d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+9:11096:x1869685692857600:12345-192.168.204.38@tcp:59:lhsmtool_posix.0 Request processed in 174us (1203us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071487.533911:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 43 00000100:00100000:3.0:1783071487.548278:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071487.549048:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692857728 00000100:00100000:2.0:1783071487.549067:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692857728 00000100:00100000:2.0:1783071487.549176:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 44 00000100:00100000:2.0:1783071487.549191:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a021ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+5:11096:x1869685692857728:12345-192.168.204.38@tcp:59:lhsmtool_posix.0 00000100:00080000:0.0:1783071487.551530:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:3.0:1783071487.556804:0:6517:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 7538us 00000100:00100000:2.0:1783071487.590123:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a021ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+5:11096:x1869685692857728:12345-192.168.204.38@tcp:59:lhsmtool_posix.0 Request processed in 40926us (41854us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071487.590139:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 44 00000040:00080000:3.0:1783071488.198462:0:13796:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1783071488.260558:0:13798:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1783071488.261086:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071488.275897:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071488.275964:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071488.276077:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071488.276081:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692857856 00000100:00100000:3.0:1783071488.276094:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692857856 00000100:00100000:1.0:1783071488.276107:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071488.276130:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071488.276154:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692858112 00000100:00100000:1.0:1783071488.276157:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692858112 00000100:00100000:3.0:1783071488.276160:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 375 00000100:00100000:3.0:1783071488.276171:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18685c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:2405:x1869685692857856:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1783071488.276191:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692858368 00000100:00100000:1.0:1783071488.276194:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692858368 00000100:00100000:1.0:1783071488.276217:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692857984 00000100:00100000:1.0:1783071488.276219:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692857984 00000100:00100000:1.0:1783071488.276245:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692858240 00000100:00100000:1.0:1783071488.276248:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692858240 00000100:00100000:1.0:1783071488.276262:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 258 00000100:00100000:1.0:1783071488.276269:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c68dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+5:2405:x1869685692858112:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1783071488.276272:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18685c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:2405:x1869685692857856:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 103us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071488.276279:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 375 00000100:00100000:1.0:1783071488.276304:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c68dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+5:2405:x1869685692858112:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 36us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071488.276310:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 258 00000100:00100000:1.0:1783071488.276324:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 259 00000100:00100000:1.0:1783071488.276329:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c68c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2405:x1869685692858368:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1783071488.276352:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c68c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2405:x1869685692858368:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 23us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071488.276358:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 259 00000100:00100000:1.0:1783071488.276484:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 260 00000100:00100000:1.0:1783071488.276491:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+9:2405:x1869685692857984:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1783071488.276535:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+9:2405:x1869685692857984:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 44us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071488.276542:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 260 00000100:00100000:1.0:1783071488.276556:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 261 00000100:00100000:1.0:1783071488.276562:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2405:x1869685692858240:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1783071488.276840:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2405:x1869685692858240:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 276us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071488.276847:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 261 00000100:00080000:0.0:1783071488.277273:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783071488.277281:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1783071489.284637:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071489.600561:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071489.600823:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692858496 00000100:00100000:1.0:1783071489.600837:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692858496 00000100:00100000:1.0:1783071489.601064:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 45 00000100:00100000:1.0:1783071489.601078:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a021ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+9:11139:x1869685692858496:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1783071489.602753:0:13815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:0.0:1783071489.605338:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1783071489.606054:0:13815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdc32d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98d8e expref: -99 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071489.606170:0:13815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc334 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071489.606189:0:13815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc334 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071489.606204:0:13815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc334 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071489.608397:0:13815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc33b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071489.608427:0:13815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc33b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071489.608441:0:13815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc33b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071489.608513:0:13815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc334 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071489.608519:0:13815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc334 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071489.608527:0:13815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc334 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071489.608548:0:13815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01748000 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:1.0:1783071489.608554:0:13815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc334 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071489.608564:0:13815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc334 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071489.608950:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8b0a52e300) 00010000:00010000:1.0:1783071489.608956:0:13815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071489.608973:0:13815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc334 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071489.608981:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc334 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071489.608998:0:13815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc33b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071489.609004:0:13815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc33b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071489.609010:0:13815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc33b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071489.609015:0:13815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01749a00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:1.0:1783071489.609017:0:13815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc33b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071489.609024:0:13815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc33b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071489.609046:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8f8b1011aa00) 00010000:00010000:1.0:1783071489.609049:0:13815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071489.609053:0:13815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc33b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071489.609063:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc33b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071489.609133:0:13815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdc32d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d8e expref: 10 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071489.609145:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8b0a52e300) 00010000:00010000:1.0:1783071489.609148:0:13815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071489.609152:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdc32d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d8e expref: 10 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071489.609164:0:13815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a01749400, rc 0) 00000100:00100000:1.0:1783071489.610589:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a021ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+9:11139:x1869685692858496:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 9500us (10032us total) trans 0 rc 301/301 00000100:00100000:1.0:1783071489.610605:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 45 00000100:00100000:2.0:1783071489.622112:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071489.623215:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692858752 00000100:00100000:3.0:1783071489.623235:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692858752 00000100:00100000:3.0:1783071489.623359:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 46 00000100:00100000:3.0:1783071489.623396:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c78d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+9:11139:x1869685692858752:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:3.0:1783071489.623477:0:10292:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071489.623512:0:10292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdc2e7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d79 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071489.623535:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8b0a52e300) 00010000:00010000:3.0:1783071489.623550:0:10292:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783071489.623643:0:10292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8200/0x6b58994c2cbdc342 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071489.623660:0:10292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8200/0x6b58994c2cbdc342 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071489.623670:0:10292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8200/0x6b58994c2cbdc342 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071489.623682:0:10292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdc349 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071489.623688:0:10292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdc349 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071489.623694:0:10292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdc349 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071489.627947:0:10292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdc350 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071489.628166:0:10292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdc350 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071489.628181:0:10292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdc350 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783071489.628217:0:10292:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fe6c3af6 reply state 000000008bbd4e18 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdc350 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071489.628230:0:10292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdc350 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071489.628239:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f8a0179f400) 00010000:00010000:3.0:1783071489.628242:0:10292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783071489.628246:0:10292:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1783071489.628253:0:10292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1783071489.628262:0:10292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8200/0x6b58994c2cbdc342 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071489.628269:0:10292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8200/0x6b58994c2cbdc342 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071489.628277:0:10292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8200/0x6b58994c2cbdc342 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071489.628283:0:10292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b014b8200 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071489.628287:0:10292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8200/0x6b58994c2cbdc342 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071489.628294:0:10292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8200/0x6b58994c2cbdc342 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071489.628306:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8a0179f500) 00010000:00010000:3.0:1783071489.628308:0:10292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071489.628311:0:10292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8200/0x6b58994c2cbdc342 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071489.628330:0:10292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8200/0x6b58994c2cbdc342 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783071489.628353:0:10292:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fe6c3af6 reply state 000000008bbd4e18 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdc349 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071489.628391:0:10292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdc349 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071489.628397:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8f8a0179fa00) 00010000:00010000:3.0:1783071489.628400:0:10292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783071489.628401:0:10292:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1783071489.628679:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c78d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+10:11139:x1869685692858752:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 5282us (6579us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1783071489.628690:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 46 00000100:00100000:3.0:1783071489.740080:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071489.740115:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692858880 00000100:00100000:2.0:1783071489.740124:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692858880 00000100:00100000:2.0:1783071489.740195:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 47 00000100:00100000:2.0:1783071489.740224:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a021ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+10:11147:x1869685692858880:12345-192.168.204.38@tcp:101:lctl.0 00010000:00010000:2.0:1783071489.740253:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071489.740284:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdc357 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98d95 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071489.740359:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdc35e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071489.740414:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdc35e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071489.740427:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdc35e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071489.740841:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783071489.740847:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783071489.740891:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdc35e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071489.740919:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdc357 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d95 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071489.740935:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdc35e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d95 expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071489.740943:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8a020cad00) 00010000:00010000:2.0:1783071489.740945:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783071489.740949:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b2fd66600, rc 0) 00000100:00100000:2.0:1783071489.741336:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a021ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+11:11147:x1869685692858880:12345-192.168.204.38@tcp:101:lctl.0 Request processed in 1115us (1334us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071489.741355:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 47 00000100:00100000:2.0:1783071489.793137:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071489.795640:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692859008 00000100:00100000:1.0:1783071489.795654:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692859008 00000100:00100000:1.0:1783071489.795765:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 48 00000100:00100000:1.0:1783071489.795775:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3b778e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+11:11153:x1869685692859008:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:1.0:1783071489.795796:0:13815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071489.795815:0:13815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc365 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98d9c expref: -99 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071489.795898:0:13815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc36c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071489.795911:0:13815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc36c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071489.795921:0:13815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc36c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071489.795931:0:13815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc373 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071489.795938:0:13815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc373 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071489.795945:0:13815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc373 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071489.796045:0:13815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748800/0x6b58994c2cbdc37a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071489.796055:0:13815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748800/0x6b58994c2cbdc37a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071489.796062:0:13815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748800/0x6b58994c2cbdc37a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783071489.796101:0:13815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1783071489.796106:0:13815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783071489.796141:0:13815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748800/0x6b58994c2cbdc37a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071489.796165:0:13815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc36c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071489.796171:0:13815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc36c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071489.796177:0:13815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc36c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071489.796183:0:13815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01749000 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:1.0:1783071489.796187:0:13815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc36c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071489.796195:0:13815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc36c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071489.796208:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8a020cad00) 00010000:00010000:1.0:1783071489.796212:0:13815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071489.796217:0:13815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc36c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071489.796223:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc36c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071489.796235:0:13815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc373 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071489.796241:0:13815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc373 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071489.796246:0:13815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc373 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071489.796258:0:13815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01748200 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:1.0:1783071489.796261:0:13815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc373 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071489.796283:0:13815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc373 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071489.796292:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8f8a0179fa00) 00010000:00010000:1.0:1783071489.796294:0:13815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071489.796297:0:13815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc373 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071489.796303:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc373 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071489.796330:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc365 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d9c expref: 13 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071489.796344:0:13815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748800/0x6b58994c2cbdc37a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d9c expref: 12 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071489.796350:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f8a0179f400) 00010000:00010000:1.0:1783071489.796352:0:13815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1783071489.796354:0:13815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a01748800, rc 0) 00000100:00100000:1.0:1783071489.796490:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3b778e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+12:11153:x1869685692859008:12345-192.168.204.38@tcp:101:bash.0 Request processed in 715us (3363us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071489.796499:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 48 00000100:00100000:1.0:1783071489.800503:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071489.808287:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692859264 00000100:00100000:3.0:1783071489.808302:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692859264 00000100:00100000:3.0:1783071489.808398:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 49 00000100:00100000:3.0:1783071489.808409:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+12:11153:x1869685692859264:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:3.0:1783071489.808433:0:10292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071489.808455:0:10292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8200/0x6b58994c2cbdc381 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98da3 expref: -99 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071489.808570:0:10292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9e00/0x6b58994c2cbdc388 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071489.808586:0:10292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9e00/0x6b58994c2cbdc388 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071489.808613:0:10292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9e00/0x6b58994c2cbdc388 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071489.808898:0:10292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8000/0x6b58994c2cbdc38f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071489.808908:0:10292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8000/0x6b58994c2cbdc38f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071489.808915:0:10292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8000/0x6b58994c2cbdc38f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783071489.809421:0:10292:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:3.0:1783071489.809558:0:10292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9400/0x6b58994c2cbdc396 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071489.809568:0:10292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9400/0x6b58994c2cbdc396 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071489.809576:0:10292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9400/0x6b58994c2cbdc396 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071489.809608:0:10292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9e00/0x6b58994c2cbdc388 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071489.809615:0:10292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9e00/0x6b58994c2cbdc388 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071489.809622:0:10292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9e00/0x6b58994c2cbdc388 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071489.809628:0:10292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b014b9e00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071489.809639:0:10292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9e00/0x6b58994c2cbdc388 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071489.809646:0:10292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9e00/0x6b58994c2cbdc388 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071489.809658:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f8a0179f400) 00010000:00010000:3.0:1783071489.809661:0:10292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071489.809666:0:10292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9e00/0x6b58994c2cbdc388 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071489.809673:0:10292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9e00/0x6b58994c2cbdc388 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783071489.809686:0:10292:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cb50f3d4 reply state 00000000b3f359ae transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8000/0x6b58994c2cbdc38f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071489.809697:0:10292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8000/0x6b58994c2cbdc38f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071489.809703:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f8a0179f500) 00010000:00010000:3.0:1783071489.809705:0:10292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783071489.809708:0:10292:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783071489.809741:0:10292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8200/0x6b58994c2cbdc381 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98da3 expref: 15 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071489.809756:0:10292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9400/0x6b58994c2cbdc396 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98da3 expref: 14 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071489.809763:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f8a0179f800) 00010000:00010000:3.0:1783071489.809766:0:10292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783071489.809775:0:10292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b014b9400, rc 0) 00000100:00100000:3.0:1783071489.809921:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+15:11153:x1869685692859264:12345-192.168.204.38@tcp:101:bash.0 Request processed in 1513us (9426us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1783071489.809929:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 49 00000100:00100000:2.0:1783071489.817708:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071489.817928:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692859392 00000100:00100000:3.0:1783071489.817940:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692859392 00000100:00100000:3.0:1783071489.818345:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 28 00000100:00100000:3.0:1783071489.818355:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3b77b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2402:x1869685692859392:12345-192.168.204.38@tcp:8:bash.0 00010000:00080000:2.0:1783071489.821080:0:8431:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from bf7532e4-6153-424a-9f4e-84941256b41f@192.168.204.38@tcp t0 exp 0000000000000000 cur 391 last 0 00000020:00000080:2.0:1783071489.821121:0:8431:0:(genops.c:1406:class_connect()) connect: client bf7532e4-6153-424a-9f4e-84941256b41f, cookie 0x6b58994c2cbdc3a4 00002000:00100000:2.0:1783071489.821136:0:8431:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli bf7532e4-6153-424a-9f4e-84941256b41f/ffff8f8b03273000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783071489.821232:0:8431:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783071489.821322:0:8431:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1783071489.821453:0:8431:0:(import.c:65:import_set_state_nolock()) ffff8f8b03274800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783071489.821708:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3b77b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf7532e4-6153-424a-9f4e-84941256b41f+6:2402:x1869685692859392:12345-192.168.204.38@tcp:8:bash.0 Request processed in 3352us (4009us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071489.821720:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 28 00000100:00100000:2.0:1783071489.824669:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071489.824799:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692859520 00000100:00100000:3.0:1783071489.824808:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692859520 00000100:00100000:3.0:1783071489.824887:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 29 00000100:00100000:3.0:1783071489.824899:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3b77a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf7532e4-6153-424a-9f4e-84941256b41f+6:0:x1869685692859520:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:3.0:1783071489.824916:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071489.824938:0:8429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b46b776/0x6b58994c2cbdc3ab lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98daa expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783071489.824974:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783071489.825000:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=391s v=(0 0) 00010000:00010000:3.0:1783071489.825005:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783071489.825015:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b46b776/0x6b58994c2cbdc3ab lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98daa expref: 7 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071489.825035:0:8429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005b46b776/0x6b58994c2cbdc3ab lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98daa expref: 7 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071489.825156:0:8429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b014b8200, rc 0) 00000100:00100000:3.0:1783071489.825217:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3b77a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf7532e4-6153-424a-9f4e-84941256b41f+7:0:x1869685692859520:12345-192.168.204.38@tcp:101:bash.0 Request processed in 321us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071489.825237:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 29 00000100:00080000:0.0:1783071489.825358:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783071489.830012:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071489.830231:0:8910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692859648 00000100:00100000:2.0:1783071489.830241:0:8910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692859648 00000100:00100000:2.0:1783071489.830313:0:8910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30 00000100:00100000:2.0:1783071489.830325:0:8910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf7532e4-6153-424a-9f4e-84941256b41f+7:11153:x1869685692859648:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:2.0:1783071489.830345:0:8910:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071489.830449:0:8910:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd4b890e/0x6b58994c2cbdc3b2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98db1 expref: -99 pid: 8910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071489.830542:0:8910:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005b46b776/0x6b58994c2cbdc3ab lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98daa expref: 8 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071489.830558:0:8910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783071489.830577:0:8910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783071489.830583:0:8910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd4b890e/0x6b58994c2cbdc3b2 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98db1 expref: 8 pid: 8910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071489.830624:0:8910:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005b46b776/0x6b58994c2cbdc3ab lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98daa expref: 8 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071489.830638:0:8910:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005b46b776/0x6b58994c2cbdc3ab lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98daa expref: 8 pid: 8429 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071489.830653:0:8910:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3b77b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8910:1869685707629440:192.168.204.38@tcp:104: 00000100:00100000:2.0:1783071489.830797:0:8910:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b05e0b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071489.836709:0:8910:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3b77b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8910:1869685707629440:192.168.204.38@tcp:104: 00010000:00010000:3.0:1783071489.836752:0:8910:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bd4b890e/0x6b58994c2cbdc3b2 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98db1 expref: 8 pid: 8910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071489.836774:0:8910:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b2fd66a00, rc 0) 00000100:00100000:3.0:1783071489.836838:0:8910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf7532e4-6153-424a-9f4e-84941256b41f+8:11153:x1869685692859648:12345-192.168.204.38@tcp:101:bash.0 Request processed in 6515us (6837us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071489.836849:0:8910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30 00000100:00100000:3.0:1783071489.841876:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071489.841990:0:7923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692859776 00000100:00100000:0.0:1783071489.842010:0:7923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692859776 00010000:00010000:0.0:1783071489.842067:0:7923:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005b46b776/0x6b58994c2cbdc3ab lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98daa expref: 8 pid: 8429 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071489.842113:0:7923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 52 00000100:00100000:0.0:1783071489.842122:0:7923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab8f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf7532e4-6153-424a-9f4e-84941256b41f+8:2405:x1869685692859776:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783071489.842138:0:7923:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071489.842158:0:7923:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005b46b776/0x6b58994c2cbdc3ab lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98daa expref: 8 pid: 8429 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071489.842182:0:7923:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005b46b776/0x6b58994c2cbdc3ab lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98daa expref: 8 pid: 8429 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071489.842207:0:7923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b46b776/0x6b58994c2cbdc3ab lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98daa expref: 8 pid: 8429 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071489.842223:0:7923:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071489.842227:0:7923:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071489.842235:0:7923:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bd4b890e/0x6b58994c2cbdc3b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98db1 expref: 7 pid: 8910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071489.842244:0:7923:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd4b890e/0x6b58994c2cbdc3b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98db1 expref: 7 pid: 8910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071489.842279:0:7923:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000bd4b890e/0x6b58994c2cbdc3b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98db1 expref: 7 pid: 8910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071489.842306:0:7923:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c686a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7923:1869685707629568:192.168.204.38@tcp:105: 00000100:00100000:0.0:1783071489.842425:0:7923:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a032c0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783071489.852808:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071489.855433:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692860032 00000100:00100000:2.0:1783071489.855450:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692860032 00000100:00100000:2.0:1783071489.855598:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 6 00000100:00100000:2.0:1783071489.855610:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+15:11153:x1869685692860032:12345-192.168.204.38@tcp:35:bash.0 00000100:00100000:2.0:1783071489.855954:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+16:11153:x1869685692860032:12345-192.168.204.38@tcp:35:bash.0 Request processed in 345us (3154us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1783071489.855971:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 6 00000100:00100000:0.0:1783071489.857833:0:7923:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c686a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7923:1869685707629568:192.168.204.38@tcp:105: 00010000:00010000:0.0:1783071489.857862:0:7923:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071489.857954:0:7923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab8f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf7532e4-6153-424a-9f4e-84941256b41f+7:2405:x1869685692859776:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 15832us (16087us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071489.857976:0:7923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 52 00000100:00100000:3.0:1783071489.858590:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c680a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707629696:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783071489.858649:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071489.858738:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707629696 00000100:00100000:1.0:1783071489.858749:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707629696 00000100:00100000:1.0:1783071489.858801:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1783071489.858810:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a021edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707629696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783071489.858845:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00100000:1.0:1783071489.858889:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a021edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707629696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071489.858896:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1783071489.859015:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783071489.859028:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c5ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869685707629952:0@lo:400:kworker.0 00000100:00100000:0.0:1783071489.859085:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3b4dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:feaa1501-b927-4e07-baad-3200e92d7497:3648:1869685707629824:0@lo:400:kworker.0 00000100:00100000:1.0:1783071489.859127:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c680a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707629696:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783071489.861146:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1869685707630464:0@lo:400:kworker.0 00000100:00100000:0.0:1783071489.864125:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071489.864267:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c5ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1869685707630336:0@lo:400:kworker.0 00000100:00100000:0.0:1783071489.864322:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071489.864347:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02c09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1869685707630848:0@lo:400:kworker.0 00000100:00100000:0.0:1783071489.864402:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071489.864422:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1783071489.864430:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c5aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707630208:0@lo:400:kworker.0 00000100:00100000:0.0:1783071489.864457:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071489.864476:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02c08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707630720:0@lo:400:kworker.0 00000100:00100000:0.0:1783071489.864501:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071489.864519:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c689500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707631232:0@lo:400:kworker.0 00000100:00100000:0.0:1783071489.864542:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071489.866178:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707629824 00000100:00100000:3.0:1783071489.866191:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707629824 00000100:00100000:3.0:1783071489.866260:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1783071489.866272:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18686050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+24:3648:x1869685707629824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071489.866304:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071489.866344:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02c0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1869685707630976:0@lo:400:kworker.0 00000100:00100000:3.0:1783071489.866356:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18686050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+24:3648:x1869685707629824:12345-0@lo:400:kworker.0 Request processed in 85us (2238us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071489.866389:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071489.866413:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1783071489.866482:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c5af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869685707630080:0@lo:400:kworker.0 00000100:00100000:1.0:1783071489.866508:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071489.866528:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02c09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707630592:0@lo:400:kworker.0 00000100:00100000:1.0:1783071489.866552:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071489.866569:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c689f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707631104:0@lo:400:kworker.0 00000100:00100000:1.0:1783071489.866588:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071489.866697:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707630720 00000100:00100000:1.0:1783071489.866703:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707630720 00000100:00100000:1.0:1783071489.866736:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707631232 00000100:00100000:1.0:1783071489.866740:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707631232 00000100:00100000:1.0:1783071489.866771:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707630592 00000100:00100000:1.0:1783071489.866774:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707630592 00000100:00100000:1.0:1783071489.866941:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707631104 00000100:00100000:1.0:1783071489.866945:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707631104 00000100:00100000:1.0:1783071489.866974:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1783071489.866981:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03808e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707630720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071489.867021:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03808e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707630720:12345-0@lo:400:kworker.0 Request processed in 40us (2519us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071489.867028:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1783071489.867045:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1783071489.867050:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03809f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707631232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071489.867077:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03809f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707631232:12345-0@lo:400:kworker.0 Request processed in 27us (2534us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071489.867083:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1783071489.867206:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1783071489.867214:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c683b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707630592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071489.867250:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c683b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707630592:12345-0@lo:400:kworker.0 Request processed in 38us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071489.867256:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1783071489.867267:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1783071489.867273:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c681500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707631104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071489.867296:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c681500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707631104:12345-0@lo:400:kworker.0 Request processed in 24us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071489.867302:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:1.0:1783071489.867320:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783071489.867325:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783071489.867339:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707630336 00000100:00100000:1.0:1783071489.867351:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707630336 00000100:00100000:0.0:1783071489.867359:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02c08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707630720:0@lo:400:kworker.0 00000100:00100000:1.0:1783071489.867398:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707630848 00000100:00100000:1.0:1783071489.867402:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707630848 00000100:00100000:1.0:1783071489.868524:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707630464 00000100:00100000:1.0:1783071489.868534:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707630464 00000100:00100000:1.0:1783071489.868582:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707630976 00000100:00100000:1.0:1783071489.868585:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707630976 00000100:00100000:1.0:1783071489.868600:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707630080 00000100:00100000:1.0:1783071489.868602:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707630080 00000100:00100000:1.0:1783071489.868631:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1783071489.868637:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c686a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869685707630336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071489.868705:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c686a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869685707630336:12345-0@lo:400:kworker.0 Request processed in 68us (4381us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071489.868712:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1783071489.868728:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1783071489.868734:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c685180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869685707630848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071489.868763:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c685180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869685707630848:12345-0@lo:400:kworker.0 Request processed in 29us (4371us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071489.868768:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1783071489.868779:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1783071489.868785:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1869685707630464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071489.868976:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1869685707630464:12345-0@lo:400:kworker.0 Request processed in 191us (2674us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071489.868982:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1783071489.868995:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1783071489.869000:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1869685707630976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071489.869029:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1869685707630976:12345-0@lo:400:kworker.0 Request processed in 29us (2640us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071489.869048:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1783071489.869060:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1783071489.869067:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1869685707630080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071489.869108:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1869685707630080:12345-0@lo:400:kworker.0 Request processed in 41us (2599us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071489.869113:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:1.0:1783071489.869138:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783071489.869142:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783071489.869189:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c5af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869685707630080:0@lo:400:kworker.0 00000100:00100000:1.0:1783071489.869204:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02c09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707630592:0@lo:400:kworker.0 00000100:00100000:1.0:1783071489.869221:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c689f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707631104:0@lo:400:kworker.0 00010000:00080000:1.0:1783071489.869233:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a01764a80 x1869685707630464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071489.869244:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1869685707630464:0@lo:400:kworker.0 00010000:00080000:1.0:1783071489.869254:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a02c0bb80 x1869685707630976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071489.869262:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02c0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1869685707630976:0@lo:400:kworker.0 00000100:00100000:3.0:1783071489.869602:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1783071489.869777:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c689500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707631232:0@lo:400:kworker.0 00000100:00100000:0.0:1783071489.869812:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c5ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1869685707630336:0@lo:400:kworker.0 00000100:00100000:0.0:1783071489.869824:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02c09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1869685707630848:0@lo:400:kworker.0 00000100:00100000:0.0:1783071489.869834:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3b4dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:feaa1501-b927-4e07-baad-3200e92d7497:3648:1869685707629824:0@lo:400:kworker.0 00000100:00100000:3.0:1783071489.870137:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707630208 00000100:00100000:3.0:1783071489.870145:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707630208 00000100:00100000:3.0:1783071489.870188:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1783071489.870195:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c79f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707630208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071489.870249:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c79f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707630208:12345-0@lo:400:kworker.0 Request processed in 55us (5791us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071489.870265:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1783071489.876054:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071489.876129:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707629952 00000100:00100000:2.0:1783071489.876139:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707629952 00000100:00100000:2.0:1783071489.876198:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1783071489.876207:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3b778000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869685707629952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071489.876283:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3b778000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869685707629952:12345-0@lo:400:kworker.0 Request processed in 77us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071489.876291:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1783071489.876331:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c5ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869685707629952:0@lo:400:kworker.0 00000100:00100000:1.0:1783071489.877055:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c5aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707630208:0@lo:400:kworker.0 00000100:00100000:1.0:1783071489.982096:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071489.982174:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692860288 00000100:00100000:3.0:1783071489.982186:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692860288 00000100:00100000:3.0:1783071489.982265:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 50 00000100:00100000:3.0:1783071489.982278:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+16:11163:x1869685692860288:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1783071489.982307:0:10292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071489.982328:0:10292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9e00/0x6b58994c2cbdc3b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98db8 expref: -99 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783071489.982577:0:10292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1783071489.983192:0:10292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9e00/0x6b58994c2cbdc3b9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98db8 expref: 18 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071489.983209:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8a020cad00) 00010000:00010000:3.0:1783071489.983212:0:10292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783071489.983217:0:10292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9e00/0x6b58994c2cbdc3b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98db8 expref: 18 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071489.983237:0:10292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b014b9e00, rc 0) 00000100:00100000:3.0:1783071489.983316:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+17:11163:x1869685692860288:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1040us (1230us total) trans 4294967315 rc 301/301 00000100:00100000:3.0:1783071489.983324:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 50 00000100:00100000:2.0:1783071489.989054:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071489.989271:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692860544 00000100:00100000:0.0:1783071489.989283:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692860544 00000100:00100000:0.0:1783071489.989350:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 7 00000100:00100000:0.0:1783071489.989527:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3b778a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+17:11163:x1869685692860544:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1783071489.990025:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3b778a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+18:11163:x1869685692860544:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 664us (980us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1783071489.990033:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 7 00000100:00100000:1.0:1783071490.090694:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071490.091431:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692860672 00000100:00100000:2.0:1783071490.091446:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692860672 00000100:00100000:2.0:1783071490.091760:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 51 00000100:00100000:2.0:1783071490.091775:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c682a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+18:11169:x1869685692860672:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1783071490.091808:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071490.091834:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66e00/0x6b58994c2cbdc3c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98dbf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071490.091930:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdc3ce lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071490.093566:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdc3ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071490.093907:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdc3ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071490.094108:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1783071490.094114:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783071490.094151:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdc3ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071490.094201:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66e00/0x6b58994c2cbdc3c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98dbf expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071490.094329:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdc3ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98dbf expref: 19 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071490.094339:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f8a0179f400) 00010000:00010000:2.0:1783071490.094342:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783071490.094347:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b2fd67400, rc 0) 00000100:00100000:2.0:1783071490.095237:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c682a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+19:11169:x1869685692860672:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 3162us (4256us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071490.095249:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 51 00000100:00100000:1.0:1783071490.106988:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071490.107324:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692860928 00000100:00100000:0.0:1783071490.107340:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692860928 00000100:00100000:0.0:1783071490.107458:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 52 00000100:00100000:0.0:1783071490.107471:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01764a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+19:11169:x1869685692860928:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1783071490.107502:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071490.107531:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864800/0x6b58994c2cbdc3d5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98dc6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071490.108212:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865200/0x6b58994c2cbdc3dc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071490.108312:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865200/0x6b58994c2cbdc3dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071490.108327:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865200/0x6b58994c2cbdc3dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783071490.108400:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1783071490.109023:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864800/0x6b58994c2cbdc3d5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98dc6 expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071490.109050:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865200/0x6b58994c2cbdc3dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98dc6 expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071490.109061:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f8a0179f800) 00010000:00010000:0.0:1783071490.109064:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783071490.109068:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a03865200, rc 0) 00000100:00100000:0.0:1783071490.109458:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01764a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+21:11169:x1869685692860928:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1987us (2485us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1783071490.109467:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 52 00000100:00100000:3.0:1783071490.118520:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071490.118831:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071490.119206:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692861184 00000100:00100000:1.0:1783071490.119246:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692861184 00000100:00100000:1.0:1783071490.119324:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 53 00000100:00100000:1.0:1783071490.119344:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c688700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+21:11169:x1869685692861184:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1783071490.119418:0:10292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071490.119445:0:10292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdc3ea lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98dcd expref: -99 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071490.119598:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692861312 00000100:00100000:2.0:1783071490.119604:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692861312 00000100:00100000:2.0:1783071490.119656:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3 00000100:00100000:2.0:1783071490.119665:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c68a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf7532e4-6153-424a-9f4e-84941256b41f+23:2405:x1869685692861312:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783071490.119678:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071490.119781:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865200/0x6b58994c2cbdc3dc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98dc6 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071490.119811:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f8a0179f800) 00010000:00010000:2.0:1783071490.119816:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071490.119904:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c68a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf7532e4-6153-424a-9f4e-84941256b41f+22:2405:x1869685692861312:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 239us (1072us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071490.119914:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3 00010000:00010000:0.0:1783071490.120316:0:10292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864800/0x6b58994c2cbdc3f1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071490.120336:0:10292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864800/0x6b58994c2cbdc3f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071490.120349:0:10292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864800/0x6b58994c2cbdc3f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783071490.120388:0:10292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1783071490.120714:0:10292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdc3ea lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98dcd expref: 23 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071490.120736:0:10292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864800/0x6b58994c2cbdc3f1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98dcd expref: 22 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071490.120763:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f8a0179f800) 00010000:00010000:0.0:1783071490.120767:0:10292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1783071490.120770:0:10292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a03864800, rc 0) 00000100:00100000:0.0:1783071490.120829:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c688700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+22:11169:x1869685692861184:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1495us (2325us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1783071490.120838:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 53 00000100:00100000:1.0:1783071490.146178:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071490.146345:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692861440 00000100:00100000:2.0:1783071490.146359:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692861440 00000100:00100000:2.0:1783071490.146553:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 31 00000100:00100000:2.0:1783071490.146585:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02c09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf7532e4-6153-424a-9f4e-84941256b41f+7:2404:x1869685692861440:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:2.0:1783071490.146785:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f377a4d/0x6b58994c2cbdc3ff lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071490.146811:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bd4b890e/0x6b58994c2cbdc3b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98db1 expref: 7 pid: 8910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071490.146821:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783071490.146825:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783071490.146831:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f377a4d/0x6b58994c2cbdc3ff lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071490.147006:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bd4b890e/0x6b58994c2cbdc3b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98db1 expref: 7 pid: 8910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071490.147024:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bd4b890e/0x6b58994c2cbdc3b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98db1 expref: 7 pid: 8910 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071490.147042:0:8432:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3b779180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8432:1869685707631360:192.168.204.38@tcp:104: 00000100:00100000:2.0:1783071490.147162:0:8432:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b05e0bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1783071490.152424:0:8432:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3b779180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8432:1869685707631360:192.168.204.38@tcp:104: 00010000:00010000:2.0:1783071490.152469:0:8432:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002f377a4d/0x6b58994c2cbdc3ff lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071490.153793:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071490.153905:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692861568 00000100:00100000:2.0:1783071490.153916:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692861568 00002000:00100000:2.0:1783071490.154011:0:8435:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff8f8a02c08000 x1869685692861568/t0(0) o4->bf7532e4-6153-424a-9f4e-84941256b41f@192.168.204.38@tcp:81/0 lens 504/0 e 0 to 0 dl 1783071501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783071490.154024:0:8435:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8f8a02c08000 with x1869685692861568 ext(0->12) 00010000:00010000:2.0:1783071490.154035:0:8435:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000bd4b890e/0x6b58994c2cbdc3b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98db1 expref: 8 pid: 8910 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071490.154055:0:8435:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000bd4b890e/0x6b58994c2cbdc3b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98db1 expref: 8 pid: 8910 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783071490.154063:0:8435:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8f8a02c08000 00000100:00100000:2.0:1783071490.154105:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 0 00000100:00100000:2.0:1783071490.154119:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02c08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bf7532e4-6153-424a-9f4e-84941256b41f+8:2405:x1869685692861568:12345-192.168.204.38@tcp:4:lfs.0 00000001:00100000:0.0:1783071490.157524:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bf7532e4-6153-424a-9f4e-84941256b41f 00000100:00100000:2.0:1783071490.161782:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02c08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bf7532e4-6153-424a-9f4e-84941256b41f+9:2405:x1869685692861568:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 7654us (7987us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1783071490.161798:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 0 00002000:00100000:2.0:1783071490.161814:0:8435:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff8f8a02c08000 x1869685692861568/t4294967300(0) o4->bf7532e4-6153-424a-9f4e-84941256b41f@192.168.204.38@tcp:81/0 lens 504/448 e 0 to 0 dl 1783071501 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783071490.161825:0:8435:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8f8a02c08000 with x1869685692861568 ext(0->12) 00010000:00010000:2.0:1783071490.161837:0:8435:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000bd4b890e/0x6b58994c2cbdc3b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98db1 expref: 9 pid: 8910 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071490.161857:0:8435:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000bd4b890e/0x6b58994c2cbdc3b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98db1 expref: 9 pid: 8910 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783071490.161865:0:8435:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8f8a02c08000 00000100:00100000:3.0:1783071490.165821:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071490.165929:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692861696 00000100:00100000:1.0:1783071490.165939:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692861696 00010000:00010000:1.0:1783071490.165994:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bd4b890e/0x6b58994c2cbdc3b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98db1 expref: 9 pid: 8910 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071490.166731:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 53 00000100:00100000:1.0:1783071490.166745:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c68bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf7532e4-6153-424a-9f4e-84941256b41f+9:2406:x1869685692861696:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783071490.166762:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1783071490.166784:0:6503:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1783071490.166787:0:6503:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1783071490 00002000:00010000:1.0:1783071490.166789:0:6503:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1783071490 00002000:00010000:1.0:1783071490.166792:0:6503:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1783071490 00002000:00010000:1.0:1783071490.166794:0:6503:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1783071490.166800:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bd4b890e/0x6b58994c2cbdc3b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98db1 expref: 9 pid: 8910 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.166817:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bd4b890e/0x6b58994c2cbdc3b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98db1 expref: 9 pid: 8910 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.166862:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd4b890e/0x6b58994c2cbdc3b2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98db1 expref: 9 pid: 8910 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.166880:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783071490.166884:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783071490.166889:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002f377a4d/0x6b58994c2cbdc3ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.166899:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f377a4d/0x6b58994c2cbdc3ff lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.166924:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071490.167005:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c68bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf7532e4-6153-424a-9f4e-84941256b41f+8:2406:x1869685692861696:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 264us (1193us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071490.167014:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 53 00010000:00010000:2.0:1783071490.167111:0:8432:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002f377a4d/0x6b58994c2cbdc3ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071490.167122:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f377a4d/0x6b58994c2cbdc3ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071490.167145:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f377a4d/0x6b58994c2cbdc3ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071490.167154:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f377a4d/0x6b58994c2cbdc3ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071490.167163:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f377a4d/0x6b58994c2cbdc3ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071490.167184:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd66e00 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:2.0:1783071490.167188:0:8432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f377a4d/0x6b58994c2cbdc3ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071490.167198:0:8432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f377a4d/0x6b58994c2cbdc3ff lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071490.167213:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f377a4d/0x6b58994c2cbdc3ff lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071490.167221:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f377a4d/0x6b58994c2cbdc3ff lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071490.167284:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02c09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf7532e4-6153-424a-9f4e-84941256b41f+7:2404:x1869685692861440:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 20702us (21550us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071490.167293:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 31 00000100:00100000:1.0:1783071490.173231:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071490.173583:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692861952 00000100:00100000:3.0:1783071490.173593:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692861952 00000100:00100000:3.0:1783071490.173659:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 8 00000100:00100000:3.0:1783071490.173669:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02c0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+22:11169:x1869685692861952:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:2.0:1783071490.178246:0:6520:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864800/0x6b58994c2cbdc3f1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98dcd expref: 22 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783071490.178556:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:2.0:1783071490.178611:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1783071490.178926:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:2.0:1783071490.178976:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66e00/0x6b58994c2cbdc406 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071490.178992:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9400/0x6b58994c2cbdc396 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98da3 expref: 26 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071490.179002:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66e00/0x6b58994c2cbdc406 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071490.179040:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9400/0x6b58994c2cbdc396 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98da3 expref: 26 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071490.179056:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9400/0x6b58994c2cbdc396 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98da3 expref: 26 pid: 10292 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071490.179072:0:6520:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3b779180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6520:1869685707631488:192.168.204.38@tcp:104: 00000100:00100000:2.0:1783071490.179173:0:6520:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b05e0b540 going to sleep for 11 seconds 00000100:00100000:2.0:1783071490.182798:0:6520:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3b779180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6520:1869685707631488:192.168.204.38@tcp:104: 00010000:00010000:2.0:1783071490.182847:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66e00/0x6b58994c2cbdc406 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071490.184107:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071490.184744:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692862080 00000100:00100000:2.0:1783071490.184754:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692862080 00010000:00010000:2.0:1783071490.184799:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9400/0x6b58994c2cbdc396 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98da3 expref: 27 pid: 10292 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071490.184848:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 54 00000100:00100000:2.0:1783071490.184858:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02c09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf7532e4-6153-424a-9f4e-84941256b41f+27:2405:x1869685692862080:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783071490.184874:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071490.184882:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9400/0x6b58994c2cbdc396 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98da3 expref: 27 pid: 10292 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071490.184896:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9400/0x6b58994c2cbdc396 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98da3 expref: 27 pid: 10292 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071490.184919:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9400/0x6b58994c2cbdc396 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98da3 expref: 27 pid: 10292 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071490.184950:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f8a0179f800) 00010000:00010000:2.0:1783071490.184967:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66e00/0x6b58994c2cbdc406 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071490.184977:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66e00/0x6b58994c2cbdc406 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071490.184985:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66e00/0x6b58994c2cbdc406 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071490.185039:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071490.185099:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02c09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf7532e4-6153-424a-9f4e-84941256b41f+26:2405:x1869685692862080:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 242us (999us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071490.185110:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 54 00010000:00010000:1.0:1783071490.187708:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66e00/0x6b58994c2cbdc406 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.187735:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66e00/0x6b58994c2cbdc406 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783071490.187864:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:1.0:1783071490.188020:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:1.0:1783071490.188129:0:6520:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c5aed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6520:1869685707631616:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1783071490.188215:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071490.188241:0:6520:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a038a8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783071490.188802:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707631616 00000100:00100000:0.0:1783071490.188811:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707631616 00000100:00100000:0.0:1783071490.188870:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1783071490.188880:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c5ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6520:x1869685707631616:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1783071490.188997:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c5ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6520:x1869685707631616:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 118us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071490.189005:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1783071490.189296:0:6520:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c5aed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6520:1869685707631616:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1783071490.189515:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:1.0:1783071490.189570:0:6520:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c5aed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6520:1869685707631744:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1783071490.189606:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071490.189622:0:6520:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a038a8900 going to sleep for 11 seconds 00000100:00100000:2.0:1783071490.189984:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707631744 00000100:00100000:2.0:1783071490.189990:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707631744 00000100:00100000:2.0:1783071490.190040:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1783071490.190049:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c5ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6520:x1869685707631744:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1783071490.190164:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c5ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6520:x1869685707631744:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 116us (556us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1783071490.190171:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1783071490.191017:0:6520:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c5aed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6520:1869685707631744:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1783071490.191899:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:1.0:1783071490.191978:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66e00/0x6b58994c2cbdc406 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.191990:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66e00/0x6b58994c2cbdc406 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.191997:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66e00/0x6b58994c2cbdc406 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.192004:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd66e00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:1.0:1783071490.192009:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66e00/0x6b58994c2cbdc406 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.192017:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66e00/0x6b58994c2cbdc406 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.192276:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f8a0179f800) 00010000:00010000:1.0:1783071490.192280:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1783071490.192286:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66e00/0x6b58994c2cbdc406 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.192314:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66e00/0x6b58994c2cbdc406 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783071490.192827:0:6520:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1783071490.192892:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1783071490.192904:0:6520:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 391981539709ns, next at 392981537511ns, rc = 0 00000001:00080000:1.0:1783071490.192912:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:1.0:1783071490.193222:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f8a0179f800) 00010000:00010000:1.0:1783071490.193226:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1783071490.193235:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864800/0x6b58994c2cbdc3f1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98dcd expref: 30 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071490.193655:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02c0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+29:11169:x1869685692861952:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 19985us (20431us total) trans 4294967327 rc 0/0 00000100:00100000:1.0:1783071490.193666:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 8 00000020:00080000:1.0:1783071490.193672:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1783071490.199699:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071490.200243:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692862208 00000100:00100000:2.0:1783071490.200253:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692862208 00000100:00100000:3.0:1783071490.201027:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 54 00000100:00100000:3.0:1783071490.201044:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c5af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+29:11169:x1869685692862208:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1783071490.201070:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071490.201094:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9e00/0x6b58994c2cbdc40d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98dd4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071490.201152:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9e00/0x6b58994c2cbdc40d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98dd4 expref: 30 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071490.201167:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9e00/0x6b58994c2cbdc40d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98dd4 expref: 30 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071490.201186:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f8a0179f900) 00010000:00010000:3.0:1783071490.201190:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783071490.201194:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b014b9e00, rc 0) 00000100:00100000:3.0:1783071490.201256:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c5af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+30:11169:x1869685692862208:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 219us (1567us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071490.201263:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 54 00000100:00100000:2.0:1783071490.222134:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071490.222489:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692862464 00000100:00100000:0.0:1783071490.222501:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692862464 00000100:00100000:0.0:1783071490.222604:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9 00000100:00100000:0.0:1783071490.222616:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0699dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+30:11169:x1869685692862464:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1783071490.222880:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0699dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+31:11169:x1869685692862464:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 265us (753us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1783071490.222887:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9 00010000:00010000:0.0:1783071490.308230:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071490.309761:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071490.309869:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692862720 00000100:00100000:0.0:1783071490.309880:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692862720 00000100:00100000:0.0:1783071490.309973:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 55 00000100:00100000:0.0:1783071490.310001:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3b779180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+31:11179:x1869685692862720:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1783071490.310028:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071490.310051:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdc414 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98ddb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783071490.310163:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1783071490.310287:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdc414 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ddb expref: 33 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071490.310303:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8a020cad00) 00010000:00010000:0.0:1783071490.310306:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783071490.310311:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdc414 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ddb expref: 33 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071490.310325:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a03865600, rc 0) 00000100:00100000:0.0:1783071490.310597:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3b779180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+32:11179:x1869685692862720:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 599us (843us total) trans 4294967329 rc 301/301 00000100:00100000:0.0:1783071490.310606:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 55 00000100:00100000:3.0:1783071490.315420:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071490.315532:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692862848 00000100:00100000:1.0:1783071490.315543:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692862848 00000100:00100000:1.0:1783071490.315601:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 56 00000100:00100000:1.0:1783071490.315610:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c689c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+32:11179:x1869685692862848:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:1.0:1783071490.315695:0:13815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc422 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.315712:0:13815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc422 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.315723:0:13815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc422 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.315749:0:13815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdc429 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.315756:0:13815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdc429 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.315761:0:13815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdc429 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.315845:0:13815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdc430 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.315854:0:13815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdc430 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.315866:0:13815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdc430 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783071490.315926:0:13815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdc430 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.315938:0:13815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc422 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.315945:0:13815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc422 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.315963:0:13815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc422 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.315970:0:13815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01749a00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:1.0:1783071490.315974:0:13815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc422 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.315989:0:13815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc422 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.316001:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f8a0179f400) 00010000:00010000:1.0:1783071490.316004:0:13815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071490.316010:0:13815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc422 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.316016:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc422 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.316030:0:13815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdc429 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.316045:0:13815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdc429 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.316049:0:13815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdc429 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.316052:0:13815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01749400 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:1.0:1783071490.316054:0:13815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdc429 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.316057:0:13815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdc429 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.316062:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f8a0179f500) 00010000:00010000:1.0:1783071490.316063:0:13815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071490.316065:0:13815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdc429 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.316077:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdc429 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.316083:0:13815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdc430 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.316087:0:13815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdc430 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.316090:0:13815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdc430 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.316093:0:13815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01749c00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:1.0:1783071490.316095:0:13815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdc430 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.316098:0:13815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdc430 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.316102:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f8a0179f900) 00010000:00010000:1.0:1783071490.316103:0:13815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071490.316105:0:13815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdc430 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.316108:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdc430 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071490.316186:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c689c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+32:11179:x1869685692862848:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 575us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071490.316193:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 56 00000100:00100000:3.0:1783071490.320564:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071490.321131:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692863104 00000100:00100000:1.0:1783071490.321143:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692863104 00000100:00100000:1.0:1783071490.321240:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 10 00000100:00100000:1.0:1783071490.321250:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c68ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+32:11179:x1869685692863104:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1783071490.321525:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c68ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+33:11179:x1869685692863104:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 275us (1163us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1783071490.321534:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 10 00000100:00100000:3.0:1783071490.352668:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071490.352801:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692863360 00000100:00100000:2.0:1783071490.352812:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692863360 00000100:00100000:2.0:1783071490.352908:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 57 00000100:00100000:2.0:1783071490.352920:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c689500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+33:11182:x1869685692863360:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1783071490.352974:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071490.352996:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdc437 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98de2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071490.353095:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdc43e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071490.353121:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdc43e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071490.353152:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdc43e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071490.353511:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66800/0x6b58994c2cbdc445 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071490.353522:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66800/0x6b58994c2cbdc445 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071490.353530:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66800/0x6b58994c2cbdc445 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071490.353653:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67e00/0x6b58994c2cbdc44c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071490.353662:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67e00/0x6b58994c2cbdc44c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071490.353669:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67e00/0x6b58994c2cbdc44c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071490.353679:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1783071490.353762:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdc43e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071490.353769:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdc43e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071490.353776:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdc43e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071490.353781:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd66c00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:2.0:1783071490.353793:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdc43e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071490.353801:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdc43e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071490.353814:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f8a0179f400) 00010000:00010000:2.0:1783071490.353817:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071490.353821:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdc43e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071490.353828:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdc43e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071490.353842:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66800/0x6b58994c2cbdc445 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071490.353848:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66800/0x6b58994c2cbdc445 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071490.353854:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66800/0x6b58994c2cbdc445 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071490.353859:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd66800 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:2.0:1783071490.353861:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66800/0x6b58994c2cbdc445 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071490.353867:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66800/0x6b58994c2cbdc445 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071490.353874:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f8a0179f500) 00010000:00010000:2.0:1783071490.353876:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071490.353885:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66800/0x6b58994c2cbdc445 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071490.353891:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66800/0x6b58994c2cbdc445 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071490.353932:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdc437 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98de2 expref: 36 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071490.353946:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67e00/0x6b58994c2cbdc44c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98de2 expref: 35 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071490.353964:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f8a0179f900) 00010000:00010000:2.0:1783071490.353967:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783071490.353969:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b2fd67e00, rc 0) 00000100:00100000:2.0:1783071490.354109:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c689500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+35:11182:x1869685692863360:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1190us (1449us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1783071490.354118:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 57 00000100:00100000:3.0:1783071490.357733:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071490.358227:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692863488 00000100:00100000:1.0:1783071490.358238:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692863488 00000100:00100000:1.0:1783071490.358353:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 58 00000100:00100000:1.0:1783071490.358412:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c689f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+35:11182:x1869685692863488:12345-192.168.204.38@tcp:54:lfs.0 00010000:00010000:1.0:1783071490.358524:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdc45a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.358542:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdc45a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.358554:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdc45a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.358593:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdc45a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.358601:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdc45a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.358607:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdc45a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.358613:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01749c00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:1.0:1783071490.358625:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdc45a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.358640:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdc45a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.358654:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f8a0179f900) 00010000:00010000:1.0:1783071490.358658:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783071490.358663:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdc45a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.358669:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdc45a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071490.358752:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c689f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+35:11182:x1869685692863488:12345-192.168.204.38@tcp:54:lfs.0 Request processed in 389us (1029us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071490.358760:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 58 00000100:00100000:3.0:1783071490.364388:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071490.364486:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692863744 00000100:00100000:0.0:1783071490.364496:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692863744 00000100:00100000:0.0:1783071490.364560:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11 00000100:00100000:0.0:1783071490.364571:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37ab9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+35:11182:x1869685692863744:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1783071490.364799:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37ab9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+36:11182:x1869685692863744:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 229us (445us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1783071490.364807:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11 00000100:00100000:0.0:1783071490.371386:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783071490.371424:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a038bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707631872:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783071490.371496:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071490.371575:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707631872 00000100:00100000:0.0:1783071490.371582:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707631872 00000100:00100000:0.0:1783071490.371630:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1783071490.371638:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02c0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707631872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783071490.371668:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783071490.371718:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02c0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707631872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071490.371725:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1783071490.371769:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a038bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707631872:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783071490.371805:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c681180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707632000:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783071490.371829:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071490.371855:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707632000 00000100:00100000:0.0:1783071490.371859:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707632000 00000100:00100000:0.0:1783071490.371880:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1783071490.371886:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a038bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707632000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783071490.371895:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783071490.371924:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a038bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707632000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 38us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071490.371930:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1783071490.371969:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c681180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707632000:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783071490.373109:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37abad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707632128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783071490.373162:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071490.373389:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707632128 00000100:00100000:3.0:1783071490.373396:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707632128 00000100:00100000:3.0:1783071490.373455:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1783071490.373463:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3b77a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1869685707632128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783071490.373484:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783071490.373530:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3b77a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1869685707632128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071490.373536:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1783071490.373577:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37abad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707632128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783071490.374408:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c681180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707632256:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783071490.374450:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071490.374534:0:12254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707632256 00000100:00100000:3.0:1783071490.374539:0:12254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707632256 00000100:00100000:3.0:1783071490.374581:0:12254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1783071490.374589:0:12254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3b77bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707632256:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783071490.374604:0:12254:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783071490.375084:0:12254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3b77bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707632256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 494us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071490.375091:0:12254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1783071490.375155:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c681180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707632256:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783071490.593103:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071490.593217:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692864000 00000100:00100000:1.0:1783071490.593227:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692864000 00000100:00100000:1.0:1783071490.593294:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 59 00000100:00100000:1.0:1783071490.593305:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3b779880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+36:11213:x1869685692864000:12345-192.168.204.38@tcp:101:cat.0 00010000:00010000:1.0:1783071490.593333:0:13815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071490.593355:0:13815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdc461 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98de9 expref: -99 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.593494:0:13815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdc468 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.593510:0:13815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdc468 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.593545:0:13815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdc468 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783071490.593559:0:13815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1783071490.593696:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdc461 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98de9 expref: 39 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.593717:0:13815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdc468 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98de9 expref: 38 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.593725:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f8a0179f900) 00010000:00010000:1.0:1783071490.593727:0:13815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783071490.593731:0:13815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a01749400, rc 0) 00000100:00100000:1.0:1783071490.593801:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3b779880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+38:11213:x1869685692864000:12345-192.168.204.38@tcp:101:cat.0 Request processed in 497us (709us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1783071490.593809:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 59 00000100:00100000:1.0:1783071490.598122:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071490.598288:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692864256 00000100:00100000:2.0:1783071490.598298:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692864256 00000100:00100000:2.0:1783071490.598401:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 12 00000100:00100000:2.0:1783071490.598412:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37abe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+38:11213:x1869685692864256:12345-192.168.204.38@tcp:35:cat.0 00000100:00100000:2.0:1783071490.598651:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37abe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+39:11213:x1869685692864256:12345-192.168.204.38@tcp:35:cat.0 Request processed in 240us (540us total) trans 4294967334 rc 0/0 00000100:00100000:2.0:1783071490.598659:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 12 00000100:00100000:1.0:1783071490.598796:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071490.599145:0:7923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692864384 00000100:00100000:2.0:1783071490.599150:0:7923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692864384 00000100:00100000:2.0:1783071490.599200:0:7923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 4 00000100:00100000:2.0:1783071490.599208:0:7923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37abf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf7532e4-6153-424a-9f4e-84941256b41f+39:2406:x1869685692864384:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783071490.599220:0:7923:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071490.599244:0:7923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdc468 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98de9 expref: 39 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071490.599261:0:7923:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f8a0179f900) 00010000:00010000:2.0:1783071490.599266:0:7923:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071490.599290:0:7923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37abf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf7532e4-6153-424a-9f4e-84941256b41f+38:2406:x1869685692864384:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 83us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071490.599295:0:7923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 4 00000100:00100000:2.0:1783071490.653415:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071490.653521:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692864640 00000100:00100000:0.0:1783071490.653539:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692864640 00000100:00100000:0.0:1783071490.653617:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 60 00000100:00100000:0.0:1783071490.653627:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3b77aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+38:11219:x1869685692864640:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:0.0:1783071490.653664:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071490.653667:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1783071490.653697:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdc3ce lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98dbf expref: 38 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071490.653718:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f8a0179f400) 00010000:00010000:0.0:1783071490.653723:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783071490.653737:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdc476 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98df0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071490.653848:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdc47d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071490.653862:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67e00/0x6b58994c2cbdc44c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98de2 expref: 38 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071490.653870:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdc47d lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071490.653904:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67e00/0x6b58994c2cbdc44c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98de2 expref: 38 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071490.653917:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67e00/0x6b58994c2cbdc44c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98de2 expref: 38 pid: 6517 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071490.653931:0:6517:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c681180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1869685707632384:192.168.204.38@tcp:104: 00000100:00100000:0.0:1783071490.654037:0:6517:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a032c0180 going to sleep for 11 seconds 00000100:00100000:0.0:1783071490.660903:0:6517:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c681180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1869685707632384:192.168.204.38@tcp:104: 00010000:00010000:0.0:1783071490.660943:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdc47d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071490.664039:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071490.664269:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692864768 00000100:00100000:1.0:1783071490.664279:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692864768 00010000:00010000:1.0:1783071490.664322:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67e00/0x6b58994c2cbdc44c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98de2 expref: 39 pid: 6517 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071490.664400:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 55 00000100:00100000:1.0:1783071490.664410:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3b778380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf7532e4-6153-424a-9f4e-84941256b41f+39:2406:x1869685692864768:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783071490.664427:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071490.664447:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67e00/0x6b58994c2cbdc44c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98de2 expref: 39 pid: 6517 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.664462:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67e00/0x6b58994c2cbdc44c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98de2 expref: 39 pid: 6517 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.664484:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67e00/0x6b58994c2cbdc44c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98de2 expref: 39 pid: 6517 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.664747:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f8a0179f900) 00010000:00010000:1.0:1783071490.664753:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdc47d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.664763:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdc47d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.664771:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdc47d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.664801:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071490.664858:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3b778380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf7532e4-6153-424a-9f4e-84941256b41f+38:2406:x1869685692864768:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 448us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071490.664867:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 55 00010000:00010000:0.0:1783071490.664880:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdc47d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071490.664890:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdc47d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783071490.664909:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1783071490.665068:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdc476 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98df0 expref: 39 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071490.665084:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdc47d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98df0 expref: 38 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071490.665091:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f8a0179f900) 00010000:00010000:0.0:1783071490.665094:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783071490.665097:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a03865e00, rc 0) 00000100:00100000:0.0:1783071490.665132:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3b77aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+38:11219:x1869685692864640:12345-192.168.204.38@tcp:101:dd.0 Request processed in 11507us (11728us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1783071490.665140:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 60 00000100:00100000:2.0:1783071490.670160:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071490.670405:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692864896 00000100:00100000:1.0:1783071490.670416:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692864896 00000100:00100000:1.0:1783071490.670478:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 61 00000100:00100000:1.0:1783071490.670489:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3b779500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+38:11219:x1869685692864896:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:1.0:1783071490.670516:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071490.670539:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc48b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98df7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.670596:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc492 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.670612:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc492 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.670623:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc492 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.670762:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc48b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98df7 expref: 40 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.670782:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc492 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98df7 expref: 39 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.670791:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f8a0179f900) 00010000:00010000:1.0:1783071490.670794:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783071490.670798:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a01749000, rc 0) 00000100:00100000:1.0:1783071490.670869:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3b779500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+39:11219:x1869685692864896:12345-192.168.204.38@tcp:101:dd.0 Request processed in 382us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071490.670876:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 61 00000100:00100000:3.0:1783071490.675571:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071490.675857:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692865152 00000100:00100000:0.0:1783071490.675866:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692865152 00000100:00100000:0.0:1783071490.675924:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 62 00000100:00100000:0.0:1783071490.675936:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37abad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+39:11219:x1869685692865152:12345-192.168.204.38@tcp:36:dd.0 00010000:00010000:0.0:1783071490.676195:0:10292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdc499 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071490.676239:0:10292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdc499 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071490.676252:0:10292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdc499 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783071490.676297:0:10292:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:0.0:1783071490.676321:0:10292:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000051b086ef reply state 00000000052b3836 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdc499 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071490.676335:0:10292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdc499 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071490.676342:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f8a0179f900) 00010000:00010000:0.0:1783071490.676345:0:10292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783071490.676349:0:10292:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783071490.677667:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37abad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+42:11219:x1869685692865152:12345-192.168.204.38@tcp:36:dd.0 Request processed in 1725us (2095us total) trans 4294967337 rc 0/0 00000100:00100000:0.0:1783071490.677679:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 62 00000020:00080000:0.0:1783071490.677684:0:10292:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1783071490.946812:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071490.946920:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692865280 00000100:00100000:0.0:1783071490.946930:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692865280 00000100:00100000:0.0:1783071490.947003:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 63 00000100:00100000:0.0:1783071490.947014:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3b779f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+42:11233:x1869685692865280:12345-192.168.204.38@tcp:101:stat.0 00010000:00010000:0.0:1783071490.947039:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071490.947058:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864a00/0x6b58994c2cbdc4a0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98dfe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071490.947131:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdc4a7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071490.947159:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdc4a7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071490.947171:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdc4a7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071490.947183:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdc4ae lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071490.947190:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdc4ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071490.947196:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdc4ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071490.947276:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864800/0x6b58994c2cbdc4b5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071490.947286:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdc47d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98df0 expref: 43 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071490.947296:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864800/0x6b58994c2cbdc4b5 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071490.947330:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdc47d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98df0 expref: 43 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071490.947343:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdc47d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98df0 expref: 43 pid: 6517 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071490.947427:0:6517:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c681180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1869685707632512:192.168.204.38@tcp:104: 00000100:00100000:0.0:1783071490.947562:0:6517:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a032c0180 going to sleep for 11 seconds 00000100:00100000:0.0:1783071490.961464:0:6517:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c681180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1869685707632512:192.168.204.38@tcp:104: 00010000:00010000:0.0:1783071490.961497:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864800/0x6b58994c2cbdc4b5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071490.964116:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071490.964518:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692865536 00000100:00100000:1.0:1783071490.964529:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692865536 00000100:00100000:1.0:1783071490.964592:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 13 00000100:00100000:1.0:1783071490.964603:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3b77ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+44:6169:x1869685692865536:12345-192.168.204.38@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1783071490.964955:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3b77ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+45:6169:x1869685692865536:12345-192.168.204.38@tcp:35:ldlm_bl.0 Request processed in 353us (850us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1783071490.964981:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 13 00000100:00100000:2.0:1783071490.970569:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071490.970778:0:7923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692865664 00000100:00100000:0.0:1783071490.970791:0:7923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692865664 00010000:00010000:0.0:1783071490.970836:0:7923:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdc47d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98df0 expref: 45 pid: 6517 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071490.970879:0:7923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 56 00000100:00100000:0.0:1783071490.970888:0:7923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3b779c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf7532e4-6153-424a-9f4e-84941256b41f+45:2405:x1869685692865664:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783071490.970904:0:7923:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071490.970911:0:7923:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdc47d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98df0 expref: 45 pid: 6517 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071490.970924:0:7923:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdc47d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98df0 expref: 45 pid: 6517 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071490.970956:0:7923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdc47d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98df0 expref: 45 pid: 6517 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071490.970972:0:7923:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f8a0179f900) 00010000:00010000:0.0:1783071490.970978:0:7923:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864800/0x6b58994c2cbdc4b5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071490.971001:0:7923:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864800/0x6b58994c2cbdc4b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071490.971010:0:7923:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864800/0x6b58994c2cbdc4b5 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071490.971059:0:7923:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071490.971133:0:7923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3b779c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf7532e4-6153-424a-9f4e-84941256b41f+44:2405:x1869685692865664:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 244us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071490.971142:0:7923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 56 00010000:00010000:1.0:1783071490.972098:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864800/0x6b58994c2cbdc4b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.972111:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864800/0x6b58994c2cbdc4b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783071490.972171:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1783071490.972176:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783071490.972218:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864800/0x6b58994c2cbdc4b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.972233:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864800/0x6b58994c2cbdc4b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.972244:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdc4a7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.972252:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdc4a7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.972259:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdc4a7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.972266:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03864600 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:1.0:1783071490.972270:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdc4a7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.972279:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdc4a7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.972292:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f8a0179f400) 00010000:00010000:1.0:1783071490.972309:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071490.972314:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdc4a7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.972320:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdc4a7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.972562:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdc4ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.972569:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdc4ae lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.972575:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdc4ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.972580:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03865c00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:1.0:1783071490.972584:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdc4ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.972590:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdc4ae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.972597:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f8a0179f500) 00010000:00010000:1.0:1783071490.972600:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071490.972603:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdc4ae lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.972608:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdc4ae lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.972648:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864a00/0x6b58994c2cbdc4a0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98dfe expref: 44 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.972677:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864800/0x6b58994c2cbdc4b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98dfe expref: 43 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071490.972683:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f8a0179f900) 00010000:00010000:1.0:1783071490.972686:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783071490.972688:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a03864800, rc 0) 00000100:00100000:1.0:1783071490.972797:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3b779f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+43:11233:x1869685692865280:12345-192.168.204.38@tcp:101:stat.0 Request processed in 25784us (25995us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071490.972807:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 63 00000100:00100000:2.0:1783071491.065461:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071491.065560:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692865920 00000100:00100000:3.0:1783071491.065573:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692865920 00000100:00100000:3.0:1783071491.065657:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 64 00000100:00100000:3.0:1783071491.065671:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3b778700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+43:11239:x1869685692865920:12345-192.168.204.38@tcp:36:truncate.0 00010000:00010000:3.0:1783071491.065733:0:13815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071491.065761:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864800/0x6b58994c2cbdc4b5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98dfe expref: 43 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071491.065784:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f8a0179f900) 00010000:00010000:3.0:1783071491.065790:0:13815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783071491.065988:0:13815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdc4bc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071491.066002:0:13815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdc4bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071491.066012:0:13815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdc4bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783071491.066060:0:13815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:3.0:1783071491.066078:0:13815:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006f3f97e5 reply state 00000000a94fa924 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdc4bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071491.066089:0:13815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdc4bc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071491.066095:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f8a0179f900) 00010000:00010000:3.0:1783071491.066098:0:13815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783071491.066100:0:13815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783071491.066192:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3b778700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+45:11239:x1869685692865920:12345-192.168.204.38@tcp:36:truncate.0 Request processed in 526us (745us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1783071491.066200:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 64 00000020:00080000:3.0:1783071491.066206:0:13815:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:1.0:1783071491.066334:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1783071491.267826:0:13796:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1783071491.272245:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071491.272690:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692866048 00000100:00100000:3.0:1783071491.272701:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692866048 00000100:00100000:3.0:1783071491.272890:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 65 00000100:00100000:3.0:1783071491.272902:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3b77b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+45:11253:x1869685692866048:12345-192.168.204.38@tcp:101:stat.0 00010000:00010000:3.0:1783071491.272926:0:10292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071491.272953:0:10292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9600/0x6b58994c2cbdc4c3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98e05 expref: -99 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071491.273053:0:10292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9400/0x6b58994c2cbdc4ca lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071491.273067:0:10292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9400/0x6b58994c2cbdc4ca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071491.273081:0:10292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9400/0x6b58994c2cbdc4ca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071491.273092:0:10292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8200/0x6b58994c2cbdc4d1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071491.273099:0:10292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8200/0x6b58994c2cbdc4d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071491.273105:0:10292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8200/0x6b58994c2cbdc4d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071491.273183:0:10292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460200/0x6b58994c2cbdc4d8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071491.273192:0:10292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460200/0x6b58994c2cbdc4d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071491.273209:0:10292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460200/0x6b58994c2cbdc4d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783071491.273256:0:10292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1783071491.273260:0:10292:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783071491.273292:0:10292:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460200/0x6b58994c2cbdc4d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071491.273313:0:10292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460200/0x6b58994c2cbdc4d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071491.273322:0:10292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9400/0x6b58994c2cbdc4ca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071491.273327:0:10292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9400/0x6b58994c2cbdc4ca lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071491.273333:0:10292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9400/0x6b58994c2cbdc4ca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071491.273339:0:10292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b014b9400 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071491.273343:0:10292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9400/0x6b58994c2cbdc4ca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071491.273351:0:10292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9400/0x6b58994c2cbdc4ca lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071491.273405:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f8a0179f400) 00010000:00010000:3.0:1783071491.273409:0:10292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071491.273414:0:10292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9400/0x6b58994c2cbdc4ca lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071491.273421:0:10292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9400/0x6b58994c2cbdc4ca lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071491.273437:0:10292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8200/0x6b58994c2cbdc4d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071491.273442:0:10292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8200/0x6b58994c2cbdc4d1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071491.273454:0:10292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8200/0x6b58994c2cbdc4d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071491.273460:0:10292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b014b8200 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071491.273463:0:10292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8200/0x6b58994c2cbdc4d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071491.273469:0:10292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8200/0x6b58994c2cbdc4d1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071491.273477:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f8a0179f500) 00010000:00010000:3.0:1783071491.273479:0:10292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071491.273483:0:10292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8200/0x6b58994c2cbdc4d1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071491.273488:0:10292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8200/0x6b58994c2cbdc4d1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071491.273529:0:10292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9600/0x6b58994c2cbdc4c3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e05 expref: 47 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071491.273542:0:10292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460200/0x6b58994c2cbdc4d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e05 expref: 46 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071491.273548:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f8a0179f900) 00010000:00010000:3.0:1783071491.273551:0:10292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783071491.273553:0:10292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b3c460200, rc 0) 00000100:00100000:3.0:1783071491.273624:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3b77b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+46:11253:x1869685692866048:12345-192.168.204.38@tcp:101:stat.0 Request processed in 725us (1390us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071491.273645:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 65 00010000:00010000:0.0:1783071491.330854:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071491.333470:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071491.333499:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692866304 00000100:00100000:1.0:1783071491.333512:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692866304 00000100:00100000:1.0:1783071491.333574:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 66 00000100:00100000:1.0:1783071491.333585:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+46:11263:x1869685692866304:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1783071491.333608:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071491.333630:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc4df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98e0c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783071491.333892:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1783071491.334061:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc4df lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e0c expref: 48 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.334078:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8a020cad00) 00010000:00010000:1.0:1783071491.334081:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783071491.334086:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc4df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e0c expref: 48 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.334114:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a01748200, rc 0) 00000100:00100000:1.0:1783071491.334174:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+47:11263:x1869685692866304:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 592us (714us total) trans 4294967341 rc 301/301 00000100:00100000:1.0:1783071491.334182:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 66 00000040:00080000:2.0:1783071491.334577:0:13798:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1783071491.340290:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071491.340540:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692866560 00000100:00100000:1.0:1783071491.340550:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692866560 00000100:00100000:1.0:1783071491.340893:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 14 00000100:00100000:1.0:1783071491.340913:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3b778a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+47:11263:x1869685692866560:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1783071491.341279:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3b778a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+48:11263:x1869685692866560:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 367us (997us total) trans 4294967342 rc 0/0 00000100:00100000:1.0:1783071491.341287:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 14 00000100:00100000:3.0:1783071491.391813:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071491.392073:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692866816 00000100:00100000:2.0:1783071491.392083:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692866816 00000100:00100000:2.0:1783071491.392147:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 67 00000100:00100000:2.0:1783071491.392158:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37ab9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+48:11269:x1869685692866816:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:2.0:1783071491.392182:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071491.392201:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdc4ed lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98e13 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071491.392308:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc4f4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071491.392325:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460200/0x6b58994c2cbdc4d8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e05 expref: 49 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071491.392334:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc4f4 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071491.392406:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460200/0x6b58994c2cbdc4d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e05 expref: 49 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071491.392418:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460200/0x6b58994c2cbdc4d8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e05 expref: 49 pid: 10292 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071491.392431:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3b77b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6516:1869685707632640:192.168.204.38@tcp:104: 00000100:00100000:2.0:1783071491.392527:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b05e0b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783071491.394808:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783071491.394827:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37ab8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707632768:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783071491.394917:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071491.395035:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707632768 00000100:00100000:3.0:1783071491.395043:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707632768 00000100:00100000:3.0:1783071491.395151:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1783071491.395162:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07795880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707632768:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783071491.395197:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783071491.395255:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07795880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707632768:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071491.395262:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1783071491.395334:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37ab8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707632768:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783071491.396908:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071491.397043:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3b77b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6516:1869685707632640:192.168.204.38@tcp:104: 00010000:00010000:2.0:1783071491.397072:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc4f4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071491.397238:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692866944 00000100:00100000:0.0:1783071491.397247:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692866944 00010000:00010000:0.0:1783071491.397285:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460200/0x6b58994c2cbdc4d8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e05 expref: 50 pid: 10292 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071491.397336:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 57 00000100:00100000:0.0:1783071491.397346:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab8c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf7532e4-6153-424a-9f4e-84941256b41f+50:2405:x1869685692866944:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783071491.397380:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071491.397387:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460200/0x6b58994c2cbdc4d8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e05 expref: 50 pid: 10292 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071491.397400:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460200/0x6b58994c2cbdc4d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e05 expref: 50 pid: 10292 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071491.397424:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460200/0x6b58994c2cbdc4d8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e05 expref: 50 pid: 10292 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071491.397453:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f8a0179f900) 00010000:00010000:0.0:1783071491.397458:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc4f4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071491.397468:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc4f4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071491.397475:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc4f4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071491.397508:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071491.397555:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab8c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf7532e4-6153-424a-9f4e-84941256b41f+49:2405:x1869685692866944:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 210us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071491.397561:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 57 00010000:00010000:2.0:1783071491.397598:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc4f4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071491.397607:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc4f4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071491.397628:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1783071491.397768:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdc4ed lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e13 expref: 50 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071491.397784:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc4f4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e13 expref: 49 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071491.397793:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f8a0179f900) 00010000:00010000:2.0:1783071491.397796:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783071491.397799:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b2fd67600, rc 0) 00000100:00100000:2.0:1783071491.397840:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37ab9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+49:11269:x1869685692866816:12345-192.168.204.38@tcp:101:bash.0 Request processed in 5684us (6037us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1783071491.397847:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 67 00000100:00100000:3.0:1783071491.401356:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071491.401427:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692867200 00000100:00100000:0.0:1783071491.401438:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692867200 00000100:00100000:0.0:1783071491.401513:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 68 00000100:00100000:0.0:1783071491.401525:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37abb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+49:11269:x1869685692867200:12345-192.168.204.38@tcp:36:bash.0 00010000:00010000:0.0:1783071491.401826:0:10292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865200/0x6b58994c2cbdc502 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071491.401845:0:10292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865200/0x6b58994c2cbdc502 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071491.401857:0:10292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865200/0x6b58994c2cbdc502 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783071491.401896:0:10292:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:0.0:1783071491.401916:0:10292:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005c7f9614 reply state 00000000815fa41c transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865200/0x6b58994c2cbdc502 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071491.401949:0:10292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865200/0x6b58994c2cbdc502 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071491.401958:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f8a0179f900) 00010000:00010000:0.0:1783071491.401960:0:10292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783071491.401965:0:10292:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783071491.402073:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37abb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+52:11269:x1869685692867200:12345-192.168.204.38@tcp:36:bash.0 Request processed in 549us (738us total) trans 4294967345 rc 0/0 00000100:00100000:0.0:1783071491.402081:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 68 00000020:00080000:0.0:1783071491.402087:0:10292:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1783071491.411842:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071491.411976:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692867328 00000100:00100000:1.0:1783071491.411988:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692867328 00000100:00100000:1.0:1783071491.412066:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 69 00000100:00100000:1.0:1783071491.412077:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37ab8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+52:11269:x1869685692867328:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:1.0:1783071491.412105:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071491.412125:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc509 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98e1a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.412220:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdc510 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.412236:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc4f4 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e13 expref: 53 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.412269:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdc510 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.412303:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc4f4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e13 expref: 53 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.412317:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc4f4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e13 expref: 53 pid: 6516 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071491.412339:0:6517:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37abc000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1869685707632896:192.168.204.38@tcp:104: 00000100:00100000:1.0:1783071491.412476:0:6517:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a038a8240 going to sleep for 11 seconds 00000100:00100000:1.0:1783071491.415433:0:6517:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37abc000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1869685707632896:192.168.204.38@tcp:104: 00010000:00010000:1.0:1783071491.415461:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdc510 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071491.417851:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071491.417921:0:7923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692867456 00000100:00100000:0.0:1783071491.417941:0:7923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692867456 00010000:00010000:0.0:1783071491.417983:0:7923:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc4f4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e13 expref: 54 pid: 6516 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071491.418086:0:7923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 58 00000100:00100000:0.0:1783071491.418101:0:7923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37abb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf7532e4-6153-424a-9f4e-84941256b41f+54:2406:x1869685692867456:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783071491.418120:0:7923:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071491.418136:0:7923:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc4f4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e13 expref: 54 pid: 6516 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071491.418152:0:7923:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc4f4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e13 expref: 54 pid: 6516 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071491.418174:0:7923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc4f4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e13 expref: 54 pid: 6516 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071491.418211:0:7923:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f8a0179f900) 00010000:00010000:0.0:1783071491.418217:0:7923:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdc510 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071491.418227:0:7923:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdc510 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071491.418234:0:7923:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdc510 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071491.418275:0:7923:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071491.418332:0:7923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37abb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf7532e4-6153-424a-9f4e-84941256b41f+53:2406:x1869685692867456:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 233us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071491.418339:0:7923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 58 00010000:00010000:1.0:1783071491.418568:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdc510 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.418579:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdc510 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783071491.418638:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1783071491.418642:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783071491.418664:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdc510 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.418698:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc509 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e1a expref: 53 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.418726:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdc510 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e1a expref: 52 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.418736:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f8a0179f900) 00010000:00010000:1.0:1783071491.418740:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783071491.418742:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a01749e00, rc 0) 00000100:00100000:1.0:1783071491.418783:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37ab8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+52:11269:x1869685692867328:12345-192.168.204.38@tcp:101:bash.0 Request processed in 6708us (6953us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071491.418792:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 69 00000100:00100000:3.0:1783071491.426124:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071491.426235:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692867712 00000100:00100000:0.0:1783071491.426256:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692867712 00000100:00100000:0.0:1783071491.426329:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 15 00000100:00100000:0.0:1783071491.426339:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0699e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+52:11269:x1869685692867712:12345-192.168.204.38@tcp:35:bash.0 00000100:00100000:0.0:1783071491.426635:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0699e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+53:11269:x1869685692867712:12345-192.168.204.38@tcp:35:bash.0 Request processed in 296us (521us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1783071491.426643:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 15 00000100:00100000:2.0:1783071491.494849:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071491.494967:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692867968 00000100:00100000:3.0:1783071491.494979:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692867968 00000100:00100000:3.0:1783071491.495049:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 70 00000100:00100000:3.0:1783071491.495061:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07796a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+53:11279:x1869685692867968:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1783071491.495087:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071491.495109:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460400/0x6b58994c2cbdc517 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98e21 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783071491.495227:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1783071491.495338:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460400/0x6b58994c2cbdc517 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e21 expref: 55 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071491.495403:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8a020cad00) 00010000:00010000:3.0:1783071491.495407:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783071491.495413:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460400/0x6b58994c2cbdc517 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e21 expref: 55 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071491.495429:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b3c460400, rc 0) 00000100:00100000:3.0:1783071491.495544:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07796a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+54:11279:x1869685692867968:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 486us (704us total) trans 4294967347 rc 301/301 00000100:00100000:3.0:1783071491.495552:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 70 00000100:00100000:3.0:1783071491.501015:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071491.501186:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692868096 00000100:00100000:0.0:1783071491.501197:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692868096 00000100:00100000:0.0:1783071491.501264:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 71 00000100:00100000:0.0:1783071491.501277:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37aba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+54:11279:x1869685692868096:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:0.0:1783071491.501389:0:10292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdc525 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071491.501424:0:10292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdc525 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071491.501438:0:10292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdc525 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071491.501452:0:10292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864400/0x6b58994c2cbdc52c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071491.501460:0:10292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864400/0x6b58994c2cbdc52c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071491.501467:0:10292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864400/0x6b58994c2cbdc52c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071491.501549:0:10292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865400/0x6b58994c2cbdc533 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071491.501558:0:10292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865400/0x6b58994c2cbdc533 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071491.501566:0:10292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865400/0x6b58994c2cbdc533 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783071491.501626:0:10292:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865400/0x6b58994c2cbdc533 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071491.501640:0:10292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdc525 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071491.501646:0:10292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdc525 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071491.501664:0:10292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdc525 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071491.501670:0:10292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03865a00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:0.0:1783071491.501674:0:10292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdc525 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071491.501682:0:10292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdc525 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071491.501694:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f8a0179f400) 00010000:00010000:0.0:1783071491.501698:0:10292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071491.501703:0:10292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdc525 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071491.501709:0:10292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdc525 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071491.501721:0:10292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864400/0x6b58994c2cbdc52c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071491.501727:0:10292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864400/0x6b58994c2cbdc52c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071491.501732:0:10292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864400/0x6b58994c2cbdc52c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071491.501738:0:10292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03864400 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:0.0:1783071491.501740:0:10292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864400/0x6b58994c2cbdc52c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071491.501756:0:10292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864400/0x6b58994c2cbdc52c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071491.501765:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f8a0179f500) 00010000:00010000:0.0:1783071491.501767:0:10292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071491.501771:0:10292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864400/0x6b58994c2cbdc52c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071491.501776:0:10292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864400/0x6b58994c2cbdc52c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071491.501787:0:10292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865400/0x6b58994c2cbdc533 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071491.501793:0:10292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865400/0x6b58994c2cbdc533 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071491.501799:0:10292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865400/0x6b58994c2cbdc533 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071491.501804:0:10292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03865400 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:0.0:1783071491.501806:0:10292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865400/0x6b58994c2cbdc533 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071491.501813:0:10292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865400/0x6b58994c2cbdc533 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071491.501820:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f8a0179f900) 00010000:00010000:0.0:1783071491.501822:0:10292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071491.501825:0:10292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865400/0x6b58994c2cbdc533 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071491.501839:0:10292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865400/0x6b58994c2cbdc533 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071491.502002:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37aba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+54:11279:x1869685692868096:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 726us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071491.502011:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 71 00000100:00100000:2.0:1783071491.507970:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071491.508071:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692868352 00000100:00100000:1.0:1783071491.508082:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692868352 00000100:00100000:1.0:1783071491.508146:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 16 00000100:00100000:1.0:1783071491.508158:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07794380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+54:11279:x1869685692868352:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1783071491.508442:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07794380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+55:11279:x1869685692868352:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 286us (483us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1783071491.508451:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 16 00000100:00100000:2.0:1783071491.549061:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071491.549253:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692868608 00000100:00100000:1.0:1783071491.549265:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692868608 00000100:00100000:1.0:1783071491.549332:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 72 00000100:00100000:1.0:1783071491.549344:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07795500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+55:11282:x1869685692868608:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1783071491.549414:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071491.549436:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc53a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98e28 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.549662:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748600/0x6b58994c2cbdc541 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.549694:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748600/0x6b58994c2cbdc541 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.549706:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748600/0x6b58994c2cbdc541 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.549720:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdc548 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.549727:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdc548 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.549735:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdc548 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.550221:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdc54f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.550233:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdc54f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.550241:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdc54f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783071491.550252:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1783071491.550343:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748600/0x6b58994c2cbdc541 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.550352:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748600/0x6b58994c2cbdc541 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.550360:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748600/0x6b58994c2cbdc541 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.550405:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01748600 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:1.0:1783071491.550410:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748600/0x6b58994c2cbdc541 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.550418:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748600/0x6b58994c2cbdc541 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.550432:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f8a0179f400) 00010000:00010000:1.0:1783071491.550435:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071491.550439:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748600/0x6b58994c2cbdc541 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.550446:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748600/0x6b58994c2cbdc541 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.550461:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdc548 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.550537:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdc548 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.550544:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdc548 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.550549:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01749600 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:1.0:1783071491.550552:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdc548 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.550557:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdc548 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.550576:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f8a0179f500) 00010000:00010000:1.0:1783071491.550579:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071491.550581:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdc548 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.550588:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdc548 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.550633:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc53a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e28 expref: 58 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.550648:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdc54f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e28 expref: 57 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.550660:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f8a0179f900) 00010000:00010000:1.0:1783071491.550663:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783071491.550665:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a01749c00, rc 0) 00000100:00100000:1.0:1783071491.550742:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07795500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+57:11282:x1869685692868608:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1399us (1691us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1783071491.550750:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 72 00000100:00100000:3.0:1783071491.559414:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071491.559475:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071491.560767:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692868736 00000100:00100000:2.0:1783071491.560794:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692868736 00000100:00100000:2.0:1783071491.560870:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 73 00000100:00100000:2.0:1783071491.560881:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37abb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+57:11282:x1869685692868736:12345-192.168.204.38@tcp:54:lfs.0 00010000:00010000:2.0:1783071491.561036:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdc55d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071491.561054:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdc55d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071491.561069:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdc55d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071491.561103:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdc55d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071491.561111:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdc55d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071491.561117:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdc55d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071491.561124:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd67200 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:2.0:1783071491.561129:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdc55d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071491.561135:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692868864 00010000:00010000:2.0:1783071491.561137:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdc55d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071491.561140:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692868864 00010000:00010000:2.0:1783071491.561151:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f8a0179f900) 00010000:00010000:2.0:1783071491.561154:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783071491.561160:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdc55d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071491.561176:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdc55d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071491.561188:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 5 00000100:00100000:1.0:1783071491.561196:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37ab8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf7532e4-6153-424a-9f4e-84941256b41f+58:2405:x1869685692868864:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783071491.561207:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071491.561222:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdc54f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e28 expref: 58 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.561244:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f8a0179f900) 00010000:00010000:1.0:1783071491.561247:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071491.561318:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37ab8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf7532e4-6153-424a-9f4e-84941256b41f+57:2405:x1869685692868864:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 122us (1842us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071491.561327:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 5 00000100:00100000:2.0:1783071491.561858:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37abb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+56:11282:x1869685692868736:12345-192.168.204.38@tcp:54:lfs.0 Request processed in 978us (2454us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071491.561867:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 73 00000100:00100000:3.0:1783071491.564047:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071491.564187:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692869120 00000100:00100000:1.0:1783071491.564203:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692869120 00000100:00100000:1.0:1783071491.564319:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 17 00000100:00100000:1.0:1783071491.564330:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37ab8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+56:11282:x1869685692869120:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1783071491.564618:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37ab8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+57:11282:x1869685692869120:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 289us (579us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1783071491.564626:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 17 00000100:00100000:3.0:1783071491.711207:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071491.711402:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692869376 00000100:00100000:0.0:1783071491.711415:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692869376 00000100:00100000:0.0:1783071491.711481:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 74 00000100:00100000:0.0:1783071491.711493:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37ab9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+57:11300:x1869685692869376:12345-192.168.204.38@tcp:101:cat.0 00010000:00010000:0.0:1783071491.711523:0:10292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071491.711546:0:10292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865400/0x6b58994c2cbdc564 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98e2f expref: -99 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071491.711664:0:10292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864400/0x6b58994c2cbdc56b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071491.711682:0:10292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864400/0x6b58994c2cbdc56b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071491.711692:0:10292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864400/0x6b58994c2cbdc56b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783071491.711703:0:10292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1783071491.711829:0:10292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865400/0x6b58994c2cbdc564 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e2f expref: 60 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071491.711849:0:10292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864400/0x6b58994c2cbdc56b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e2f expref: 59 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071491.711873:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f8a0179f900) 00010000:00010000:0.0:1783071491.711877:0:10292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1783071491.711880:0:10292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a03864400, rc 0) 00000100:00100000:0.0:1783071491.711966:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37ab9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+59:11300:x1869685692869376:12345-192.168.204.38@tcp:101:cat.0 Request processed in 475us (770us total) trans 4294967351 rc 0/0 00000100:00100000:0.0:1783071491.711974:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 74 00000100:00100000:3.0:1783071491.737276:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071491.737422:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692869504 00000100:00100000:1.0:1783071491.737433:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692869504 00000100:00100000:1.0:1783071491.737498:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 75 00000100:00100000:1.0:1783071491.737510:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37aba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+59:11301:x1869685692869504:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1783071491.737594:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071491.737618:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc579 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98e36 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.737712:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdc580 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.737728:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdc580 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.737751:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdc580 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783071491.737808:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1783071491.737813:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783071491.737834:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdc580 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.737860:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc579 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e36 expref: 61 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.737879:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdc580 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e36 expref: 60 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.737888:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f8a0179f400) 00010000:00010000:1.0:1783071491.737892:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783071491.737895:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a01749600, rc 0) 00000100:00100000:1.0:1783071491.738043:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37aba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+60:11301:x1869685692869504:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 535us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071491.738051:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 75 00000100:00100000:1.0:1783071491.743946:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071491.747131:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692869888 00000100:00100000:0.0:1783071491.747148:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692869888 00000100:00100000:0.0:1783071491.747313:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18 00000100:00100000:0.0:1783071491.747326:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37abc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+60:11301:x1869685692869888:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1783071491.747736:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37abc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+61:11301:x1869685692869888:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 411us (3807us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1783071491.747744:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18 00000100:00100000:2.0:1783071491.750080:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071491.750177:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692870016 00000100:00100000:1.0:1783071491.750187:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692870016 00000100:00100000:1.0:1783071491.750252:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 6 00000100:00100000:1.0:1783071491.750263:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07795f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf7532e4-6153-424a-9f4e-84941256b41f+61:11301:x1869685692870016:12345-192.168.204.38@tcp:103:lfs.0 00010000:00010000:1.0:1783071491.750277:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1783071491.750303:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdc510 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e1a expref: 61 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.750341:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864400/0x6b58994c2cbdc56b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e2f expref: 60 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.750355:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9e00/0x6b58994c2cbdc40d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98dd4 expref: 59 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.750412:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f8a0179f900) 00010000:00010000:1.0:1783071491.750427:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071491.750979:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07795f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf7532e4-6153-424a-9f4e-84941256b41f+58:11301:x1869685692870016:12345-192.168.204.38@tcp:103:lfs.0 Request processed in 716us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071491.750987:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 6 00000100:00100000:3.0:1783071491.760265:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071491.760358:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692870144 00000100:00100000:1.0:1783071491.760393:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692870144 00000100:00100000:1.0:1783071491.760463:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 76 00000100:00100000:1.0:1783071491.760475:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37abbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+58:11301:x1869685692870144:12345-192.168.204.38@tcp:58:lfs.0 00010000:00010000:1.0:1783071491.760628:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc587 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.760647:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc587 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.760659:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc587 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783071491.760943:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783071491.761985:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1783071491.763431:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1783071491.764095:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37abbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+58:11301:x1869685692870144:12345-192.168.204.38@tcp:58:lfs.0 Request processed in 3615us (3833us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071491.764107:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 76 00000100:00100000:3.0:1783071491.810270:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071491.810891:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692870272 00000100:00100000:1.0:1783071491.810908:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692870272 00000100:00100000:1.0:1783071491.811014:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 77 00000100:00100000:1.0:1783071491.811027:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37ab9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+58:11303:x1869685692870272:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1783071491.811059:0:13815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071491.811086:0:13815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdc58e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98e3d expref: -99 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.811177:0:13815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748600/0x6b58994c2cbdc595 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.811197:0:13815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748600/0x6b58994c2cbdc595 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.811211:0:13815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748600/0x6b58994c2cbdc595 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.811223:0:13815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdc59c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.811230:0:13815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdc59c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.811236:0:13815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdc59c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.811351:0:13815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc5a3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.811432:0:13815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc5a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.811439:0:13815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc5a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783071491.811843:0:13815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1783071491.811850:0:13815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783071491.811880:0:13815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc5a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.811895:0:13815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc5a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.811905:0:13815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748600/0x6b58994c2cbdc595 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.811913:0:13815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748600/0x6b58994c2cbdc595 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.811920:0:13815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748600/0x6b58994c2cbdc595 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.811936:0:13815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01748600 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:1.0:1783071491.811941:0:13815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748600/0x6b58994c2cbdc595 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.811949:0:13815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748600/0x6b58994c2cbdc595 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.811966:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f8a0179f400) 00010000:00010000:1.0:1783071491.811979:0:13815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071491.811986:0:13815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748600/0x6b58994c2cbdc595 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.811994:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748600/0x6b58994c2cbdc595 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.812029:0:13815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdc59c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.812035:0:13815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdc59c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.812041:0:13815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdc59c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.812046:0:13815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01749400 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:1.0:1783071491.812049:0:13815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdc59c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.812055:0:13815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdc59c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.812063:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f8a0179f500) 00010000:00010000:1.0:1783071491.812067:0:13815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071491.812070:0:13815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdc59c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.812076:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdc59c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.812114:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdc58e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e3d expref: 60 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.812142:0:13815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc5a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e3d expref: 59 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071491.812149:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f8a0179f900) 00010000:00010000:1.0:1783071491.812151:0:13815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783071491.812154:0:13815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a01748000, rc 0) 00000100:00100000:1.0:1783071491.812254:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37ab9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+59:11303:x1869685692870272:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1229us (2002us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071491.812265:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 77 00000040:00080000:2.0:1783071492.290641:0:13796:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783071492.290655:0:13796:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783071492.290700:0:13796:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1783071492.290709:0:13796:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783071492.290893:0:13796:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b07796d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13796:1869685707633024:192.168.204.38@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783071492.291036:0:13796:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b05e0b540 going to sleep for 11 seconds 00000100:00100000:2.0:1783071492.298875:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071492.298939:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692870400 00000100:00100000:2.0:1783071492.298952:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692870400 00000100:00100000:2.0:1783071492.299033:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 78 00000100:00100000:2.0:1783071492.299047:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07795c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+60:11314:x1869685692870400:12345-192.168.204.38@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783071492.299094:0:6518:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783071492.301357:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07795c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+60:11314:x1869685692870400:12345-192.168.204.38@tcp:53:lhsmtool_posix.0 Request processed in 2302us (2485us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071492.301398:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 78 00000100:00100000:3.0:1783071492.301503:0:13796:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b07796d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13796:1869685707633024:192.168.204.38@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783071492.314156:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071492.314940:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692870528 00000100:00100000:0.0:1783071492.314956:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692870528 00000100:00100000:0.0:1783071492.315203:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 79 00000100:00100000:0.0:1783071492.315215:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37abca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+59:11314:x1869685692870528:12345-192.168.204.38@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1783071492.315293:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdc5aa lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.315311:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdc5aa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.315327:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdc5aa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.315416:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864000/0x6b58994c2cbdc5b1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.315426:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864000/0x6b58994c2cbdc5b1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.315434:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864000/0x6b58994c2cbdc5b1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.315470:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865000/0x6b58994c2cbdc5b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.315480:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865000/0x6b58994c2cbdc5b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.315487:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865000/0x6b58994c2cbdc5b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783071492.315535:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1783071492.315540:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783071492.315558:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865000/0x6b58994c2cbdc5b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.315571:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdc5aa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.315577:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdc5aa lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.315584:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdc5aa lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.315601:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03864e00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:0.0:1783071492.315606:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdc5aa lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.315616:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdc5aa lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.315633:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f8b0d17fa00) 00010000:00010000:0.0:1783071492.315636:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071492.315641:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdc5aa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.315648:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdc5aa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.315664:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864000/0x6b58994c2cbdc5b1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.315671:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864000/0x6b58994c2cbdc5b1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.315676:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864000/0x6b58994c2cbdc5b1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.315681:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03864000 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:0.0:1783071492.315684:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864000/0x6b58994c2cbdc5b1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.315691:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864000/0x6b58994c2cbdc5b1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.315710:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff8f8b10db4500) 00010000:00010000:0.0:1783071492.315712:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071492.315715:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864000/0x6b58994c2cbdc5b1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.315720:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864000/0x6b58994c2cbdc5b1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.315744:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865000/0x6b58994c2cbdc5b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.315751:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865000/0x6b58994c2cbdc5b8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.315757:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865000/0x6b58994c2cbdc5b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.315762:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03865000 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:0.0:1783071492.315766:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865000/0x6b58994c2cbdc5b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.315773:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865000/0x6b58994c2cbdc5b8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.315780:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f8a0179f900) 00010000:00010000:0.0:1783071492.315782:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071492.315786:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865000/0x6b58994c2cbdc5b8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.315791:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865000/0x6b58994c2cbdc5b8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071492.315882:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37abca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+59:11314:x1869685692870528:12345-192.168.204.38@tcp:34:lhsmtool_posix.0 Request processed in 668us (1739us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071492.315890:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 79 00000100:00100000:3.0:1783071492.326737:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071492.326785:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692870784 00000100:00100000:3.0:1783071492.326797:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692870784 00000100:00100000:3.0:1783071492.326869:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 80 00000100:00100000:3.0:1783071492.326881:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37abaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+59:11314:x1869685692870784:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783071492.326911:0:13815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071492.326948:0:13815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461c00/0x6b58994c2cbdc5bf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98e44 expref: -99 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.327109:0:13815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460400/0x6b58994c2cbdc5c6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.327128:0:13815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460400/0x6b58994c2cbdc5c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.327140:0:13815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460400/0x6b58994c2cbdc5c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783071492.327153:0:13815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1783071492.327260:0:13815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460400/0x6b58994c2cbdc5c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.327267:0:13815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460400/0x6b58994c2cbdc5c6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.327274:0:13815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460400/0x6b58994c2cbdc5c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.327280:0:13815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b3c460400 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071492.327285:0:13815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460400/0x6b58994c2cbdc5c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.327293:0:13815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460400/0x6b58994c2cbdc5c6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.327308:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f8a0179f900) 00010000:00010000:3.0:1783071492.327311:0:13815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783071492.327317:0:13815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460400/0x6b58994c2cbdc5c6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.327332:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460400/0x6b58994c2cbdc5c6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.327417:0:13815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461c00/0x6b58994c2cbdc5bf lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e44 expref: 61 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.327429:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f8b0d17fa00) 00010000:00010000:3.0:1783071492.327432:0:13815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783071492.327438:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461c00/0x6b58994c2cbdc5bf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e44 expref: 61 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.327449:0:13815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b3c461c00, rc 0) 00000100:00100000:3.0:1783071492.327530:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37abaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+60:11314:x1869685692870784:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 651us (804us total) trans 4294967353 rc 301/301 00000100:00100000:3.0:1783071492.327538:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 80 00000100:00100000:3.0:1783071492.332213:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071492.332323:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692870912 00000100:00100000:0.0:1783071492.332339:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692870912 00000100:00100000:0.0:1783071492.332448:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 81 00000100:00100000:0.0:1783071492.332464:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37ab8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+60:11314:x1869685692870912:12345-192.168.204.38@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783071492.332507:0:6518:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783071492.332840:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37ab8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+60:11314:x1869685692870912:12345-192.168.204.38@tcp:53:lhsmtool_posix.0 Request processed in 380us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071492.332849:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 81 00000100:00100000:3.0:1783071492.346867:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071492.349730:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692871168 00000100:00100000:0.0:1783071492.349746:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692871168 00000100:00100000:0.0:1783071492.349819:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 82 00000100:00100000:0.0:1783071492.349835:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37ab9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+60:11314:x1869685692871168:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783071492.349857:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071492.349860:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1783071492.349891:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdc580 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e36 expref: 60 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.349909:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f8a0179f400) 00010000:00010000:0.0:1783071492.349924:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783071492.349939:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865000/0x6b58994c2cbdc5d4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98e4b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783071492.350357:0:6516:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:0.0:1783071492.350575:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864000/0x6b58994c2cbdc5db lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.350589:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864000/0x6b58994c2cbdc5db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.350599:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864000/0x6b58994c2cbdc5db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.350652:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865000/0x6b58994c2cbdc5d4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e4b expref: 62 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.350666:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864000/0x6b58994c2cbdc5db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e4b expref: 61 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.350674:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f8b10db4500) 00010000:00010000:0.0:1783071492.350677:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783071492.350680:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a03864000, rc 0) 00000100:00100000:0.0:1783071492.350749:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37ab9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+61:11314:x1869685692871168:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 920us (3898us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1783071492.350757:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 82 00000100:00100000:3.0:1783071492.355112:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071492.355213:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692871424 00000100:00100000:0.0:1783071492.355229:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692871424 00000100:00100000:0.0:1783071492.355306:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 83 00000100:00100000:0.0:1783071492.355315:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37ab9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+61:11314:x1869685692871424:12345-192.168.204.38@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783071492.355415:0:10292:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071492.355454:0:10292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864000/0x6b58994c2cbdc5db lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e4b expref: 61 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.355476:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f8b10db4500) 00010000:00010000:0.0:1783071492.355499:0:10292:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783071492.355521:0:10292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdc5e9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.355534:0:10292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdc5e9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.355545:0:10292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdc5e9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.355557:0:10292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdc5f0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x672a3d3e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.355673:0:10292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdc5f0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x672a3d3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.355682:0:10292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdc5f0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x672a3d3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.355739:0:10292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdc5e9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.355747:0:10292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdc5e9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.355754:0:10292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdc5e9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.355773:0:10292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03864e00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:0.0:1783071492.355786:0:10292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdc5e9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.355793:0:10292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdc5e9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.355803:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f8a0179f400) 00010000:00010000:0.0:1783071492.355806:0:10292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071492.355811:0:10292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdc5e9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.355817:0:10292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdc5e9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.355828:0:10292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdc5f0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x672a3d3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.355834:0:10292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdc5f0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x672a3d3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.355839:0:10292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdc5f0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x672a3d3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.355844:0:10292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03865a00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:0.0:1783071492.355846:0:10292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdc5f0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x672a3d3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.355851:0:10292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdc5f0 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x672a3d3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.355858:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x672a3d3e (ffff8f8b10db4600) 00010000:00010000:0.0:1783071492.355860:0:10292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071492.355869:0:10292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdc5f0 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x672a3d3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.355875:0:10292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdc5f0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x672a3d3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071492.355992:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37ab9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+60:11314:x1869685692871424:12345-192.168.204.38@tcp:36:lhsmtool_posix.0 Request processed in 676us (897us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783071492.356001:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 83 00010000:00010000:0.0:1783071492.356059:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071492.361408:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071492.361480:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692871552 00000100:00100000:2.0:1783071492.361495:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692871552 00000100:00100000:2.0:1783071492.361699:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 84 00000100:00100000:2.0:1783071492.361713:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c68ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+60:11314:x1869685692871552:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783071492.361755:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071492.361786:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66400/0x6b58994c2cbdc5f7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98e52 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.361834:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc5fe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.361851:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc5fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.361865:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc5fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.362021:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66400/0x6b58994c2cbdc5f7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e52 expref: 62 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.362040:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc5fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e52 expref: 61 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.362050:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f8a020ca400) 00010000:00010000:2.0:1783071492.362053:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783071492.362057:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b2fd67600, rc 0) 00000100:00100000:2.0:1783071492.362142:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c68ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+61:11314:x1869685692871552:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 432us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071492.362150:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 84 00000100:00100000:2.0:1783071492.366343:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071492.366463:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692871808 00000100:00100000:1.0:1783071492.366477:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692871808 00000100:00100000:1.0:1783071492.367907:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 85 00000100:00100000:1.0:1783071492.367942:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07794700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+61:11314:x1869685692871808:12345-192.168.204.38@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783071492.369497:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc605 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071492.369530:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc605 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071492.369544:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc605 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783071492.377036:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:1.0:1783071492.377072:0:6516:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 394165707222ns, next at 395165697222ns, rc = 0 00000004:00010000:1.0:1783071492.377193:0:6516:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001d69e26c reply state 000000009f72a8bb transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc605 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071492.377247:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc605 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071492.377258:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f8a020ca400) 00010000:00010000:1.0:1783071492.377262:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1783071492.377267:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783071492.377784:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07794700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+63:11314:x1869685692871808:12345-192.168.204.38@tcp:36:lhsmtool_posix.0 Request processed in 9846us (11450us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1783071492.377796:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 85 00000100:00100000:3.0:1783071492.393857:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071492.394042:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692871936 00000100:00100000:2.0:1783071492.394057:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692871936 00000100:00100000:2.0:1783071492.394146:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 86 00000100:00100000:2.0:1783071492.394176:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37ab8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+63:11314:x1869685692871936:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783071492.394212:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071492.394245:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdc60c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98e59 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.394325:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdc60c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e59 expref: 64 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.394342:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdc60c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e59 expref: 64 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.394406:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f8a020ca400) 00010000:00010000:2.0:1783071492.394410:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783071492.394416:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b2fd66200, rc 0) 00000100:00100000:2.0:1783071492.394516:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37ab8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+64:11314:x1869685692871936:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 342us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071492.394525:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 86 00000100:00100000:2.0:1783071492.405144:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071492.405258:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692872064 00000100:00100000:3.0:1783071492.405273:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692872064 00000100:00100000:3.0:1783071492.405339:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 32 00000100:00100000:3.0:1783071492.405351:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07797800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2402:x1869685692872064:12345-192.168.204.38@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1783071492.405427:0:8431:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from bf7532e4-6153-424a-9f4e-84941256b41f@192.168.204.38@tcp t0 exp 0000000000000000 cur 394 last 0 00000020:00000080:3.0:1783071492.408056:0:8431:0:(genops.c:1406:class_connect()) connect: client bf7532e4-6153-424a-9f4e-84941256b41f, cookie 0x6b58994c2cbdc613 00002000:00100000:3.0:1783071492.408086:0:8431:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli bf7532e4-6153-424a-9f4e-84941256b41f/ffff8f8a03a55000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783071492.408129:0:8431:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783071492.408259:0:8431:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1783071492.408314:0:8431:0:(import.c:65:import_set_state_nolock()) ffff8f8a03a52800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783071492.408423:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07797800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf7532e4-6153-424a-9f4e-84941256b41f+6:2402:x1869685692872064:12345-192.168.204.38@tcp:8:lhsmtool_posix.0 Request processed in 3072us (3298us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071492.408435:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 32 00000100:00100000:0.0:1783071492.416065:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071492.426829:0:8910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692872192 00000100:00100000:1.0:1783071492.426845:0:8910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692872192 00000100:00100000:1.0:1783071492.427306:0:8910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 33 00000100:00100000:1.0:1783071492.427319:0:8910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c68a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf7532e4-6153-424a-9f4e-84941256b41f+6:0:x1869685692872192:12345-192.168.204.38@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1783071492.430217:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1783071492.435470:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:2.0:1783071492.435487:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bf7532e4-6153-424a-9f4e-84941256b41f 00000100:00100000:2.0:1783071492.435625:0:8910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c68a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf7532e4-6153-424a-9f4e-84941256b41f+5:0:x1869685692872192:12345-192.168.204.38@tcp:2:lhsmtool_posix.0 Request processed in 8303us (19566us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1783071492.435636:0:8910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 33 00000100:00100000:3.0:1783071492.438509:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071492.438599:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692872448 00000100:00100000:2.0:1783071492.438609:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692872448 00000100:00100000:2.0:1783071492.438673:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19 00000100:00100000:2.0:1783071492.438693:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+64:11314:x1869685692872448:12345-192.168.204.38@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1783071492.439268:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+65:11314:x1869685692872448:12345-192.168.204.38@tcp:35:lhsmtool_posix.0 Request processed in 574us (767us total) trans 4294967356 rc 0/0 00000100:00100000:2.0:1783071492.439276:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19 00000100:00100000:2.0:1783071492.449939:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071492.450178:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692872704 00000100:00100000:0.0:1783071492.450188:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692872704 00000100:00100000:0.0:1783071492.450250:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 87 00000100:00100000:0.0:1783071492.450260:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07794e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+65:11314:x1869685692872704:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783071492.450403:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07794e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+65:11314:x1869685692872704:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 Request processed in 143us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071492.450410:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 87 00000100:00100000:3.0:1783071492.456925:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071492.457026:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692872832 00000100:00100000:1.0:1783071492.457037:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692872832 00000100:00100000:1.0:1783071492.457105:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 88 00000100:00100000:1.0:1783071492.457116:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+65:11314:x1869685692872832:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783071492.457141:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071492.457163:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748600/0x6b58994c2cbdc61a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98e60 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071492.457245:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdc621 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071492.457262:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdc621 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071492.457274:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdc621 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783071492.457345:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783071492.457415:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdc621 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071492.457448:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748600/0x6b58994c2cbdc61a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e60 expref: 67 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071492.457469:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdc621 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e60 expref: 66 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071492.457477:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f8a020ca400) 00010000:00010000:1.0:1783071492.457480:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1783071492.457484:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a01749400, rc 0) 00000100:00100000:1.0:1783071492.457613:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+66:11314:x1869685692872832:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 498us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071492.457622:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 88 00000100:00100000:3.0:1783071492.462190:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071492.472065:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692872960 00000100:00100000:0.0:1783071492.472089:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692872960 00000100:00100000:0.0:1783071492.472202:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 34 00000100:00100000:0.0:1783071492.472216:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf7532e4-6153-424a-9f4e-84941256b41f+5:2405:x1869685692872960:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783071492.472246:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071492.472275:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049e80cbc/0x6b58994c2cbdc628 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98e67 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783071492.472498:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a478305, blocks: 0x0 00010000:00010000:0.0:1783071492.472544:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=394s v=(0 0) 00010000:00010000:0.0:1783071492.472550:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071492.472562:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049e80cbc/0x6b58994c2cbdc628 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e67 expref: 6 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.472585:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000049e80cbc/0x6b58994c2cbdc628 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e67 expref: 6 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.472600:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a03865a00, rc 0) 00000100:00100000:0.0:1783071492.472755:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf7532e4-6153-424a-9f4e-84941256b41f+6:2405:x1869685692872960:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 540us (10582us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071492.472763:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 34 00000100:00100000:2.0:1783071492.493429:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071492.496674:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692873216 00000100:00100000:0.0:1783071492.500212:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692873216 00000100:00100000:0.0:1783071492.500347:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 89 00000100:00100000:0.0:1783071492.500361:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07797100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+66:11314:x1869685692873216:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783071492.500552:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07797100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+66:11314:x1869685692873216:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 Request processed in 194us (7136us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071492.500562:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 89 00000100:00100000:0.0:1783071492.508283:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071492.509356:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692873344 00000100:00100000:3.0:1783071492.509389:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692873344 00000100:00100000:3.0:1783071492.509485:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 35 00000100:00100000:3.0:1783071492.509498:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c68bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf7532e4-6153-424a-9f4e-84941256b41f+6:11314:x1869685692873344:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783071492.509530:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071492.509551:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b22ab653/0x6b58994c2cbdc62f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98e6e expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.513036:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000049e80cbc/0x6b58994c2cbdc628 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e67 expref: 7 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.513058:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783071492.513063:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783071492.513073:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b22ab653/0x6b58994c2cbdc62f lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e6e expref: 7 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.513126:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000049e80cbc/0x6b58994c2cbdc628 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e67 expref: 7 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.513162:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000049e80cbc/0x6b58994c2cbdc628 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e67 expref: 7 pid: 8431 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071492.513181:0:8432:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a80000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8432:1869685707633152:192.168.204.38@tcp:104: 00000100:00100000:3.0:1783071492.513286:0:8432:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b180279c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071492.517325:0:8432:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a80000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8432:1869685707633152:192.168.204.38@tcp:104: 00010000:00010000:3.0:1783071492.517391:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b22ab653/0x6b58994c2cbdc62f lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e6e expref: 7 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.517414:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b3c460200, rc 0) 00000100:00100000:3.0:1783071492.517479:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c68bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf7532e4-6153-424a-9f4e-84941256b41f+7:11314:x1869685692873344:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 7983us (9206us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071492.517489:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 35 00000100:00100000:3.0:1783071492.529657:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071492.529757:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692873472 00000100:00100000:1.0:1783071492.529770:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692873472 00010000:00010000:1.0:1783071492.529829:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000049e80cbc/0x6b58994c2cbdc628 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e67 expref: 7 pid: 8431 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071492.529898:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 59 00000100:00100000:1.0:1783071492.529919:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf7532e4-6153-424a-9f4e-84941256b41f+7:2406:x1869685692873472:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783071492.529943:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071492.529971:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000049e80cbc/0x6b58994c2cbdc628 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e67 expref: 7 pid: 8431 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071492.530018:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000049e80cbc/0x6b58994c2cbdc628 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e67 expref: 7 pid: 8431 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071492.530052:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049e80cbc/0x6b58994c2cbdc628 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e67 expref: 7 pid: 8431 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071492.530074:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783071492.530080:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783071492.530091:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b22ab653/0x6b58994c2cbdc62f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e6e expref: 6 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071492.530101:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b22ab653/0x6b58994c2cbdc62f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e6e expref: 6 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071492.530171:0:6501:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b22ab653/0x6b58994c2cbdc62f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e6e expref: 6 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071492.530190:0:6501:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37abd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6501:1869685707633280:192.168.204.38@tcp:105: 00000100:00100000:1.0:1783071492.530307:0:6501:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b05ebec00 going to sleep for 11 seconds 00000100:00100000:3.0:1783071492.536941:0:6501:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37abd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6501:1869685707633280:192.168.204.38@tcp:105: 00010000:00010000:3.0:1783071492.536977:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783071492.537060:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf7532e4-6153-424a-9f4e-84941256b41f+6:2406:x1869685692873472:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 7151us (7418us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071492.537075:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 59 00000100:00100000:0.0:1783071492.545171:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071492.545274:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692873600 00000100:00100000:0.0:1783071492.545286:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692873600 00002000:00100000:0.0:1783071492.545359:0:8437:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8f8a02c09500 x1869685692873600/t0(0) o4->bf7532e4-6153-424a-9f4e-84941256b41f@192.168.204.38@tcp:83/0 lens 504/0 e 0 to 0 dl 1783071503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783071492.545389:0:8437:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8f8a02c09500 with x1869685692873600 ext(0->8) 00002000:00010000:0.0:1783071492.545411:0:8437:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f8a02c09500 00000100:00100000:0.0:1783071492.545455:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 0 00000100:00100000:0.0:1783071492.545467:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02c09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bf7532e4-6153-424a-9f4e-84941256b41f+6:2405:x1869685692873600:12345-192.168.204.38@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1783071492.550247:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02c09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bf7532e4-6153-424a-9f4e-84941256b41f+8:2405:x1869685692873600:12345-192.168.204.38@tcp:4:lhsmtool_posix.0 Request processed in 4768us (5077us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1783071492.550262:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 0 00002000:00100000:0.0:1783071492.550276:0:8437:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8f8a02c09500 x1869685692873600/t4294967303(0) o4->bf7532e4-6153-424a-9f4e-84941256b41f@192.168.204.38@tcp:83/0 lens 504/448 e 0 to 0 dl 1783071503 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783071492.550286:0:8437:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8f8a02c09500 with x1869685692873600 ext(0->8) 00002000:00010000:0.0:1783071492.550293:0:8437:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f8a02c09500 00000100:00100000:0.0:1783071492.562588:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071492.562709:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692873728 00000100:00100000:3.0:1783071492.562725:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692873728 00000100:00100000:3.0:1783071492.562818:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 90 00000100:00100000:3.0:1783071492.562834:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3b4dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+66:11314:x1869685692873728:12345-192.168.204.38@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1783071492.573227:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:3.0:1783071492.573246:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000004:00080000:3.0:1783071492.573319:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:3.0:1783071492.573357:0:6495:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f8a038a8e40 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1783071492.573380:0:6495:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8f8b3c64f900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f8a038a8c00 00000020:00080000:3.0:1783071492.573383:0:6495:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8f8b3c64f400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f8a0301de00 00010000:00010000:2.0:1783071492.575643:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdc349 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.575664:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdc349 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.575672:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdc349 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.575679:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b014b9000 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:2.0:1783071492.575685:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdc349 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.575693:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdc349 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.575712:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8f8a0179fa00) 00010000:00010000:2.0:1783071492.575716:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071492.575790:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdc349 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.575805:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdc349 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.575950:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdc350 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.575958:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdc350 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.575965:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdc350 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.575971:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b014b8600 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:2.0:1783071492.575974:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdc350 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.575981:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdc350 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.575990:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f8a0179f400) 00010000:00010000:2.0:1783071492.575993:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071492.575995:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdc350 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.576002:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdc350 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.576065:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8000/0x6b58994c2cbdc38f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.576072:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8000/0x6b58994c2cbdc38f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.576079:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8000/0x6b58994c2cbdc38f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.576091:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b014b8000 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:2.0:1783071492.576095:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8000/0x6b58994c2cbdc38f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.576102:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8000/0x6b58994c2cbdc38f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.576111:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f8a0179f500) 00010000:00010000:2.0:1783071492.576114:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071492.576117:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8000/0x6b58994c2cbdc38f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.576122:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8000/0x6b58994c2cbdc38f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.576138:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdc499 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.576145:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdc499 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.576151:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdc499 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.576156:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03865600 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:2.0:1783071492.576160:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdc499 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.576166:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdc499 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.576185:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f8a0179f900) 00010000:00010000:2.0:1783071492.576187:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071492.576190:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdc499 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.576196:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdc499 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.576208:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdc4bc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.576215:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdc4bc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.576220:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdc4bc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.576445:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b014b8c00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:2.0:1783071492.576448:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdc4bc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.576456:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdc4bc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.576465:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f8a0179f900) 00010000:00010000:2.0:1783071492.576468:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071492.576471:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdc4bc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.576565:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdc4bc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.576591:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865200/0x6b58994c2cbdc502 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.576598:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865200/0x6b58994c2cbdc502 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.576604:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865200/0x6b58994c2cbdc502 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.576609:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03865200 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:2.0:1783071492.576611:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865200/0x6b58994c2cbdc502 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.576617:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865200/0x6b58994c2cbdc502 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.576624:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f8a0179f900) 00010000:00010000:2.0:1783071492.576627:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071492.576630:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865200/0x6b58994c2cbdc502 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.576635:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865200/0x6b58994c2cbdc502 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.576645:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc605 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.576650:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc605 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.576655:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc605 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.576666:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01749a00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:2.0:1783071492.576669:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc605 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.576675:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc605 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.576683:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f8a020ca400) 00010000:00010000:2.0:1783071492.576686:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1783071492.576689:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc605 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.576694:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc605 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071492.577019:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b07796680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707633408:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783071492.577090:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071492.577157:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707633408 00000100:00100000:2.0:1783071492.577347:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707633408 00000100:00100000:2.0:1783071492.577435:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783071492.577447:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07797480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1869685707633408:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783071492.577474:0:8429:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:2.0:1783071492.577598:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a478302, atime: 0x6a478302, ctime: 0x6a478302, blocks: 0x8 00010000:00010000:2.0:1783071492.577606:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b84e4d16/0x6b58994c2cbdc636 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.577621:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=394s v=(0 0) 00010000:00010000:2.0:1783071492.577625:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783071492.577639:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b84e4d16/0x6b58994c2cbdc636 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.577654:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b84e4d16/0x6b58994c2cbdc636 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.577664:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b84e4d16/0x6b58994c2cbdc636 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.577671:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b84e4d16/0x6b58994c2cbdc636 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.577690:0:8429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783071492.578061:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07797480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3645:x1869685707633408:12345-0@lo:6:osp-syn-1-0.0 Request processed in 616us (970us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1783071492.578069:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1783071492.578097:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1783071492.578106:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783071492.578112:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b84e4d16/0x6b58994c2cbdc636 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.578120:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd66800 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:2.0:1783071492.578123:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b84e4d16/0x6b58994c2cbdc636 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.578132:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b84e4d16/0x6b58994c2cbdc636 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.578159:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b84e4d16/0x6b58994c2cbdc636 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.578291:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b84e4d16/0x6b58994c2cbdc636 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.578311:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071492.578313:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071492.578314:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783071492.578347:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f8b07796680/2, rc 0, transno 4294967302 00000100:00100000:2.0:1783071492.578354:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b07796680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707633408:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1783071492.580513:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37abe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707633536:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1783071492.580587:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071492.580644:0:8910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707633536 00000100:00100000:1.0:1783071492.580649:0:8910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707633536 00000100:00100000:1.0:1783071492.580703:0:8910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783071492.580739:0:8910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37abfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707633536:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1783071492.580894:0:8910:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1783071492.580898:0:8910:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1783071493 00002000:00010000:1.0:1783071492.580900:0:8910:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1783071492.580902:0:8910:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1783071493 -> 1783071493 00002000:00010000:1.0:1783071492.580904:0:8910:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1783071492.580953:0:8910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37abfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3646:x1869685707633536:12345-0@lo:2:osp-syn-0-0.0 Request processed in 216us (365us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1783071492.580961:0:8910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:1.0:1783071492.581006:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f8b37abe300/2, rc 0, transno 4294967304 00000100:00100000:1.0:1783071492.581013:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37abe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707633536:0@lo:2:osp-syn-0-0.0 00000100:00080000:2.0:1783071492.581605:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:1.0:1783071492.582453:0:6549:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1783071492.582918:0:6549:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1783071492.582994:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3b4dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+14:11314:x1869685692873728:12345-192.168.204.38@tcp:44:lhsmtool_posix.0 Request processed in 20159us (20415us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071492.583005:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 90 00000100:00100000:3.0:1783071492.589144:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071492.589921:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692873856 00000100:00100000:0.0:1783071492.589933:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692873856 00000100:00100000:0.0:1783071492.591142:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 38 00000100:00100000:0.0:1783071492.591161:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf7532e4-6153-424a-9f4e-84941256b41f+8:2406:x1869685692873856:12345-192.168.204.38@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1783071492.596546:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:3.0:1783071492.596571:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:0.0:1783071492.596849:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf7532e4-6153-424a-9f4e-84941256b41f+6:2406:x1869685692873856:12345-192.168.204.38@tcp:16:lhsmtool_posix.0 Request processed in 5684us (7708us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071492.596869:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 38 00000100:00100000:1.0:1783071492.601060:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071492.601152:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692874112 00000100:00100000:0.0:1783071492.601174:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692874112 00000100:00100000:0.0:1783071492.601253:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 91 00000100:00100000:0.0:1783071492.601264:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37abd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+14:11314:x1869685692874112:12345-192.168.204.38@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783071492.601338:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071492.601385:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdc621 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e60 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.601413:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f8a020ca400) 00010000:00010000:0.0:1783071492.601418:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783071492.601448:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865000/0x6b58994c2cbdc63d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.601460:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865000/0x6b58994c2cbdc63d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.601470:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865000/0x6b58994c2cbdc63d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783071492.601715:0:6516:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c5f6491b reply state 000000007b46ca16 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865000/0x6b58994c2cbdc63d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.601796:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865000/0x6b58994c2cbdc63d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.601803:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f8a020ca400) 00010000:00010000:0.0:1783071492.601805:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783071492.601808:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783071492.601905:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37abd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+15:11314:x1869685692874112:12345-192.168.204.38@tcp:36:lhsmtool_posix.0 Request processed in 642us (856us total) trans 4294967357 rc 0/0 00000100:00100000:0.0:1783071492.601925:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 91 00000100:00100000:3.0:1783071492.609724:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071492.609872:0:8910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692874240 00000100:00100000:0.0:1783071492.609891:0:8910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692874240 00000100:00100000:0.0:1783071492.609973:0:8910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 39 00000100:00100000:0.0:1783071492.609984:0:8910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf7532e4-6153-424a-9f4e-84941256b41f+6:2406:x1869685692874240:12345-192.168.204.38@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1783071492.610177:0:8910:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1783071492.610191:0:8910:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1783071493 -> 1783071492 00002000:00010000:0.0:1783071492.610193:0:8910:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1783071490 00002000:00010000:0.0:1783071492.610195:0:8910:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1783071493 -> 1783071492 00002000:00010000:0.0:1783071492.610197:0:8910:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1783071492.610290:0:8910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf7532e4-6153-424a-9f4e-84941256b41f+7:2406:x1869685692874240:12345-192.168.204.38@tcp:2:lhsmtool_posix.0 Request processed in 308us (581us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1783071492.610298:0:8910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 39 00000100:00100000:0.0:1783071492.617825:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071492.617956:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692874496 00000100:00100000:3.0:1783071492.617972:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692874496 00000100:00100000:3.0:1783071492.618179:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 92 00000100:00100000:3.0:1783071492.618192:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+15:11314:x1869685692874496:12345-192.168.204.38@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1783071492.618289:0:10292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461c00/0x6b58994c2cbdc644 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.618313:0:10292:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc5fe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e52 expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.618324:0:10292:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461c00/0x6b58994c2cbdc644 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.620315:0:10292:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc5fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e52 expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.620349:0:10292:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc5fe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e52 expref: 15 pid: 6517 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071492.620409:0:10292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a82300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10292:1869685707633664:192.168.204.38@tcp:104: 00000100:00100000:2.0:1783071492.620777:0:10292:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b180279c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783071492.624105:0:10292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a82300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10292:1869685707633664:192.168.204.38@tcp:104: 00010000:00010000:2.0:1783071492.624143:0:10292:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461c00/0x6b58994c2cbdc644 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071492.631012:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071492.631324:0:7923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692874624 00000100:00100000:1.0:1783071492.631339:0:7923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692874624 00010000:00010000:1.0:1783071492.631434:0:7923:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc5fe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e52 expref: 16 pid: 6517 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071492.631487:0:7923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 60 00000100:00100000:1.0:1783071492.631497:0:7923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07794000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf7532e4-6153-424a-9f4e-84941256b41f+16:2405:x1869685692874624:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783071492.631513:0:7923:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071492.631519:0:7923:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc5fe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e52 expref: 16 pid: 6517 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071492.631533:0:7923:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc5fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e52 expref: 16 pid: 6517 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071492.631570:0:7923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc5fe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e52 expref: 16 pid: 6517 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071492.631588:0:7923:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f8a020ca400) 00010000:00010000:1.0:1783071492.631594:0:7923:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461c00/0x6b58994c2cbdc644 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071492.631604:0:7923:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461c00/0x6b58994c2cbdc644 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071492.631612:0:7923:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461c00/0x6b58994c2cbdc644 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071492.631648:0:7923:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783071492.631675:0:10292:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461c00/0x6b58994c2cbdc644 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.631690:0:10292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461c00/0x6b58994c2cbdc644 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.631748:0:10292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461c00/0x6b58994c2cbdc644 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.631757:0:10292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461c00/0x6b58994c2cbdc644 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.631767:0:10292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461c00/0x6b58994c2cbdc644 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.631774:0:10292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b3c461c00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071492.631779:0:10292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461c00/0x6b58994c2cbdc644 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.631788:0:10292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461c00/0x6b58994c2cbdc644 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.631804:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f8a020ca400) 00010000:00010000:3.0:1783071492.631807:0:10292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1783071492.631811:0:10292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461c00/0x6b58994c2cbdc644 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.631817:0:10292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461c00/0x6b58994c2cbdc644 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071492.631956:0:7923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07794000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf7532e4-6153-424a-9f4e-84941256b41f+15:2405:x1869685692874624:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 455us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071492.631965:0:7923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 60 00000100:00100000:3.0:1783071492.634269:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+14:11314:x1869685692874496:12345-192.168.204.38@tcp:55:lhsmtool_posix.0 Request processed in 16062us (16444us total) trans 0 rc -22/-22 00000100:00100000:3.0:1783071492.634288:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 92 00000100:00100000:3.0:1783071492.638228:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071492.638779:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692874752 00000100:00100000:2.0:1783071492.638798:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692874752 00000100:00100000:2.0:1783071492.639097:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 40 00000100:00100000:2.0:1783071492.639111:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf7532e4-6153-424a-9f4e-84941256b41f+7:2403:x1869685692874752:12345-192.168.204.38@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1783071492.639202:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b84e4d16/0x6b58994c2cbdc64b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.639230:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b22ab653/0x6b58994c2cbdc62f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e6e expref: 7 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.639239:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783071492.639244:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783071492.639250:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b84e4d16/0x6b58994c2cbdc64b lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.639394:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b22ab653/0x6b58994c2cbdc62f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e6e expref: 7 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.639413:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b22ab653/0x6b58994c2cbdc62f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e6e expref: 7 pid: 8432 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071492.639507:0:8431:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b07794a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8431:1869685707633792:192.168.204.38@tcp:104: 00000100:00100000:2.0:1783071492.639689:0:8431:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a038cad80 going to sleep for 11 seconds 00000100:00100000:1.0:1783071492.647574:0:8431:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b07794a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8431:1869685707633792:192.168.204.38@tcp:104: 00010000:00010000:1.0:1783071492.647604:0:8431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b84e4d16/0x6b58994c2cbdc64b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071492.655033:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071492.659787:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692874880 00000100:00100000:3.0:1783071492.659804:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692874880 00010000:00010000:3.0:1783071492.659859:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b22ab653/0x6b58994c2cbdc62f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e6e expref: 8 pid: 8432 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071492.659929:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 61 00000100:00100000:3.0:1783071492.659939:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07795180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf7532e4-6153-424a-9f4e-84941256b41f+8:2403:x1869685692874880:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783071492.659954:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071492.659974:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b22ab653/0x6b58994c2cbdc62f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e6e expref: 8 pid: 8432 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.659989:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b22ab653/0x6b58994c2cbdc62f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e6e expref: 8 pid: 8432 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.660015:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b22ab653/0x6b58994c2cbdc62f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e6e expref: 8 pid: 8432 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.660032:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783071492.660036:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783071492.660042:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b84e4d16/0x6b58994c2cbdc64b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.660068:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b84e4d16/0x6b58994c2cbdc64b lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.660106:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783071492.660163:0:8431:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b84e4d16/0x6b58994c2cbdc64b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071492.660172:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07795180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf7532e4-6153-424a-9f4e-84941256b41f+7:2403:x1869685692874880:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 232us (5148us total) trans 0 rc 0/0 00010000:00010000:1.0:1783071492.660184:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b84e4d16/0x6b58994c2cbdc64b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071492.660189:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 61 00010000:00010000:1.0:1783071492.660228:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b84e4d16/0x6b58994c2cbdc64b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071492.660238:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b84e4d16/0x6b58994c2cbdc64b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071492.660251:0:8431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b84e4d16/0x6b58994c2cbdc64b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071492.660259:0:8431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd66800 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:1.0:1783071492.660263:0:8431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b84e4d16/0x6b58994c2cbdc64b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071492.660274:0:8431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b84e4d16/0x6b58994c2cbdc64b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071492.660288:0:8431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b84e4d16/0x6b58994c2cbdc64b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071492.660296:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b84e4d16/0x6b58994c2cbdc64b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071492.660387:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf7532e4-6153-424a-9f4e-84941256b41f+6:2403:x1869685692874752:12345-192.168.204.38@tcp:1:lhsmtool_posix.0 Request processed in 21254us (22154us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071492.660396:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 40 00000100:00100000:3.0:1783071492.666715:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071492.666800:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692875136 00000100:00100000:0.0:1783071492.666817:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692875136 00000100:00100000:0.0:1783071492.670173:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 93 00000100:00100000:0.0:1783071492.670188:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+14:11314:x1869685692875136:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1783071492.670271:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865400/0x6b58994c2cbdc652 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.670288:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc492 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98df7 expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.670298:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865400/0x6b58994c2cbdc652 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.670336:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc492 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98df7 expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.670349:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc492 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98df7 expref: 14 pid: 6518 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071492.670388:0:6517:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03333100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1869685707633920:192.168.204.38@tcp:104: 00000100:00100000:0.0:1783071492.670613:0:6517:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a032c0000 going to sleep for 11 seconds 00000100:00100000:1.0:1783071492.685081:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071492.685114:0:7923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692875264 00000100:00100000:1.0:1783071492.685124:0:7923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692875264 00010000:00010000:1.0:1783071492.685166:0:7923:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc492 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98df7 expref: 15 pid: 6518 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071492.685201:0:7923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 62 00000100:00100000:1.0:1783071492.685210:0:7923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab8c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf7532e4-6153-424a-9f4e-84941256b41f+15:2406:x1869685692875264:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783071492.685225:0:7923:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071492.685232:0:7923:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc492 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98df7 expref: 15 pid: 6518 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071492.685246:0:7923:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc492 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98df7 expref: 15 pid: 6518 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071492.685268:0:7923:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f8a0179f900) 00010000:00010000:1.0:1783071492.685274:0:7923:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865400/0x6b58994c2cbdc652 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071492.685283:0:7923:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865400/0x6b58994c2cbdc652 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071492.685291:0:7923:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865400/0x6b58994c2cbdc652 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071492.685309:0:7923:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071492.685359:0:7923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab8c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf7532e4-6153-424a-9f4e-84941256b41f+15:2406:x1869685692875264:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 150us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071492.685712:0:7923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 62 00010000:00010000:3.0:1783071492.686538:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc492 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98df7 expref: 14 pid: 6518 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071492.686619:0:6517:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03333100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1869685707633920:192.168.204.38@tcp:104: 00010000:00010000:3.0:1783071492.686647:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865400/0x6b58994c2cbdc652 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.686657:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865400/0x6b58994c2cbdc652 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.686663:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865400/0x6b58994c2cbdc652 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.686839:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460200/0x6b58994c2cbdc659 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.686851:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdc60c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e59 expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.686877:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460200/0x6b58994c2cbdc659 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.686920:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdc60c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e59 expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.686936:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdc60c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e59 expref: 14 pid: 6518 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071492.686950:0:6517:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a82a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1869685707634048:192.168.204.38@tcp:104: 00000100:00100000:3.0:1783071492.688152:0:6517:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b18027cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071492.695445:0:6517:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a82a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1869685707634048:192.168.204.38@tcp:104: 00010000:00010000:3.0:1783071492.695477:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460200/0x6b58994c2cbdc659 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071492.703152:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071492.707986:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692875392 00000100:00100000:1.0:1783071492.708003:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692875392 00010000:00010000:1.0:1783071492.708057:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdc60c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e59 expref: 15 pid: 6518 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071492.708112:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 63 00000100:00100000:1.0:1783071492.708123:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03330000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf7532e4-6153-424a-9f4e-84941256b41f+15:2405:x1869685692875392:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783071492.708141:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071492.708149:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdc60c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e59 expref: 15 pid: 6518 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071492.708166:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdc60c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e59 expref: 15 pid: 6518 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071492.708192:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdc60c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e59 expref: 15 pid: 6518 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071492.708213:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f8a020ca400) 00010000:00010000:1.0:1783071492.708220:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460200/0x6b58994c2cbdc659 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071492.708231:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460200/0x6b58994c2cbdc659 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071492.708239:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460200/0x6b58994c2cbdc659 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071492.708275:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071492.708346:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03330000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf7532e4-6153-424a-9f4e-84941256b41f+14:2405:x1869685692875392:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 224us (5203us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071492.708391:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 63 00010000:00010000:1.0:1783071492.708478:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460200/0x6b58994c2cbdc659 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071492.708484:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460200/0x6b58994c2cbdc659 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783071492.708588:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:1.0:1783071492.708691:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:1.0:1783071492.708729:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:1.0:1783071492.708813:0:6517:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37abea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6517:1869685707634176:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1783071492.708902:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071492.708952:0:6517:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b3c766c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783071492.709571:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707634176 00000100:00100000:2.0:1783071492.709578:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707634176 00000100:00100000:2.0:1783071492.709629:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1783071492.709639:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37abc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6517:x1869685707634176:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1783071492.709733:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37abc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6517:x1869685707634176:12345-0@lo:1000:mdt00_001.0 Request processed in 97us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071492.709749:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1783071492.709900:0:6517:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1783071492.709914:0:6517:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f8b37abe300, transno 4294967304 00000100:00100000:1.0:1783071492.709935:0:6517:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37abea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6517:1869685707634176:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1783071492.710240:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:1.0:1783071492.710298:0:6517:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37abea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6517:1869685707634304:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1783071492.710336:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071492.710392:0:6517:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b09bb19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783071492.710526:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707634304 00000100:00100000:2.0:1783071492.710532:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707634304 00000100:00100000:2.0:1783071492.710577:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1783071492.710584:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37abd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6517:x1869685707634304:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1783071492.710696:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37abd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6517:x1869685707634304:12345-0@lo:1000:mdt00_001.0 Request processed in 112us (359us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1783071492.710703:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1783071492.710808:0:6517:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37abea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6517:1869685707634304:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1783071492.710845:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460200/0x6b58994c2cbdc659 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071492.710855:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460200/0x6b58994c2cbdc659 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071492.710863:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460200/0x6b58994c2cbdc659 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071492.710879:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b3c460200 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:1.0:1783071492.710885:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460200/0x6b58994c2cbdc659 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071492.710892:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460200/0x6b58994c2cbdc659 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071492.710916:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f8a020ca400) 00010000:00010000:1.0:1783071492.710919:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783071492.710924:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460200/0x6b58994c2cbdc659 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071492.710931:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460200/0x6b58994c2cbdc659 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071492.710960:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc587 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071492.710966:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc587 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071492.710972:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc587 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071492.710977:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01748200 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:1.0:1783071492.710981:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc587 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071492.711061:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc587 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071492.711080:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f8a0179f900) 00010000:00010000:1.0:1783071492.711082:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783071492.711086:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc587 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071492.711092:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc587 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071492.711112:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdc660 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071492.711125:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc5a3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e3d expref: 17 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071492.711133:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdc660 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071492.711156:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc5a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e3d expref: 17 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071492.711169:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc5a3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e3d expref: 17 pid: 13815 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071492.711181:0:6517:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37abdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1869685707634432:192.168.204.38@tcp:104: 00000100:00100000:1.0:1783071492.711246:0:6517:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0317ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1783071492.716984:0:6517:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37abdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1869685707634432:192.168.204.38@tcp:104: 00010000:00010000:1.0:1783071492.717016:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdc660 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071492.720636:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071492.720945:0:7923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692875520 00000100:00100000:2.0:1783071492.720954:0:7923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692875520 00010000:00010000:2.0:1783071492.720996:0:7923:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc5a3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e3d expref: 18 pid: 13815 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071492.721032:0:7923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 64 00000100:00100000:2.0:1783071492.721042:0:7923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37abdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf7532e4-6153-424a-9f4e-84941256b41f+18:2406:x1869685692875520:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783071492.721057:0:7923:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071492.721063:0:7923:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc5a3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e3d expref: 18 pid: 13815 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.721077:0:7923:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc5a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e3d expref: 18 pid: 13815 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.721114:0:7923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc5a3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e3d expref: 18 pid: 13815 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.721127:0:7923:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f8a0179f900) 00010000:00010000:2.0:1783071492.721140:0:7923:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdc660 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.721151:0:7923:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdc660 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.721158:0:7923:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdc660 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071492.721188:0:7923:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071492.721240:0:7923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37abdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf7532e4-6153-424a-9f4e-84941256b41f+17:2406:x1869685692875520:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 200us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071492.721249:0:7923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 64 00010000:00010000:0.0:1783071492.721758:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdc660 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.721768:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdc660 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.721783:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdc660 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.721789:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdc660 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.721797:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdc660 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.721803:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01749e00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:0.0:1783071492.721808:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdc660 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.721816:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdc660 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.721827:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f8a0179f900) 00010000:00010000:0.0:1783071492.721830:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071492.721833:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdc660 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.721839:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdc660 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.721862:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865400/0x6b58994c2cbdc652 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.721869:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865400/0x6b58994c2cbdc652 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.721875:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865400/0x6b58994c2cbdc652 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.721880:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03865400 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:0.0:1783071492.721883:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865400/0x6b58994c2cbdc652 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.721889:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865400/0x6b58994c2cbdc652 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.721919:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f8a0179f900) 00010000:00010000:0.0:1783071492.721922:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783071492.721925:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865400/0x6b58994c2cbdc652 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.721931:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865400/0x6b58994c2cbdc652 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071492.722099:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+16:11314:x1869685692875136:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 Request processed in 51913us (55599us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1783071492.722108:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 93 00000020:00080000:0.0:1783071492.722112:0:6517:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1783071492.722177:0:13796:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783071492.722183:0:13796:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783071492.722198:0:13796:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1783071492.722204:0:13796:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783071492.724691:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071492.724738:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692875776 00000100:00100000:3.0:1783071492.724748:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692875776 00000100:00100000:3.0:1783071492.724857:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 20 00000100:00100000:3.0:1783071492.724870:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37abed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+16:11314:x1869685692875776:12345-192.168.204.38@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1783071492.725197:0:6519:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1783071492.725232:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:3.0:1783071492.725269:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461c00/0x6b58994c2cbdc667 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.725288:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461c00/0x6b58994c2cbdc667 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.725310:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461c00/0x6b58994c2cbdc667 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.725320:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461c00/0x6b58994c2cbdc667 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.725328:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461c00/0x6b58994c2cbdc667 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.725334:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461c00/0x6b58994c2cbdc667 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.725358:0:6519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783071492.725552:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37abed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+18:11314:x1869685692875776:12345-192.168.204.38@tcp:35:lhsmtool_posix.0 Request processed in 683us (870us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1783071492.725561:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 20 00000020:00080000:3.0:1783071492.725566:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1783071492.725686:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783071492.725693:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461c00/0x6b58994c2cbdc667 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.725707:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b3c461c00 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:0.0:1783071492.725711:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461c00/0x6b58994c2cbdc667 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.725720:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461c00/0x6b58994c2cbdc667 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.725735:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f8a020ca400) 00010000:00010000:0.0:1783071492.725738:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783071492.725743:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461c00/0x6b58994c2cbdc667 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.725748:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461c00/0x6b58994c2cbdc667 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.725759:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071492.725760:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071492.725762:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783071492.746242:0:14205:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783071492.746252:0:14205:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783071492.746281:0:14205:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1783071492.746291:0:14205:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783071492.860516:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071492.860957:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692876032 00000100:00100000:1.0:1783071492.860968:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692876032 00000100:00100000:1.0:1783071492.861044:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 94 00000100:00100000:1.0:1783071492.861055:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03333100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+18:11324:x1869685692876032:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1783071492.861079:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071492.861099:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc66e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98e75 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071492.861212:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748600/0x6b58994c2cbdc675 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071492.861227:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748600/0x6b58994c2cbdc675 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071492.861239:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748600/0x6b58994c2cbdc675 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783071492.861251:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1783071492.861348:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc66e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e75 expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071492.861386:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748600/0x6b58994c2cbdc675 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e75 expref: 20 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071492.861841:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f8a0179f400) 00010000:00010000:1.0:1783071492.862488:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783071492.862503:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a01748600, rc 0) 00000100:00100000:1.0:1783071492.862675:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03333100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+20:11324:x1869685692876032:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1609us (2158us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1783071492.862685:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 94 00000100:00100000:2.0:1783071492.874758:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071492.876764:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692876160 00000100:00100000:3.0:1783071492.876781:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692876160 00000100:00100000:3.0:1783071492.876860:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 95 00000100:00100000:3.0:1783071492.876871:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+20:11324:x1869685692876160:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:3.0:1783071492.876962:0:10292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460400/0x6b58994c2cbdc683 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.876981:0:10292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460400/0x6b58994c2cbdc683 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.876994:0:10292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460400/0x6b58994c2cbdc683 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.877025:0:10292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461c00/0x6b58994c2cbdc68a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.877033:0:10292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461c00/0x6b58994c2cbdc68a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.877040:0:10292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461c00/0x6b58994c2cbdc68a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.877131:0:10292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460200/0x6b58994c2cbdc691 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.877140:0:10292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460200/0x6b58994c2cbdc691 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.877148:0:10292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460200/0x6b58994c2cbdc691 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783071492.877196:0:10292:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460200/0x6b58994c2cbdc691 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.877209:0:10292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460400/0x6b58994c2cbdc683 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.877216:0:10292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460400/0x6b58994c2cbdc683 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.877223:0:10292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460400/0x6b58994c2cbdc683 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.877230:0:10292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b3c460400 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071492.877234:0:10292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460400/0x6b58994c2cbdc683 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.877249:0:10292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460400/0x6b58994c2cbdc683 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.877261:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f8a0179f400) 00010000:00010000:3.0:1783071492.877264:0:10292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071492.877269:0:10292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460400/0x6b58994c2cbdc683 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.877275:0:10292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460400/0x6b58994c2cbdc683 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.877288:0:10292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461c00/0x6b58994c2cbdc68a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.877294:0:10292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461c00/0x6b58994c2cbdc68a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.877300:0:10292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461c00/0x6b58994c2cbdc68a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.877305:0:10292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b3c461c00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071492.877308:0:10292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461c00/0x6b58994c2cbdc68a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.877314:0:10292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461c00/0x6b58994c2cbdc68a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.877321:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f8b3b7ce800) 00010000:00010000:3.0:1783071492.877324:0:10292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071492.877327:0:10292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461c00/0x6b58994c2cbdc68a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.877342:0:10292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461c00/0x6b58994c2cbdc68a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.877357:0:10292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460200/0x6b58994c2cbdc691 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.877388:0:10292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460200/0x6b58994c2cbdc691 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.877641:0:10292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460200/0x6b58994c2cbdc691 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.877647:0:10292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b3c460200 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071492.877650:0:10292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460200/0x6b58994c2cbdc691 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.877656:0:10292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460200/0x6b58994c2cbdc691 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.877674:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f8b3b7ce300) 00010000:00010000:3.0:1783071492.877676:0:10292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071492.877679:0:10292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460200/0x6b58994c2cbdc691 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071492.877684:0:10292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460200/0x6b58994c2cbdc691 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071492.877939:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+20:11324:x1869685692876160:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 1068us (3190us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071492.877947:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 95 00000100:00100000:3.0:1783071492.954407:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071492.954509:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692876416 00000100:00100000:0.0:1783071492.954520:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692876416 00000100:00100000:0.0:1783071492.954587:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 96 00000100:00100000:0.0:1783071492.954597:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+20:11327:x1869685692876416:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1783071492.954621:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071492.954641:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdc698 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98e7c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.954873:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864800/0x6b58994c2cbdc69f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.954889:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864800/0x6b58994c2cbdc69f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.954900:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864800/0x6b58994c2cbdc69f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.954927:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864a00/0x6b58994c2cbdc6a6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.954935:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864a00/0x6b58994c2cbdc6a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.954942:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864a00/0x6b58994c2cbdc6a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.955070:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdc6ad lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.955079:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdc6ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.955085:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdc6ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783071492.955096:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1783071492.955480:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864800/0x6b58994c2cbdc69f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.955489:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864800/0x6b58994c2cbdc69f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.955505:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864800/0x6b58994c2cbdc69f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.955511:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03864800 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:0.0:1783071492.955515:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864800/0x6b58994c2cbdc69f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.955523:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864800/0x6b58994c2cbdc69f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.955538:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f8a0179f400) 00010000:00010000:0.0:1783071492.955542:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071492.955547:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864800/0x6b58994c2cbdc69f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.955554:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864800/0x6b58994c2cbdc69f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.955568:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864a00/0x6b58994c2cbdc6a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.955574:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864a00/0x6b58994c2cbdc6a6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.955580:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864a00/0x6b58994c2cbdc6a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.955585:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03864a00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:0.0:1783071492.955588:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864a00/0x6b58994c2cbdc6a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.955606:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864a00/0x6b58994c2cbdc6a6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.955614:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f8b10db4600) 00010000:00010000:0.0:1783071492.955617:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071492.955728:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864a00/0x6b58994c2cbdc6a6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.955736:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864a00/0x6b58994c2cbdc6a6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.955798:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdc698 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e7c expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.955812:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdc6ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e7c expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.955819:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f8b10db4c00) 00010000:00010000:0.0:1783071492.955822:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783071492.955824:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a03865c00, rc 0) 00000100:00100000:0.0:1783071492.955966:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+22:11327:x1869685692876416:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1370us (1604us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1783071492.955975:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 96 00000100:00100000:2.0:1783071492.960348:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071492.960804:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692876544 00000100:00100000:1.0:1783071492.960815:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692876544 00000100:00100000:0.0:1783071492.960987:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 97 00000100:00100000:0.0:1783071492.960998:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07797b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+22:11327:x1869685692876544:12345-192.168.204.38@tcp:54:lfs.0 00010000:00010000:0.0:1783071492.961069:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdc6bb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.961100:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdc6bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.961112:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdc6bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.961147:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdc6bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.961154:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdc6bb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.961161:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdc6bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.961166:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03864600 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:0.0:1783071492.961171:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdc6bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.961178:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdc6bb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.961191:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f8b10db4c00) 00010000:00010000:0.0:1783071492.961194:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783071492.961200:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdc6bb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071492.961206:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdc6bb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071492.961289:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07797b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+22:11327:x1869685692876544:12345-192.168.204.38@tcp:54:lfs.0 Request processed in 292us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071492.961303:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 97 00000100:00100000:2.0:1783071492.964823:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071492.964928:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692876800 00000100:00100000:1.0:1783071492.964938:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692876800 00000100:00100000:1.0:1783071492.964996:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 21 00000100:00100000:1.0:1783071492.965007:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0699f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+22:11327:x1869685692876800:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1783071492.965268:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0699f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+23:11327:x1869685692876800:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 262us (453us total) trans 4294967367 rc 0/0 00000100:00100000:1.0:1783071492.965277:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 21 00000100:00100000:3.0:1783071492.999859:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071493.001227:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692877056 00000100:00100000:2.0:1783071493.001240:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692877056 00000100:00100000:2.0:1783071493.001356:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 98 00000100:00080000:0.0:1783071493.001401:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783071493.001404:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+23:10854:x1869685692877056:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:2.0:1783071493.001433:0:10292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071493.001457:0:10292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdc6c2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98e83 expref: -99 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071493.001568:0:10292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc6c9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071493.001596:0:10292:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdc6ad lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e7c expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071493.001605:0:10292:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc6c9 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071493.001640:0:10292:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdc6ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e7c expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071493.001652:0:10292:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdc6ad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e7c expref: 24 pid: 6517 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071493.001665:0:10292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b07794380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10292:1869685707634560:192.168.204.38@tcp:104: 00000100:00100000:2.0:1783071493.001771:0:10292:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a038ca0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071493.005335:0:10292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b07794380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10292:1869685707634560:192.168.204.38@tcp:104: 00010000:00010000:3.0:1783071493.005379:0:10292:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc6c9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071493.005486:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071493.005651:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692877184 00000100:00100000:3.0:1783071493.005658:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692877184 00010000:00010000:3.0:1783071493.005694:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdc6ad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e7c expref: 25 pid: 6517 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071493.005783:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 65 00000100:00100000:3.0:1783071493.005793:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37abc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf7532e4-6153-424a-9f4e-84941256b41f+25:2406:x1869685692877184:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783071493.005808:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071493.005814:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdc6ad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e7c expref: 25 pid: 6517 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071493.005823:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdc6ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e7c expref: 25 pid: 6517 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071493.005840:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdc6ad lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e7c expref: 25 pid: 6517 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071493.005852:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f8b10db4c00) 00010000:00010000:3.0:1783071493.005855:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc6c9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071493.005862:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc6c9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071493.005890:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc6c9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071493.005921:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783071493.006049:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37abc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf7532e4-6153-424a-9f4e-84941256b41f+24:2406:x1869685692877184:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 255us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071493.006058:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 65 00010000:00010000:2.0:1783071493.006114:0:10292:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc6c9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071493.006122:0:10292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc6c9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071493.006144:0:10292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:2.0:1783071493.006275:0:10292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdc6c2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e83 expref: 25 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071493.006290:0:10292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc6c9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e83 expref: 24 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071493.006297:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f8b10db4c00) 00010000:00010000:2.0:1783071493.006309:0:10292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783071493.006312:0:10292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b2fd67600, rc 0) 00000100:00100000:2.0:1783071493.007107:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+24:10854:x1869685692877056:12345-192.168.204.38@tcp:101:bash.0 Request processed in 5738us (7255us total) trans 4294967368 rc 0/0 00000100:00100000:2.0:1783071493.007116:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 98 00000100:00100000:1.0:1783071493.014014:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071493.014892:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692877312 00000100:00100000:0.0:1783071493.014915:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692877312 00000100:00100000:0.0:1783071493.015036:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 99 00000100:00100000:0.0:1783071493.015048:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37abed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+24:10854:x1869685692877312:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:0.0:1783071493.015075:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071493.015097:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864a00/0x6b58994c2cbdc6d7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98e8a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071493.015132:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864800/0x6b58994c2cbdc6de lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071493.015149:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864800/0x6b58994c2cbdc6de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071493.015161:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864800/0x6b58994c2cbdc6de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071493.015290:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864a00/0x6b58994c2cbdc6d7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e8a expref: 26 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071493.015310:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864800/0x6b58994c2cbdc6de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e8a expref: 25 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071493.015319:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f8b10db4c00) 00010000:00010000:0.0:1783071493.015323:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783071493.015327:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a03864800, rc 0) 00000100:00100000:0.0:1783071493.015427:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37abed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+25:10854:x1869685692877312:12345-192.168.204.38@tcp:101:bash.0 Request processed in 381us (1424us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071493.015435:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 99 00000100:00100000:0.0:1783071493.021867:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071493.022175:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692877568 00000100:00100000:2.0:1783071493.022186:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692877568 00000100:00100000:2.0:1783071493.022260:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 100 00000100:00100000:2.0:1783071493.022270:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+25:10854:x1869685692877568:12345-192.168.204.38@tcp:36:bash.0 00010000:00010000:2.0:1783071493.022566:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdc6e5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071493.022590:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdc6e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071493.022602:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdc6e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783071493.022651:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:2.0:1783071493.022689:0:6518:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004653d091 reply state 000000005131949a transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdc6e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071493.022703:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdc6e5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071493.022711:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f8b10db4c00) 00010000:00010000:2.0:1783071493.022713:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783071493.022717:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1783071493.022753:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:2.0:1783071493.022869:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+29:10854:x1869685692877568:12345-192.168.204.38@tcp:36:bash.0 Request processed in 599us (1013us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1783071493.022893:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 100 00000020:00080000:2.0:1783071493.022898:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1783071493.026353:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071493.026520:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692877696 00000100:00100000:2.0:1783071493.026532:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692877696 00000100:00100000:2.0:1783071493.026600:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 101 00000100:00100000:2.0:1783071493.026611:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37abdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+29:10854:x1869685692877696:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:2.0:1783071493.026636:0:10292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071493.026657:0:10292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdc6ec lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98e91 expref: -99 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071493.026732:0:10292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdc6ec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e91 expref: 30 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071493.026747:0:10292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdc6ec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e91 expref: 30 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071493.026767:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f8b10db4c00) 00010000:00010000:2.0:1783071493.026770:0:10292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783071493.026774:0:10292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b2fd66c00, rc 0) 00000100:00100000:2.0:1783071493.026838:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37abdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+30:10854:x1869685692877696:12345-192.168.204.38@tcp:101:bash.0 Request processed in 228us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071493.026844:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 101 00000100:00100000:3.0:1783071493.030330:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071493.030471:0:8910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692877824 00000100:00100000:0.0:1783071493.030482:0:8910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692877824 00000100:00100000:0.0:1783071493.030548:0:8910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 41 00000100:00100000:0.0:1783071493.030559:0:8910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf7532e4-6153-424a-9f4e-84941256b41f+6:10854:x1869685692877824:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:0.0:1783071493.030578:0:8910:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071493.030599:0:8910:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a19eddc3/0x6b58994c2cbdc6f3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98e98 expref: -99 pid: 8910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783071493.030624:0:8910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a478304, atime: 0x6a478302, ctime: 0x6a478304, blocks: 0x8 00010000:00010000:0.0:1783071493.030645:0:8910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=394s v=(0 0) 00010000:00010000:0.0:1783071493.030649:0:8910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071493.030657:0:8910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a19eddc3/0x6b58994c2cbdc6f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e98 expref: 7 pid: 8910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071493.030688:0:8910:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a19eddc3/0x6b58994c2cbdc6f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e98 expref: 7 pid: 8910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071493.030701:0:8910:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a03864a00, rc 0) 00000100:00100000:0.0:1783071493.030771:0:8910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf7532e4-6153-424a-9f4e-84941256b41f+7:10854:x1869685692877824:12345-192.168.204.38@tcp:101:bash.0 Request processed in 214us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071493.030779:0:8910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 41 00000100:00100000:0.0:1783071493.033493:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071493.033611:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692877952 00000100:00100000:2.0:1783071493.033620:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692877952 00002000:00010000:2.0:1783071493.033670:0:8435:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:2.0:1783071493.033676:0:8435:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8f8a032c8380 with x1869685692877952 ext(0->18446744073709551615) 00002000:00010000:2.0:1783071493.033687:0:8435:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f8a032c8380. 00000100:00100000:2.0:1783071493.033775:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1 00000100:00100000:2.0:1783071493.033786:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bf7532e4-6153-424a-9f4e-84941256b41f+7:2405:x1869685692877952:12345-192.168.204.38@tcp:10:bash.0 00002000:00010000:2.0:1783071493.034178:0:8435:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1783071493.034182:0:8435:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1783071492 -> 1783071493 00002000:00010000:2.0:1783071493.034184:0:8435:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1783071490 -> 1783071490 00002000:00010000:2.0:1783071493.034186:0:8435:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1783071492 -> 1783071493 00002000:00010000:2.0:1783071493.034188:0:8435:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1783071493.034301:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bf7532e4-6153-424a-9f4e-84941256b41f+8:2405:x1869685692877952:12345-192.168.204.38@tcp:10:bash.0 Request processed in 514us (816us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1783071493.034309:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1 00002000:00010000:2.0:1783071493.034314:0:8435:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:2.0:1783071493.034317:0:8435:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8f8a032c8380 with x1869685692877952 ext(0->18446744073709551615) 00002000:00010000:2.0:1783071493.034322:0:8435:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f8a032c8380. 00000100:00100000:1.0:1783071493.105647:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071493.105838:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692878080 00000100:00100000:0.0:1783071493.105848:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692878080 00000100:00100000:0.0:1783071493.105973:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 102 00000100:00100000:0.0:1783071493.105983:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37abc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+30:11341:x1869685692878080:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:0.0:1783071493.106059:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdc6fa lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071493.106197:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdc6fa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071493.106211:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdc6fa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071493.106228:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdc701 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071493.106236:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdc701 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071493.106242:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdc701 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071493.106327:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdc708 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071493.106337:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdc708 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071493.106344:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdc708 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783071493.106643:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdc708 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.106657:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdc6fa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.106663:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdc6fa lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.106671:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdc6fa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.106676:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03865e00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:1.0:1783071493.106693:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdc6fa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.106700:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdc6fa lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.106712:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f8a0179f400) 00010000:00010000:1.0:1783071493.106716:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071493.106719:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdc6fa lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.106725:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdc6fa lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.106737:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdc701 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.106743:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdc701 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.106749:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdc701 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.106754:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03865c00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:1.0:1783071493.106757:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdc701 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.106763:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdc701 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.106769:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f8b10db4200) 00010000:00010000:1.0:1783071493.106772:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071493.106781:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdc701 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.106788:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdc701 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.106815:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdc708 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.106822:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdc708 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.106828:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdc708 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.106834:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03864600 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:1.0:1783071493.106837:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdc708 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.106843:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdc708 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.106852:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f8b10db4c00) 00010000:00010000:1.0:1783071493.106854:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071493.106856:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdc708 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.106927:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdc708 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071493.107143:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37abc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+30:11341:x1869685692878080:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 1159us (1562us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071493.107152:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 102 00000100:00100000:2.0:1783071493.147824:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071493.147951:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692878336 00000100:00100000:1.0:1783071493.147963:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692878336 00000100:00100000:1.0:1783071493.148025:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 103 00000100:00100000:1.0:1783071493.148035:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+30:11344:x1869685692878336:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1783071493.148056:0:13815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071493.148076:0:13815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc70f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98e9f expref: -99 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.148157:0:13815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc716 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.148173:0:13815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc716 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.148184:0:13815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc716 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.148199:0:13815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdc71d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.148206:0:13815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdc71d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.148213:0:13815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdc71d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.148339:0:13815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdc724 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.148348:0:13815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdc724 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.148404:0:13815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdc724 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783071493.148416:0:13815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1783071493.148620:0:13815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc716 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.148629:0:13815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc716 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.148635:0:13815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc716 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.148642:0:13815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01748000 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:1.0:1783071493.148646:0:13815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc716 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.148653:0:13815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc716 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.148665:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f8a0179f400) 00010000:00010000:1.0:1783071493.148668:0:13815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071493.148673:0:13815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc716 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.148679:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc716 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.148692:0:13815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdc71d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.148698:0:13815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdc71d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.148711:0:13815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdc71d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.148717:0:13815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01749e00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:1.0:1783071493.148720:0:13815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdc71d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.148727:0:13815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdc71d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.148736:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f8b1011aa00) 00010000:00010000:1.0:1783071493.148738:0:13815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071493.148741:0:13815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdc71d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.148747:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdc71d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.148787:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc70f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e9f expref: 33 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.148801:0:13815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdc724 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e9f expref: 32 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.148809:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f8b10db4c00) 00010000:00010000:1.0:1783071493.148810:0:13815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1783071493.148813:0:13815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a01749c00, rc 0) 00000100:00100000:1.0:1783071493.148888:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+32:11344:x1869685692878336:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 854us (1072us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1783071493.148916:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 103 00000100:00100000:0.0:1783071493.151955:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071493.152274:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692878464 00000100:00100000:1.0:1783071493.152284:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692878464 00000100:00100000:1.0:1783071493.152462:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 104 00000100:00100000:1.0:1783071493.152481:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+32:11344:x1869685692878464:12345-192.168.204.38@tcp:54:lfs.0 00010000:00010000:1.0:1783071493.152552:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc732 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.152570:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc6c9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e83 expref: 32 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.152579:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc732 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.152616:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc6c9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e83 expref: 32 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.152630:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc6c9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e83 expref: 32 pid: 10292 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071493.152645:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37abf800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6516:1869685707634688:192.168.204.38@tcp:104: 00000100:00100000:1.0:1783071493.152741:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0317e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783071493.161339:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071493.161738:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692878720 00000100:00100000:3.0:1783071493.161750:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692878720 00000100:00100000:3.0:1783071493.161822:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 22 00000100:00100000:3.0:1783071493.161834:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+33:6170:x1869685692878720:12345-192.168.204.38@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1783071493.162159:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+34:6170:x1869685692878720:12345-192.168.204.38@tcp:35:ldlm_bl.0 Request processed in 327us (831us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1783071493.162167:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 22 00000100:00100000:1.0:1783071493.162319:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37abf800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6516:1869685707634688:192.168.204.38@tcp:104: 00010000:00010000:1.0:1783071493.162343:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc732 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071493.168594:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071493.171611:0:7923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692878848 00000100:00100000:2.0:1783071493.171628:0:7923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692878848 00010000:00010000:2.0:1783071493.171687:0:7923:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc6c9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e83 expref: 34 pid: 10292 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071493.171738:0:7923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 66 00000100:00100000:2.0:1783071493.171748:0:7923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf7532e4-6153-424a-9f4e-84941256b41f+34:2405:x1869685692878848:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783071493.171765:0:7923:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071493.171772:0:7923:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc6c9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e83 expref: 34 pid: 10292 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071493.171788:0:7923:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc6c9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e83 expref: 34 pid: 10292 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071493.171830:0:7923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc6c9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e83 expref: 34 pid: 10292 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071493.171847:0:7923:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f8b10db4c00) 00010000:00010000:2.0:1783071493.171853:0:7923:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc732 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071493.171864:0:7923:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc732 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071493.171872:0:7923:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc732 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071493.171914:0:7923:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783071493.172071:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc732 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.172088:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc732 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.172130:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc732 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.172138:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc732 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.172144:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc732 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.172151:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01749000 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:1.0:1783071493.172155:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc732 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.172162:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc732 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.172172:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f8b10db4c00) 00010000:00010000:1.0:1783071493.172176:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783071493.172180:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc732 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.172185:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc732 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071493.172259:0:7923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf7532e4-6153-424a-9f4e-84941256b41f+33:2405:x1869685692878848:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 511us (3675us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071493.172268:0:7923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 66 00000100:00100000:1.0:1783071493.174809:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+32:11344:x1869685692878464:12345-192.168.204.38@tcp:54:lfs.0 Request processed in 22318us (22852us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071493.174824:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 104 00000100:00100000:0.0:1783071493.181635:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071493.181720:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692879104 00000100:00100000:3.0:1783071493.181731:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692879104 00000100:00100000:3.0:1783071493.181790:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 23 00000100:00100000:3.0:1783071493.181801:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+32:11344:x1869685692879104:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1783071493.182064:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+33:11344:x1869685692879104:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 264us (437us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1783071493.182072:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 23 00000100:00100000:0.0:1783071493.264465:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071493.264569:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692879360 00000100:00100000:1.0:1783071493.264579:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692879360 00000100:00100000:1.0:1783071493.264645:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 105 00000100:00100000:1.0:1783071493.264655:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+33:11355:x1869685692879360:12345-192.168.204.38@tcp:101:cat.0 00010000:00010000:1.0:1783071493.264680:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071493.264701:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc739 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98ea6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.264786:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc740 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.264801:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc740 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.264815:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc740 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.264830:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdc747 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.264838:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdc747 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.264844:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdc747 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.264973:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc74e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.264984:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc74e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.265011:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc74e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783071493.265023:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:1.0:1783071493.265318:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc740 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.265330:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc740 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.265337:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc740 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.265343:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01748200 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:1.0:1783071493.265348:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc740 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.265400:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc740 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.265414:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f8a0179f400) 00010000:00010000:1.0:1783071493.265417:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071493.265422:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc740 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.265428:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc740 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.265441:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdc747 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.265447:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdc747 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.265460:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdc747 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.265466:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01749e00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:1.0:1783071493.265469:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdc747 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.265475:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdc747 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.265484:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f8b1011aa00) 00010000:00010000:1.0:1783071493.265487:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071493.265489:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdc747 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.265495:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdc747 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.265538:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc739 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ea6 expref: 36 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.265551:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc74e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ea6 expref: 35 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.265559:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f8b10db4c00) 00010000:00010000:1.0:1783071493.265561:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783071493.265564:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a01748000, rc 0) 00000100:00100000:1.0:1783071493.265621:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+35:11355:x1869685692879360:12345-192.168.204.38@tcp:101:cat.0 Request processed in 967us (1166us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1783071493.265639:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 105 00000100:00100000:0.0:1783071493.273025:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071493.277053:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692879616 00000100:00100000:3.0:1783071493.277070:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692879616 00000100:00100000:2.0:1783071493.277386:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 24 00000100:00100000:2.0:1783071493.277399:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+35:11355:x1869685692879616:12345-192.168.204.38@tcp:35:cat.0 00000100:00100000:2.0:1783071493.277718:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+36:11355:x1869685692879616:12345-192.168.204.38@tcp:35:cat.0 Request processed in 320us (4702us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1783071493.277726:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 24 00000100:00100000:0.0:1783071493.312566:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071493.312687:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692879872 00000100:00100000:1.0:1783071493.312700:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692879872 00000100:00100000:1.0:1783071493.312775:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 106 00000100:00100000:1.0:1783071493.312787:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+36:11356:x1869685692879872:12345-192.168.204.38@tcp:36:rm.0 00010000:00010000:1.0:1783071493.312887:0:13815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1783071493.312927:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdc6ec lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e91 expref: 36 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.312951:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc74e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ea6 expref: 35 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.312966:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdc724 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e9f expref: 34 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.312978:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864800/0x6b58994c2cbdc6de lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e8a expref: 33 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.312990:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f8b10db4c00) 00010000:00010000:1.0:1783071493.312995:0:13815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783071493.313019:0:13815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc75c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.313033:0:13815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc75c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.313043:0:13815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc75c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.313064:0:13815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdc763 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.313073:0:13815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdc763 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.313080:0:13815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdc763 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.313160:0:13815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc76a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.313169:0:13815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc76a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.313176:0:13815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc76a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783071493.313795:0:13815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00010000:00010000:1.0:1783071493.313864:0:13815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc771 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.313875:0:13815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc771 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.313885:0:13815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc771 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.313893:0:13815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc771 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.313913:0:13815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc771 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.313928:0:13815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc771 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.314018:0:13815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783071493.314042:0:13815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc76a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.314050:0:13815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc76a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.314056:0:13815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc76a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.314062:0:13815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01748200 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:1.0:1783071493.314066:0:13815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc76a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.314074:0:13815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc76a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.314087:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f8b10db4c00) 00010000:00010000:1.0:1783071493.314090:0:13815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1783071493.314094:0:13815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc76a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.314101:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc76a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.314117:0:13815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc75c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.314123:0:13815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc75c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.314135:0:13815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc75c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.314141:0:13815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01749000 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:1.0:1783071493.314144:0:13815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc75c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.314151:0:13815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc75c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.314159:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f8a0179f400) 00010000:00010000:1.0:1783071493.314162:0:13815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071493.314165:0:13815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc75c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.314171:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc75c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783071493.314182:0:13815:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d1339b92 reply state 00000000ffa53ad4 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdc763 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.314195:0:13815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdc763 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.314201:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f8b1011aa00) 00010000:00010000:1.0:1783071493.314203:0:13815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783071493.314206:0:13815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783071493.314286:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+34:11356:x1869685692879872:12345-192.168.204.38@tcp:36:rm.0 Request processed in 1499us (1729us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1783071493.314295:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 106 00010000:00010000:0.0:1783071493.315861:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783071493.315874:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc771 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071493.315886:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01749a00 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:0.0:1783071493.315891:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc771 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071493.315910:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc771 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071493.315929:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f8b10db4c00) 00010000:00010000:0.0:1783071493.315932:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783071493.315936:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc771 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071493.315943:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc771 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071493.315959:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071493.315962:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071493.315964:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071493.363043:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071493.363188:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692880128 00000100:00100000:1.0:1783071493.363199:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692880128 00000100:00100000:1.0:1783071493.363450:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 107 00000100:00100000:1.0:1783071493.363463:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+34:11362:x1869685692880128:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:1.0:1783071493.363497:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071493.363628:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc778 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98ead expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.363748:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc77f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.363764:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc77f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.363777:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc77f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.363789:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdc786 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.363796:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdc786 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.363802:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdc786 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783071493.364708:0:6516:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:1.0:1783071493.364952:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc78d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.364965:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc78d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.365057:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc78d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.365095:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc77f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.365102:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc77f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.365109:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc77f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.365115:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01748200 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:1.0:1783071493.365120:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc77f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.365127:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc77f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.365140:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f8a0179f400) 00010000:00010000:1.0:1783071493.365143:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071493.365147:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc77f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.365154:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc77f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783071493.365229:0:6516:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fedfe851 reply state 0000000053ba373b transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdc786 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.365243:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdc786 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.365255:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f8b1011aa00) 00010000:00010000:1.0:1783071493.365257:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783071493.365260:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783071493.365642:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc778 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ead expref: 37 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.365661:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc78d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ead expref: 36 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.365668:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f8b1011a800) 00010000:00010000:1.0:1783071493.365671:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783071493.365673:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a01748000, rc 0) 00000100:00100000:1.0:1783071493.365754:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+37:11362:x1869685692880128:12345-192.168.204.38@tcp:101:bash.0 Request processed in 2293us (2788us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1783071493.365762:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 107 00000100:00100000:1.0:1783071493.373869:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071493.374065:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692880256 00000100:00100000:3.0:1783071493.374090:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692880256 00000100:00100000:3.0:1783071493.374223:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 42 00000100:00100000:3.0:1783071493.374236:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37abf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf7532e4-6153-424a-9f4e-84941256b41f+7:2405:x1869685692880256:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:3.0:1783071493.374260:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071493.374298:0:8429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b22ab653/0x6b58994c2cbdc79b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98eb4 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783071493.374330:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783071493.374406:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=395s v=(0 0) 00010000:00010000:3.0:1783071493.374412:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783071493.374420:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b22ab653/0x6b58994c2cbdc79b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98eb4 expref: 8 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071493.374440:0:8429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b22ab653/0x6b58994c2cbdc79b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98eb4 expref: 8 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071493.374455:0:8429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b3c460200, rc 0) 00000100:00100000:3.0:1783071493.374642:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37abf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf7532e4-6153-424a-9f4e-84941256b41f+8:2405:x1869685692880256:12345-192.168.204.38@tcp:101:bash.0 Request processed in 281us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071493.374651:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 42 00000100:00080000:0.0:1783071493.375771:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1783071493.378649:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071493.378903:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071493.380156:0:8910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692880384 00000100:00100000:1.0:1783071493.380168:0:8910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692880384 00000100:00100000:1.0:1783071493.380296:0:8910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 43 00000100:00100000:1.0:1783071493.380309:0:8910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf7532e4-6153-424a-9f4e-84941256b41f+8:11362:x1869685692880384:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:1.0:1783071493.380331:0:8910:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071493.380351:0:8910:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070fd10ee/0x6b58994c2cbdc7a2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98ebb expref: -99 pid: 8910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.380402:0:8910:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b22ab653/0x6b58994c2cbdc79b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98eb4 expref: 9 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.380437:0:8910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783071493.380441:0:8910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783071493.380448:0:8910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070fd10ee/0x6b58994c2cbdc7a2 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ebb expref: 9 pid: 8910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.380488:0:8910:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b22ab653/0x6b58994c2cbdc79b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98eb4 expref: 9 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.380504:0:8910:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b22ab653/0x6b58994c2cbdc79b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98eb4 expref: 9 pid: 8429 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071493.380531:0:8910:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37abce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8910:1869685707634816:192.168.204.38@tcp:104: 00000100:00100000:1.0:1783071493.380635:0:8910:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0317e480 going to sleep for 11 seconds 00000100:00100000:1.0:1783071493.383996:0:8910:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37abce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8910:1869685707634816:192.168.204.38@tcp:104: 00010000:00010000:1.0:1783071493.384033:0:8910:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000070fd10ee/0x6b58994c2cbdc7a2 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ebb expref: 9 pid: 8910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.384056:0:8910:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a01749000, rc 0) 00000100:00100000:1.0:1783071493.384160:0:8910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf7532e4-6153-424a-9f4e-84941256b41f+9:11362:x1869685692880384:12345-192.168.204.38@tcp:101:bash.0 Request processed in 3853us (5808us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071493.384170:0:8910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 43 00000100:00100000:0.0:1783071493.388248:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071493.388709:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692880512 00000100:00100000:1.0:1783071493.388724:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692880512 00010000:00010000:1.0:1783071493.388794:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b22ab653/0x6b58994c2cbdc79b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98eb4 expref: 9 pid: 8429 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071493.388877:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 67 00000100:00100000:1.0:1783071493.388890:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0397c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf7532e4-6153-424a-9f4e-84941256b41f+9:2405:x1869685692880512:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783071493.388920:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071493.388944:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b22ab653/0x6b58994c2cbdc79b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98eb4 expref: 9 pid: 8429 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.388960:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b22ab653/0x6b58994c2cbdc79b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98eb4 expref: 9 pid: 8429 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.389002:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b22ab653/0x6b58994c2cbdc79b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98eb4 expref: 9 pid: 8429 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.389028:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783071493.389033:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783071493.389042:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000070fd10ee/0x6b58994c2cbdc7a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ebb expref: 8 pid: 8910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.389055:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070fd10ee/0x6b58994c2cbdc7a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ebb expref: 8 pid: 8910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.389101:0:6502:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000070fd10ee/0x6b58994c2cbdc7a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ebb expref: 8 pid: 8910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071493.389117:0:6502:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37abce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6502:1869685707634944:192.168.204.38@tcp:105: 00000100:00100000:1.0:1783071493.389209:0:6502:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0317e480 going to sleep for 11 seconds 00000100:00100000:2.0:1783071493.396661:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071493.396708:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071493.396727:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071493.396754:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071493.396801:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071493.397038:0:6502:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37abce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6502:1869685707634944:192.168.204.38@tcp:105: 00010000:00010000:1.0:1783071493.397066:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071493.397130:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0397c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf7532e4-6153-424a-9f4e-84941256b41f+8:2405:x1869685692880512:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 8241us (8892us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071493.397142:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 67 00000100:00100000:0.0:1783071493.397249:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692880896 00000100:00100000:0.0:1783071493.397258:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692880896 00000100:00100000:0.0:1783071493.397307:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 377 00000100:00100000:0.0:1783071493.397317:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18687c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:2406:x1869685692880896:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1783071493.397387:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18687c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:2406:x1869685692880896:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 49us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071493.397394:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 377 00000100:00100000:3.0:1783071493.397704:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692880768 00000100:00100000:3.0:1783071493.397709:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692880768 00000100:00100000:3.0:1783071493.397741:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 25 00000100:00100000:3.0:1783071493.397749:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+37:11362:x1869685692880768:12345-192.168.204.38@tcp:35:bash.0 00000100:00100000:3.0:1783071493.398080:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+38:11362:x1869685692880768:12345-192.168.204.38@tcp:35:bash.0 Request processed in 331us (1431us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1783071493.398098:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 25 00000100:00100000:1.0:1783071493.402160:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692881024 00000100:00100000:1.0:1783071493.402176:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692881024 00000100:00080000:3.0:1783071493.402393:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783071493.402526:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692881280 00000100:00100000:1.0:1783071493.402531:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692881280 00000100:00100000:1.0:1783071493.402560:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692881152 00000100:00100000:1.0:1783071493.402563:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692881152 00000100:00100000:1.0:1783071493.402589:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 268 00000100:00100000:1.0:1783071493.402599:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07795180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+5:2406:x1869685692881024:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1783071493.402698:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07795180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+5:2406:x1869685692881024:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 101us (5989us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071493.402706:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 268 00000100:00100000:1.0:1783071493.402726:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 269 00000100:00100000:1.0:1783071493.402732:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07794a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2406:x1869685692881280:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1783071493.402768:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07794a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2406:x1869685692881280:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 37us (6040us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071493.402768:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 270 00000100:00100000:1.0:1783071493.402774:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 269 00000100:00080000:3.0:1783071493.402902:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783071493.402906:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783071493.402918:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07796d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2406:x1869685692881152:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1783071493.402962:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07796d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2406:x1869685692881152:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 186us (6159us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071493.402969:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 270 00000100:00100000:3.0:1783071493.565948:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071493.566624:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692881408 00000100:00100000:1.0:1783071493.566634:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692881408 00000100:00100000:1.0:1783071493.566708:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 108 00000100:00100000:1.0:1783071493.566720:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+38:11378:x1869685692881408:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1783071493.566759:0:13815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071493.566782:0:13815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc7a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98ec2 expref: -99 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.566870:0:13815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdc7b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.566884:0:13815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdc7b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.566904:0:13815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdc7b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783071493.566947:0:13815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1783071493.566951:0:13815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783071493.566980:0:13815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdc7b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.567003:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc7a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ec2 expref: 40 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.567021:0:13815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdc7b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ec2 expref: 39 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.567030:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f8a0179f400) 00010000:00010000:1.0:1783071493.567033:0:13815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783071493.567037:0:13815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a01749400, rc 0) 00000100:00100000:1.0:1783071493.567103:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+39:11378:x1869685692881408:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 386us (1164us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071493.567110:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 108 00000100:00100000:0.0:1783071493.570161:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071493.571047:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692881664 00000100:00100000:1.0:1783071493.571059:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692881664 00000100:00100000:1.0:1783071493.571127:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 109 00000100:00100000:1.0:1783071493.571137:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0397ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+39:11378:x1869685692881664:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1783071493.571159:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071493.571178:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc7b7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98ec9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.571285:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdc7be lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.571301:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdc7be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.571312:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdc7be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783071493.571323:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1783071493.571469:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc7b7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ec9 expref: 42 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.571488:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdc7be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ec9 expref: 41 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.571497:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f8b1011a800) 00010000:00010000:1.0:1783071493.571500:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783071493.571503:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a01749600, rc 0) 00000100:00100000:1.0:1783071493.575274:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0397ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+41:11378:x1869685692881664:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 4126us (5110us total) trans 4294967380 rc 0/0 00000100:00100000:1.0:1783071493.575304:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 109 00000100:00100000:0.0:1783071493.588239:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071493.588525:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071493.588680:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692882048 00000100:00100000:3.0:1783071493.588690:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692882048 00000100:00100000:3.0:1783071493.588757:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 110 00000100:00100000:3.0:1783071493.588771:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0397e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+41:11378:x1869685692882048:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1783071493.588798:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071493.588824:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461c00/0x6b58994c2cbdc7cc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98ed0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071493.588968:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460400/0x6b58994c2cbdc7d3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071493.588985:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460400/0x6b58994c2cbdc7d3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071493.588997:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460400/0x6b58994c2cbdc7d3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783071493.589010:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1783071493.589117:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461c00/0x6b58994c2cbdc7cc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ed0 expref: 44 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071493.589134:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460400/0x6b58994c2cbdc7d3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ed0 expref: 43 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071493.589160:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f8b1011a800) 00010000:00010000:3.0:1783071493.589175:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1783071493.589179:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b3c460400, rc 0) 00000100:00100000:3.0:1783071493.589237:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0397e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+43:11378:x1869685692882048:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 470us (712us total) trans 4294967381 rc 0/0 00000100:00100000:3.0:1783071493.589245:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 110 00000100:00100000:2.0:1783071493.592118:0:7923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692881792 00000100:00100000:2.0:1783071493.592133:0:7923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692881792 00000100:00100000:2.0:1783071493.592218:0:7923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 7 00000100:00100000:2.0:1783071493.592240:0:7923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0397d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf7532e4-6153-424a-9f4e-84941256b41f+43:2406:x1869685692881792:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783071493.592257:0:7923:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071493.592295:0:7923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdc7be lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ec9 expref: 43 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071493.592316:0:7923:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f8b1011a800) 00010000:00010000:2.0:1783071493.592321:0:7923:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071493.592614:0:7923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0397d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf7532e4-6153-424a-9f4e-84941256b41f+42:2406:x1869685692881792:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 385us (4448us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071493.592623:0:7923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 7 00000100:00100000:0.0:1783071493.598577:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071493.598671:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692882176 00000100:00100000:3.0:1783071493.598682:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692882176 00000100:00100000:3.0:1783071493.598749:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 44 00000100:00100000:3.0:1783071493.598761:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b2fe7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf7532e4-6153-424a-9f4e-84941256b41f+8:2405:x1869685692882176:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:3.0:1783071493.598808:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4a2fec1/0x6b58994c2cbdc7e1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071493.598829:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000070fd10ee/0x6b58994c2cbdc7a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ebb expref: 8 pid: 8910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071493.598837:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783071493.598841:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783071493.598845:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4a2fec1/0x6b58994c2cbdc7e1 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071493.598903:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000070fd10ee/0x6b58994c2cbdc7a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ebb expref: 8 pid: 8910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071493.598919:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000070fd10ee/0x6b58994c2cbdc7a2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ebb expref: 8 pid: 8910 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071493.598959:0:8429:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a81c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8429:1869685707635072:192.168.204.38@tcp:104: 00000100:00100000:3.0:1783071493.599066:0:8429:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b05e0b540 going to sleep for 11 seconds 00000100:00100000:3.0:1783071493.605623:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071493.605819:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692882304 00000100:00100000:1.0:1783071493.605830:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692882304 00002000:00100000:1.0:1783071493.605883:0:8437:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8f8a03a80700 x1869685692882304/t0(0) o4->bf7532e4-6153-424a-9f4e-84941256b41f@192.168.204.38@tcp:84/0 lens 504/0 e 0 to 0 dl 1783071504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783071493.605910:0:8437:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8f8a03a80700 with x1869685692882304 ext(0->8) 00010000:00010000:1.0:1783071493.605919:0:8437:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000070fd10ee/0x6b58994c2cbdc7a2 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ebb expref: 9 pid: 8910 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.605938:0:8437:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000070fd10ee/0x6b58994c2cbdc7a2 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ebb expref: 9 pid: 8910 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783071493.605945:0:8437:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8f8a03a80700 00000100:00100000:1.0:1783071493.605980:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1 00000100:00100000:1.0:1783071493.605988:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bf7532e4-6153-424a-9f4e-84941256b41f+9:2405:x1869685692882304:12345-192.168.204.38@tcp:4:lfs.0 00000100:00100000:0.0:1783071493.607002:0:8429:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a81c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8429:1869685707635072:192.168.204.38@tcp:104: 00000100:00100000:1.0:1783071493.607006:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bf7532e4-6153-424a-9f4e-84941256b41f+11:2405:x1869685692882304:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 1015us (1390us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1783071493.607018:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1 00002000:00100000:1.0:1783071493.607028:0:8437:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8f8a03a80700 x1869685692882304/t4294967303(0) o4->bf7532e4-6153-424a-9f4e-84941256b41f@192.168.204.38@tcp:84/0 lens 504/448 e 0 to 0 dl 1783071504 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783071493.607037:0:8437:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8f8a03a80700 with x1869685692882304 ext(0->8) 00010000:00010000:0.0:1783071493.607038:0:8429:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f4a2fec1/0x6b58994c2cbdc7e1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.607045:0:8437:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000070fd10ee/0x6b58994c2cbdc7a2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ebb expref: 11 pid: 8910 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.607404:0:8437:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000070fd10ee/0x6b58994c2cbdc7a2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ebb expref: 11 pid: 8910 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783071493.607413:0:8437:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8f8a03a80700 00000100:00100000:3.0:1783071493.615324:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071493.622981:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692882432 00000100:00100000:2.0:1783071493.622999:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692882432 00010000:00010000:2.0:1783071493.623051:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000070fd10ee/0x6b58994c2cbdc7a2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ebb expref: 11 pid: 8910 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071493.623107:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 68 00000100:00100000:2.0:1783071493.623117:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab8e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf7532e4-6153-424a-9f4e-84941256b41f+11:2404:x1869685692882432:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783071493.623133:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1783071493.623151:0:6501:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1783071493.623154:0:6501:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1783071494 00002000:00010000:2.0:1783071493.623156:0:6501:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1783071494 00002000:00010000:2.0:1783071493.623158:0:6501:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1783071494 00002000:00010000:2.0:1783071493.623160:0:6501:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1783071493.623181:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000070fd10ee/0x6b58994c2cbdc7a2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ebb expref: 11 pid: 8910 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071493.623194:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000070fd10ee/0x6b58994c2cbdc7a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ebb expref: 11 pid: 8910 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071493.623218:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070fd10ee/0x6b58994c2cbdc7a2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ebb expref: 11 pid: 8910 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071493.623235:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783071493.623240:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783071493.623245:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f4a2fec1/0x6b58994c2cbdc7e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071493.623254:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4a2fec1/0x6b58994c2cbdc7e1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071493.623279:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071493.623350:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab8e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf7532e4-6153-424a-9f4e-84941256b41f+10:2404:x1869685692882432:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 234us (8044us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071493.623358:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 68 00010000:00010000:0.0:1783071493.623794:0:8429:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f4a2fec1/0x6b58994c2cbdc7e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071493.623805:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4a2fec1/0x6b58994c2cbdc7e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071493.623837:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4a2fec1/0x6b58994c2cbdc7e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071493.623845:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f4a2fec1/0x6b58994c2cbdc7e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071493.623852:0:8429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f4a2fec1/0x6b58994c2cbdc7e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071493.623858:0:8429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b3c461c00 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:0.0:1783071493.623862:0:8429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4a2fec1/0x6b58994c2cbdc7e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071493.623870:0:8429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4a2fec1/0x6b58994c2cbdc7e1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071493.623882:0:8429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f4a2fec1/0x6b58994c2cbdc7e1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071493.623906:0:8429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4a2fec1/0x6b58994c2cbdc7e1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071493.623979:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b2fe7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf7532e4-6153-424a-9f4e-84941256b41f+10:2405:x1869685692882176:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 25220us (25620us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071493.623987:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 44 00000100:00100000:3.0:1783071493.630909:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071493.631146:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692882688 00000100:00100000:1.0:1783071493.631155:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692882688 00000100:00100000:1.0:1783071493.631215:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 26 00000100:00100000:1.0:1783071493.631226:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0699c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+42:11378:x1869685692882688:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:1.0:1783071493.631304:0:6520:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460400/0x6b58994c2cbdc7d3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ed0 expref: 42 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783071493.631545:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:1.0:1783071493.631579:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1783071493.631937:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:1.0:1783071493.632041:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc7e8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.632058:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc78d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ead expref: 46 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.632068:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc7e8 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.632103:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc78d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ead expref: 46 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.632118:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc78d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ead expref: 46 pid: 6516 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071493.632141:0:6520:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37abce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6520:1869685707635200:192.168.204.38@tcp:104: 00000100:00100000:1.0:1783071493.632221:0:6520:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0317e780 going to sleep for 11 seconds 00000100:00100000:3.0:1783071493.637568:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071493.637822:0:6520:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37abce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6520:1869685707635200:192.168.204.38@tcp:104: 00010000:00010000:1.0:1783071493.637849:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc7e8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071493.638248:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692882816 00000100:00100000:0.0:1783071493.638257:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692882816 00010000:00010000:0.0:1783071493.638307:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc78d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ead expref: 47 pid: 6516 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071493.638347:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 69 00000100:00100000:0.0:1783071493.638356:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf7532e4-6153-424a-9f4e-84941256b41f+47:2405:x1869685692882816:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783071493.638397:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071493.638405:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc78d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ead expref: 47 pid: 6516 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071493.638419:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc78d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ead expref: 47 pid: 6516 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071493.638441:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc78d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ead expref: 47 pid: 6516 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071493.638458:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f8b1011a800) 00010000:00010000:0.0:1783071493.638463:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc7e8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071493.638473:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc7e8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071493.638481:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc7e8 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071493.638503:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071493.638563:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf7532e4-6153-424a-9f4e-84941256b41f+46:2405:x1869685692882816:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 207us (1004us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071493.638586:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 69 00010000:00010000:1.0:1783071493.639442:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc7e8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.639456:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc7e8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783071493.639591:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:1.0:1783071493.639714:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:1.0:1783071493.639814:0:6520:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37abce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6520:1869685707635328:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1783071493.639879:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071493.639919:0:6520:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0317e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783071493.640234:0:9413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707635328 00000100:00100000:0.0:1783071493.640240:0:9413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707635328 00000100:00100000:0.0:1783071493.640340:0:9413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1783071493.640350:0:9413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37abf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6520:x1869685707635328:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1783071493.640467:0:9413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37abf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6520:x1869685707635328:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 118us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071493.640476:0:9413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1783071493.640557:0:6520:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37abce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6520:1869685707635328:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1783071493.640676:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:1.0:1783071493.640722:0:6520:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37abce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6520:1869685707635456:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1783071493.640749:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071493.646614:0:6520:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b012edc00 going to sleep for 11 seconds 00000100:00100000:2.0:1783071493.647010:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707635456 00000100:00100000:2.0:1783071493.647020:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707635456 00000100:00100000:2.0:1783071493.647076:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1783071493.647085:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37abdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6520:x1869685707635456:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1783071493.647304:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37abdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6520:x1869685707635456:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 220us (6553us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1783071493.647335:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1783071493.647823:0:6520:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37abce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6520:1869685707635456:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1783071493.647910:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:1.0:1783071493.647960:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc7e8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.647988:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc7e8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.647997:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc7e8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.648003:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01749a00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:1.0:1783071493.648009:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc7e8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.648017:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc7e8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.648034:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f8b1011a800) 00010000:00010000:1.0:1783071493.648037:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1783071493.648043:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc7e8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.648049:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc7e8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783071493.648158:0:6520:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1783071493.648228:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:1.0:1783071493.648245:0:6520:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 395436880374ns, next at 396436876164ns, rc = 0 00000001:00080000:1.0:1783071493.648252:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:1.0:1783071493.648291:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f8b1011a800) 00010000:00010000:1.0:1783071493.648294:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1783071493.648303:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460400/0x6b58994c2cbdc7d3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ed0 expref: 50 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071493.648444:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0699c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+49:11378:x1869685692882688:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 17219us (17554us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1783071493.648453:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 26 00000020:00080000:1.0:1783071493.648458:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1783071493.654238:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071493.654528:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692882944 00000100:00100000:2.0:1783071493.654538:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692882944 00000100:00100000:2.0:1783071493.654599:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 111 00000100:00100000:2.0:1783071493.654609:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+49:11378:x1869685692882944:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1783071493.654636:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071493.654664:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdc7ef lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98ed7 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071493.654735:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdc7ef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ed7 expref: 50 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071493.654751:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdc7ef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ed7 expref: 50 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071493.654771:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f8a020ca200) 00010000:00010000:2.0:1783071493.654774:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783071493.654778:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b2fd66c00, rc 0) 00000100:00100000:2.0:1783071493.654848:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+50:11378:x1869685692882944:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 240us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071493.654857:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 111 00000100:00100000:3.0:1783071493.660464:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071493.660650:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692883200 00000100:00100000:2.0:1783071493.660659:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692883200 00000100:00100000:2.0:1783071493.660726:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 27 00000100:00100000:2.0:1783071493.660736:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+50:11378:x1869685692883200:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1783071493.661010:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+51:11378:x1869685692883200:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 274us (554us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1783071493.661032:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 27 00000100:00100000:3.0:1783071493.770042:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071493.770184:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692883328 00000100:00100000:1.0:1783071493.770197:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692883328 00000100:00100000:1.0:1783071493.770281:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 112 00000100:00100000:1.0:1783071493.770293:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+51:11388:x1869685692883328:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:1.0:1783071493.770426:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc7f6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.770447:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc7f6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.770459:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc7f6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.770470:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc7fd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.770478:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc7fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.770485:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc7fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.770574:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc804 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.770601:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc804 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.770608:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc804 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783071493.770662:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc804 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.770676:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc7f6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.770683:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc7f6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.770690:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc7f6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.770696:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01749a00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:1.0:1783071493.770700:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc7f6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.770708:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc7f6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.770720:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f8a0179f400) 00010000:00010000:1.0:1783071493.770723:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071493.770729:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc7f6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.770735:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc7f6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.770757:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc7fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.770763:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc7fd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.770768:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc7fd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.770773:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01748200 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:1.0:1783071493.770776:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc7fd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.770782:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc7fd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.770790:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f8b1011aa00) 00010000:00010000:1.0:1783071493.770793:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071493.770795:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc7fd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.770801:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc7fd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.770810:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc804 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.770816:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc804 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.770823:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc804 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.770834:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01748000 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:1.0:1783071493.770837:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc804 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.770843:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc804 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.770851:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f8a020ca200) 00010000:00010000:1.0:1783071493.770853:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071493.770856:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc804 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.770861:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc804 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071493.770950:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+51:11388:x1869685692883328:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 657us (917us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071493.770959:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 112 00000100:00100000:3.0:1783071493.823408:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071493.824247:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692883584 00000100:00100000:1.0:1783071493.824260:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692883584 00000100:00100000:1.0:1783071493.824331:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 113 00000100:00100000:1.0:1783071493.824342:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+51:11391:x1869685692883584:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1783071493.824381:0:13815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071493.824402:0:13815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc80b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98ede expref: -99 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.824485:0:13815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc812 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.824521:0:13815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc812 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.824534:0:13815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc812 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.824547:0:13815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc819 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.824554:0:13815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc819 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.824561:0:13815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc819 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.824693:0:13815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc820 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.824701:0:13815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc820 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.824709:0:13815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc820 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783071493.824720:0:13815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1783071493.824803:0:13815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc812 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.824811:0:13815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc812 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.824817:0:13815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc812 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.824829:0:13815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01748200 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:1.0:1783071493.824834:0:13815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc812 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.824841:0:13815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc812 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.824854:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f8a0179f400) 00010000:00010000:1.0:1783071493.824857:0:13815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071493.824863:0:13815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc812 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.824869:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc812 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.824894:0:13815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc819 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.824901:0:13815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc819 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.824907:0:13815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc819 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.824913:0:13815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01749a00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:1.0:1783071493.824916:0:13815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc819 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.824922:0:13815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc819 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.824941:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f8b1011aa00) 00010000:00010000:1.0:1783071493.824943:0:13815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071493.824946:0:13815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc819 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.824952:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc819 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.825436:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc80b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ede expref: 54 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.825454:0:13815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc820 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ede expref: 53 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.825462:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f8a020ca200) 00010000:00010000:1.0:1783071493.825464:0:13815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783071493.825467:0:13815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a01749000, rc 0) 00000100:00100000:1.0:1783071493.825545:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+53:11391:x1869685692883584:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1204us (2181us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1783071493.825554:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 113 00000100:00100000:0.0:1783071493.839117:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071493.839223:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692883712 00000100:00100000:2.0:1783071493.839234:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692883712 00000100:00100000:2.0:1783071493.839303:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 114 00000100:00100000:2.0:1783071493.839313:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0397fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+53:11391:x1869685692883712:12345-192.168.204.38@tcp:54:lfs.0 00010000:00010000:2.0:1783071493.839429:0:10292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67e00/0x6b58994c2cbdc82e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071493.839447:0:10292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67e00/0x6b58994c2cbdc82e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071493.839458:0:10292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67e00/0x6b58994c2cbdc82e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071493.839495:0:10292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67e00/0x6b58994c2cbdc82e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071493.839502:0:10292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67e00/0x6b58994c2cbdc82e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071493.839508:0:10292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67e00/0x6b58994c2cbdc82e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071493.839514:0:10292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd67e00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:2.0:1783071493.839519:0:10292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67e00/0x6b58994c2cbdc82e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071493.839528:0:10292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67e00/0x6b58994c2cbdc82e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071493.839540:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f8a020ca200) 00010000:00010000:2.0:1783071493.839557:0:10292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783071493.839563:0:10292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67e00/0x6b58994c2cbdc82e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071493.839570:0:10292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67e00/0x6b58994c2cbdc82e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071493.839650:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0397fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+53:11391:x1869685692883712:12345-192.168.204.38@tcp:54:lfs.0 Request processed in 339us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071493.839658:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 114 00000100:00100000:0.0:1783071493.849045:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071493.849197:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692883968 00000100:00100000:2.0:1783071493.849208:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692883968 00000100:00100000:2.0:1783071493.849274:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 28 00000100:00100000:2.0:1783071493.849285:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0397d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+53:11391:x1869685692883968:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1783071493.849557:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0397d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+54:11391:x1869685692883968:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 273us (522us total) trans 4294967393 rc 0/0 00000100:00100000:2.0:1783071493.849566:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 28 00000100:00100000:2.0:1783071493.939322:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071493.939399:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692884224 00000100:00100000:3.0:1783071493.939411:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692884224 00000100:00100000:3.0:1783071493.939498:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 115 00000100:00100000:3.0:1783071493.939614:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+54:11401:x1869685692884224:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:3.0:1783071493.939657:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071493.939660:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1783071493.939690:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdc7b0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ec2 expref: 54 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071493.939864:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f8a0179f400) 00010000:00010000:3.0:1783071493.939870:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783071493.939894:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8000/0x6b58994c2cbdc835 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98ee5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071493.940730:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdc83c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071493.940767:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc820 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ede expref: 54 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071493.940778:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdc83c lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071493.942056:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc820 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ede expref: 54 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071493.942076:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc820 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ede expref: 54 pid: 13815 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071493.942092:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a81180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6518:1869685707635584:192.168.204.38@tcp:104: 00000100:00100000:3.0:1783071493.942206:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b05e0be40 going to sleep for 11 seconds 00000100:00100000:0.0:1783071493.946896:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071493.946991:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692884352 00000100:00100000:1.0:1783071493.947000:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692884352 00010000:00010000:1.0:1783071493.947042:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc820 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ede expref: 55 pid: 13815 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071493.947088:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 70 00000100:00100000:1.0:1783071493.947098:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0397ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf7532e4-6153-424a-9f4e-84941256b41f+55:2406:x1869685692884352:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783071493.947132:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071493.947140:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc820 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ede expref: 55 pid: 13815 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.947155:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc820 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ede expref: 55 pid: 13815 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.947180:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f8a020ca200) 00010000:00010000:1.0:1783071493.947185:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdc83c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.947194:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdc83c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.947202:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdc83c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.947224:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071493.947287:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0397ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf7532e4-6153-424a-9f4e-84941256b41f+55:2406:x1869685692884352:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 190us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071493.947294:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 70 00010000:00010000:3.0:1783071493.948051:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc820 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ede expref: 54 pid: 13815 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071493.948070:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a81180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6518:1869685707635584:192.168.204.38@tcp:104: 00010000:00010000:3.0:1783071493.948092:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdc83c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071493.948101:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdc83c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071493.948106:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdc83c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783071493.948126:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1783071493.949753:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8000/0x6b58994c2cbdc835 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ee5 expref: 55 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071493.949784:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdc83c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ee5 expref: 54 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071493.949806:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f8a020ca200) 00010000:00010000:3.0:1783071493.949810:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783071493.949813:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b014b8c00, rc 0) 00000100:00100000:3.0:1783071493.949904:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+54:11401:x1869685692884224:12345-192.168.204.38@tcp:101:bash.0 Request processed in 10294us (10592us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1783071493.949913:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 115 00000100:00100000:0.0:1783071493.959066:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071493.961202:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692884480 00000100:00100000:2.0:1783071493.961216:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692884480 00000100:00100000:2.0:1783071493.961287:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 116 00000100:00100000:2.0:1783071493.961297:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0397c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+54:11401:x1869685692884480:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:2.0:1783071493.961320:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071493.961340:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67e00/0x6b58994c2cbdc84a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98eec expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071493.961406:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66e00/0x6b58994c2cbdc851 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071493.961440:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66e00/0x6b58994c2cbdc851 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071493.961453:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66e00/0x6b58994c2cbdc851 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071493.961964:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67e00/0x6b58994c2cbdc84a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98eec expref: 56 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071493.961985:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66e00/0x6b58994c2cbdc851 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98eec expref: 55 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071493.961994:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f8a020ca200) 00010000:00010000:2.0:1783071493.961997:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783071493.962001:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b2fd66e00, rc 0) 00000100:00100000:2.0:1783071493.962070:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0397c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+55:11401:x1869685692884480:12345-192.168.204.38@tcp:101:bash.0 Request processed in 775us (3015us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071493.962078:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 116 00000100:00100000:0.0:1783071493.975240:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071493.975790:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692884736 00000100:00100000:1.0:1783071493.975812:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692884736 00000100:00100000:1.0:1783071493.975876:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 117 00000100:00100000:1.0:1783071493.975897:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0397d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+55:11401:x1869685692884736:12345-192.168.204.38@tcp:36:bash.0 00010000:00010000:1.0:1783071493.976134:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc858 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.976153:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc858 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.976179:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc858 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783071493.976224:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:1.0:1783071493.976250:0:6517:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000018f380ce reply state 00000000f0e2b7f2 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc858 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.976264:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc858 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071493.976271:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f8a020ca200) 00010000:00010000:1.0:1783071493.976274:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783071493.976277:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783071493.976569:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0397d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+58:11401:x1869685692884736:12345-192.168.204.38@tcp:36:bash.0 Request processed in 683us (1347us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1783071493.976577:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 117 00000020:00080000:1.0:1783071493.976582:0:6517:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1783071493.979334:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071493.981160:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692884864 00000100:00100000:3.0:1783071493.981175:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692884864 00000100:00100000:3.0:1783071493.981301:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 118 00000100:00100000:3.0:1783071493.981312:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0397df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+58:11401:x1869685692884864:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:3.0:1783071493.981335:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071493.981356:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8000/0x6b58994c2cbdc85f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98ef3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071493.981484:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdc866 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071493.981501:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdc83c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ee5 expref: 59 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071493.981511:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdc866 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071493.981568:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdc83c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ee5 expref: 59 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071493.981582:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdc83c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ee5 expref: 59 pid: 6518 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071493.981596:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a81180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6518:1869685707635712:192.168.204.38@tcp:104: 00000100:00100000:3.0:1783071493.981688:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b05e0be40 going to sleep for 11 seconds 00000100:00100000:2.0:1783071493.987914:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a81180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6518:1869685707635712:192.168.204.38@tcp:104: 00010000:00010000:2.0:1783071493.987949:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdc866 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071493.994488:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071493.994902:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692884992 00000100:00100000:3.0:1783071493.994912:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692884992 00010000:00010000:3.0:1783071493.994982:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdc83c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ee5 expref: 60 pid: 6518 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071493.995036:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 71 00000100:00100000:3.0:1783071493.995046:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0397ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf7532e4-6153-424a-9f4e-84941256b41f+60:2405:x1869685692884992:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783071493.995061:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071493.995068:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdc83c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ee5 expref: 60 pid: 6518 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071493.995082:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdc83c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ee5 expref: 60 pid: 6518 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071493.995105:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdc83c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ee5 expref: 60 pid: 6518 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071493.995123:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f8a020ca200) 00010000:00010000:3.0:1783071493.995143:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdc866 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071493.995153:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdc866 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071493.995162:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdc866 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071493.995201:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783071493.995262:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0397ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf7532e4-6153-424a-9f4e-84941256b41f+59:2405:x1869685692884992:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 217us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071493.995270:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 71 00010000:00010000:0.0:1783071493.995399:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdc866 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071493.995408:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdc866 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783071493.995470:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1783071493.995475:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783071493.995495:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdc866 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071493.995657:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8000/0x6b58994c2cbdc85f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ef3 expref: 59 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071493.995686:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdc866 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ef3 expref: 58 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071493.995694:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f8a020ca200) 00010000:00010000:0.0:1783071493.995697:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783071493.995700:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b014b8600, rc 0) 00000100:00100000:0.0:1783071493.995728:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0397df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+58:11401:x1869685692884864:12345-192.168.204.38@tcp:101:bash.0 Request processed in 14418us (16404us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071493.995735:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 118 00000100:00100000:3.0:1783071493.999613:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071493.999905:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692885248 00000100:00100000:2.0:1783071493.999915:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692885248 00000100:00100000:2.0:1783071493.999977:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 29 00000100:00100000:2.0:1783071493.999987:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+58:11401:x1869685692885248:12345-192.168.204.38@tcp:35:bash.0 00000100:00100000:2.0:1783071494.000234:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+59:11401:x1869685692885248:12345-192.168.204.38@tcp:35:bash.0 Request processed in 247us (632us total) trans 4294967397 rc 0/0 00000100:00100000:2.0:1783071494.000257:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 29 00000100:00100000:1.0:1783071494.116221:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071494.116329:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692885376 00000100:00100000:2.0:1783071494.116345:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692885376 00000100:00100000:2.0:1783071494.116466:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 119 00000100:00100000:2.0:1783071494.116477:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37abc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+59:11407:x1869685692885376:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1783071494.116502:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071494.116521:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67e00/0x6b58994c2cbdc86d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98efa expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071494.116599:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66800/0x6b58994c2cbdc874 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071494.116613:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66800/0x6b58994c2cbdc874 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071494.116624:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66800/0x6b58994c2cbdc874 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071494.116668:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1783071494.116672:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783071494.116690:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66800/0x6b58994c2cbdc874 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071494.116712:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67e00/0x6b58994c2cbdc86d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98efa expref: 61 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071494.116730:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66800/0x6b58994c2cbdc874 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98efa expref: 60 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071494.116750:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f8a0179f400) 00010000:00010000:2.0:1783071494.116753:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783071494.116757:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b2fd66800, rc 0) 00000100:00100000:2.0:1783071494.117012:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37abc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+60:11407:x1869685692885376:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 536us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071494.117021:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 119 00000100:00100000:0.0:1783071494.126986:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071494.127216:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692885504 00000100:00100000:1.0:1783071494.127227:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692885504 00000100:00100000:1.0:1783071494.127294:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 120 00000100:00100000:1.0:1783071494.127306:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0397dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+60:11407:x1869685692885504:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1783071494.127329:0:13815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071494.127353:0:13815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdc87b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98f01 expref: -99 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.127660:0:13815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc882 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.127699:0:13815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc882 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.127711:0:13815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc882 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.127725:0:13815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc889 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.127732:0:13815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc889 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.127739:0:13815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc889 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.127819:0:13815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc890 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.127828:0:13815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc890 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.127835:0:13815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc890 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783071494.127877:0:13815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1783071494.128332:0:13815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783071494.128355:0:13815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc890 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.128391:0:13815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc890 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.128410:0:13815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc882 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.128416:0:13815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc882 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.128423:0:13815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc882 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.128429:0:13815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01748200 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:1.0:1783071494.128433:0:13815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc882 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.128440:0:13815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc882 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.128845:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f8a0179f400) 00010000:00010000:1.0:1783071494.128850:0:13815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071494.128856:0:13815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc882 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.128863:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc882 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.128878:0:13815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc889 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.128899:0:13815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc889 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.128905:0:13815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc889 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.128916:0:13815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01749a00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:1.0:1783071494.128919:0:13815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc889 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.128925:0:13815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc889 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.128933:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f8b1011aa00) 00010000:00010000:1.0:1783071494.128936:0:13815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071494.128939:0:13815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc889 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.128945:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc889 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.129039:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdc87b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f01 expref: 62 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.129055:0:13815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc890 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f01 expref: 61 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.129063:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f8a020ca200) 00010000:00010000:1.0:1783071494.129066:0:13815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783071494.129068:0:13815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a01749000, rc 0) 00000100:00100000:1.0:1783071494.129140:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0397dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+61:11407:x1869685692885504:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1835us (2163us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071494.129148:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 120 00000100:00100000:3.0:1783071494.133655:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071494.133700:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071494.133855:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692885888 00000100:00100000:0.0:1783071494.133866:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692885888 00000100:00100000:0.0:1783071494.133951:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 121 00000100:00100000:0.0:1783071494.133960:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+61:11407:x1869685692885888:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1783071494.133983:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071494.134003:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdc897 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98f08 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071494.134048:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692885632 00000100:00100000:1.0:1783071494.134066:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692885632 00000100:00100000:1.0:1783071494.134116:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 8 00000100:00100000:1.0:1783071494.134125:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a81500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf7532e4-6153-424a-9f4e-84941256b41f+63:2406:x1869685692885632:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783071494.134125:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdc89e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.134140:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071494.134148:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdc866 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ef3 expref: 63 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071494.134225:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc890 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f01 expref: 63 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071494.134246:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdc89e lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.137673:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f8a020ca200) 00010000:00010000:1.0:1783071494.137686:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdc89e lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.137699:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdc89e lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.137719:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783071494.137738:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc890 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f01 expref: 63 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071494.137771:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdc866 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ef3 expref: 62 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071494.137790:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdc866 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ef3 expref: 62 pid: 6518 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071494.137797:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a81500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf7532e4-6153-424a-9f4e-84941256b41f+62:2406:x1869685692885632:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 3671us (4149us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071494.137808:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 8 00000100:00100000:0.0:1783071494.138006:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0397c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6518:1869685707635968:192.168.204.38@tcp:104: 00000100:00100000:0.0:1783071494.138156:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a032c09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783071494.142145:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0397c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6518:1869685707635968:192.168.204.38@tcp:104: 00010000:00010000:0.0:1783071494.142178:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdc89e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071494.142274:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071494.142695:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692886016 00000100:00100000:3.0:1783071494.142705:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692886016 00010000:00010000:3.0:1783071494.142743:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdc866 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ef3 expref: 62 pid: 6518 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071494.142820:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 72 00000100:00100000:3.0:1783071494.142830:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07797800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf7532e4-6153-424a-9f4e-84941256b41f+62:2406:x1869685692886016:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783071494.142843:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071494.142855:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdc866 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ef3 expref: 62 pid: 6518 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071494.142868:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdc866 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ef3 expref: 62 pid: 6518 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071494.142925:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdc866 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ef3 expref: 62 pid: 6518 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071494.142941:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f8a020ca200) 00010000:00010000:3.0:1783071494.142947:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdc89e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071494.142965:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdc89e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071494.142973:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdc89e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071494.143001:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783071494.143017:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdc89e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071494.143023:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdc89e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783071494.143043:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000100:00100000:3.0:1783071494.143055:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07797800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf7532e4-6153-424a-9f4e-84941256b41f+61:2406:x1869685692886016:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 227us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071494.143063:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 72 00010000:00010000:0.0:1783071494.143337:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdc897 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f08 expref: 62 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071494.143399:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdc89e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f08 expref: 61 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071494.143407:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f8a020ca200) 00010000:00010000:0.0:1783071494.143410:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783071494.143412:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a03865a00, rc 0) 00000100:00100000:0.0:1783071494.143449:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+61:11407:x1869685692885888:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 9490us (9747us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1783071494.143455:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 121 00000100:00100000:2.0:1783071494.150847:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071494.151165:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692886272 00000100:00100000:3.0:1783071494.151180:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692886272 00000100:00100000:3.0:1783071494.151258:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9 00000100:00100000:3.0:1783071494.151279:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07797480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf7532e4-6153-424a-9f4e-84941256b41f+61:11407:x1869685692886272:12345-192.168.204.38@tcp:103:lfs.0 00010000:00010000:3.0:1783071494.151298:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071494.151328:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdc7ef lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ed7 expref: 61 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071494.151350:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f8a020ca200) 00010000:00010000:3.0:1783071494.151355:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783071494.151495:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07797480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf7532e4-6153-424a-9f4e-84941256b41f+60:11407:x1869685692886272:12345-192.168.204.38@tcp:103:lfs.0 Request processed in 227us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071494.151504:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9 00000100:00100000:1.0:1783071494.155324:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071494.155559:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692886400 00000100:00100000:0.0:1783071494.155573:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692886400 00000100:00100000:0.0:1783071494.155675:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 122 00000100:00100000:0.0:1783071494.155686:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37abfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+60:11407:x1869685692886400:12345-192.168.204.38@tcp:58:lfs.0 00010000:00010000:0.0:1783071494.155821:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdc8ac lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071494.155840:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdc8ac lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071494.155930:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdc8ac lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783071494.156036:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1783071494.156168:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37abfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+60:11407:x1869685692886400:12345-192.168.204.38@tcp:58:lfs.0 Request processed in 482us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071494.156177:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 122 00000100:00100000:0.0:1783071494.159532:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071494.160429:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692886528 00000100:00100000:1.0:1783071494.160446:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692886528 00000100:00100000:1.0:1783071494.160538:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 123 00000100:00100000:1.0:1783071494.160554:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0397c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+60:11407:x1869685692886528:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1783071494.160587:0:13815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071494.160616:0:13815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc8b3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98f0f expref: -99 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.160687:0:13815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdc8ac lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.160703:0:13815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc8b3 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f0f expref: 61 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.160748:0:13815:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdc8ac lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.160764:0:13815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc8b3 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f0f expref: 61 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.160778:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f8a020ca200) 00010000:00010000:1.0:1783071494.160780:0:13815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783071494.160784:0:13815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc8b3 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f0f expref: 61 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.160791:0:13815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a01748200, rc 0) 00000100:00100000:1.0:1783071494.160851:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0397c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+61:11407:x1869685692886528:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 303us (1331us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071494.160857:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 123 00010000:00010000:0.0:1783071494.402669:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783071494.786612:0:13796:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783071494.787152:0:13796:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783071494.787192:0:13796:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1783071494.787203:0:13796:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783071494.789017:0:13796:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b07794380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13796:1869685707636096:192.168.204.38@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783071494.789221:0:13796:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a038ca300 going to sleep for 11 seconds 00000100:00100000:3.0:1783071494.796460:0:13796:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b07794380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13796:1869685707636096:192.168.204.38@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783071494.804847:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071494.805462:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692886656 00000100:00100000:2.0:1783071494.805472:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692886656 00000100:00100000:2.0:1783071494.805534:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 124 00000100:00100000:2.0:1783071494.805545:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0397f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+61:11409:x1869685692886656:12345-192.168.204.38@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783071494.805577:0:6518:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783071494.806014:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0397f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+61:11409:x1869685692886656:12345-192.168.204.38@tcp:53:lhsmtool_posix.0 Request processed in 470us (1174us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071494.806022:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 124 00000100:00100000:3.0:1783071494.809758:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071494.811150:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692886784 00000100:00100000:0.0:1783071494.811171:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692886784 00000100:00100000:0.0:1783071494.811246:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 125 00000100:00100000:0.0:1783071494.811267:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+61:11409:x1869685692886784:12345-192.168.204.38@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1783071494.811348:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdc8ba lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071494.811408:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdc8ba lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071494.811421:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdc8ba lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071494.811436:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864800/0x6b58994c2cbdc8c1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071494.811444:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864800/0x6b58994c2cbdc8c1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071494.811450:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864800/0x6b58994c2cbdc8c1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071494.811476:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864000/0x6b58994c2cbdc8c8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071494.811485:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864000/0x6b58994c2cbdc8c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071494.811491:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864000/0x6b58994c2cbdc8c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783071494.811564:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1783071494.811569:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783071494.811581:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864000/0x6b58994c2cbdc8c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071494.811593:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdc8ba lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071494.811600:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdc8ba lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071494.811606:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdc8ba lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071494.811612:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03865600 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:0.0:1783071494.811616:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdc8ba lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071494.812725:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdc8ba lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071494.812749:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f8b0d17fa00) 00010000:00010000:0.0:1783071494.812752:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071494.812758:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdc8ba lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071494.812765:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdc8ba lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071494.812782:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864800/0x6b58994c2cbdc8c1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071494.812805:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864800/0x6b58994c2cbdc8c1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071494.812811:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864800/0x6b58994c2cbdc8c1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071494.812816:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03864800 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:0.0:1783071494.812820:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864800/0x6b58994c2cbdc8c1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071494.812825:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864800/0x6b58994c2cbdc8c1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071494.812833:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff8f8b10db4800) 00010000:00010000:0.0:1783071494.812836:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071494.812838:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864800/0x6b58994c2cbdc8c1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071494.812843:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864800/0x6b58994c2cbdc8c1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071494.812884:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864000/0x6b58994c2cbdc8c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071494.812891:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864000/0x6b58994c2cbdc8c8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071494.812896:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864000/0x6b58994c2cbdc8c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071494.812901:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03864000 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:0.0:1783071494.812910:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864000/0x6b58994c2cbdc8c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071494.812916:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864000/0x6b58994c2cbdc8c8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071494.812924:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f8a020ca200) 00010000:00010000:0.0:1783071494.812926:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071494.812929:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864000/0x6b58994c2cbdc8c8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071494.812934:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864000/0x6b58994c2cbdc8c8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071494.816459:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+61:11409:x1869685692886784:12345-192.168.204.38@tcp:34:lhsmtool_posix.0 Request processed in 5181us (6699us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071494.816475:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 125 00000100:00100000:3.0:1783071494.823134:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071494.823227:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692887040 00000100:00100000:2.0:1783071494.823237:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692887040 00000100:00100000:2.0:1783071494.823305:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 126 00000100:00100000:2.0:1783071494.823334:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+61:11409:x1869685692887040:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783071494.823405:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071494.823431:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdc8cf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98f16 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071494.823553:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdc8d6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071494.823572:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdc8d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071494.823584:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdc8d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071494.823596:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1783071494.823957:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdc8d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071494.823967:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdc8d6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071494.823974:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdc8d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071494.823979:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd66a00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:2.0:1783071494.823984:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdc8d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071494.823992:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdc8d6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071494.824006:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f8a020ca200) 00010000:00010000:2.0:1783071494.824019:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1783071494.824025:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdc8d6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071494.824031:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdc8d6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071494.824081:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdc8cf lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f16 expref: 63 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071494.824092:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f8b0d17fa00) 00010000:00010000:2.0:1783071494.824094:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783071494.824098:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdc8cf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f16 expref: 63 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071494.824108:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b2fd67200, rc 0) 00000100:00100000:2.0:1783071494.824181:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+62:11409:x1869685692887040:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 850us (1054us total) trans 4294967399 rc 301/301 00000100:00100000:2.0:1783071494.824189:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 126 00000100:00100000:0.0:1783071494.834837:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071494.835742:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692887168 00000100:00100000:2.0:1783071494.835754:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692887168 00000100:00100000:2.0:1783071494.835823:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 127 00000100:00100000:2.0:1783071494.835858:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0397ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+62:11409:x1869685692887168:12345-192.168.204.38@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783071494.835902:0:6518:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783071494.836350:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0397ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+62:11409:x1869685692887168:12345-192.168.204.38@tcp:53:lhsmtool_posix.0 Request processed in 516us (1523us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071494.836359:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 127 00000100:00100000:0.0:1783071494.839707:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071494.840191:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692887424 00000100:00100000:1.0:1783071494.840202:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692887424 00000100:00100000:1.0:1783071494.840265:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 128 00000100:00100000:1.0:1783071494.840276:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0397f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+62:11409:x1869685692887424:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783071494.840298:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071494.840301:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1783071494.840327:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66800/0x6b58994c2cbdc874 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98efa expref: 62 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.840413:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f8a0179f400) 00010000:00010000:1.0:1783071494.840419:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783071494.840437:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc8e4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98f1d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783071494.840903:0:6517:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:1.0:1783071494.841332:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc8eb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.841348:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc8eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.841359:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc8eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.841446:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc8e4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f1d expref: 64 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.841461:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc8eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f1d expref: 63 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.841470:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f8b1011a800) 00010000:00010000:1.0:1783071494.841472:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783071494.841475:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a01749a00, rc 0) 00000100:00100000:1.0:1783071494.841541:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0397f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+63:11409:x1869685692887424:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 1267us (1842us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1783071494.841548:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 128 00000100:00100000:3.0:1783071494.844922:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071494.845167:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692887680 00000100:00100000:2.0:1783071494.845191:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692887680 00000100:00100000:2.0:1783071494.845260:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 129 00000100:00100000:2.0:1783071494.845271:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+63:11409:x1869685692887680:12345-192.168.204.38@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783071494.845328:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071494.845355:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdc8eb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f1d expref: 63 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071494.845411:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f8b1011a800) 00010000:00010000:2.0:1783071494.845424:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783071494.845447:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdc8f9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071494.845460:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdc8f9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071494.845470:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdc8f9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071494.845533:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdc900 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x226b5f2e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071494.845540:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdc900 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x226b5f2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071494.845546:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdc900 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x226b5f2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071494.845593:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdc8f9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071494.845599:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdc8f9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071494.845612:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdc8f9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071494.845618:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd66a00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:2.0:1783071494.845731:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdc8f9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071494.845740:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdc8f9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071494.845750:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f8a0179f400) 00010000:00010000:2.0:1783071494.845753:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071494.845758:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdc8f9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071494.845763:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdc8f9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071494.845773:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdc900 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x226b5f2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071494.845779:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdc900 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x226b5f2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071494.845784:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdc900 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x226b5f2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071494.845789:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd66200 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:2.0:1783071494.845792:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdc900 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x226b5f2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071494.845807:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdc900 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x226b5f2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071494.845816:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x226b5f2e (ffff8f8a020ca700) 00010000:00010000:2.0:1783071494.845818:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071494.845821:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdc900 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x226b5f2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071494.845826:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdc900 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x226b5f2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071494.845921:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+62:11409:x1869685692887680:12345-192.168.204.38@tcp:36:lhsmtool_posix.0 Request processed in 650us (1009us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783071494.845928:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 129 00000100:00100000:2.0:1783071494.856116:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071494.856228:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692887808 00000100:00100000:1.0:1783071494.856239:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692887808 00000100:00100000:1.0:1783071494.856311:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 130 00000100:00100000:1.0:1783071494.856322:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07794380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+62:11409:x1869685692887808:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783071494.856343:0:13815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071494.856406:0:13815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc907 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98f24 expref: -99 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.856441:0:13815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdc90e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.856454:0:13815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdc90e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.856465:0:13815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdc90e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.856579:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdc907 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f24 expref: 64 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.856598:0:13815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdc90e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f24 expref: 63 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.856608:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f8b1011a100) 00010000:00010000:1.0:1783071494.856611:0:13815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783071494.856615:0:13815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a01749400, rc 0) 00000100:00100000:1.0:1783071494.856684:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07794380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+63:11409:x1869685692887808:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 364us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071494.856692:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 130 00000100:00100000:1.0:1783071494.869580:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071494.869707:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692888064 00000100:00100000:0.0:1783071494.869718:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692888064 00000100:00100000:0.0:1783071494.869787:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 131 00000100:00100000:0.0:1783071494.869802:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37abf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+63:11409:x1869685692888064:12345-192.168.204.38@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783071494.869950:0:10292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864800/0x6b58994c2cbdc915 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071494.869976:0:10292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864800/0x6b58994c2cbdc915 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071494.869996:0:10292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864800/0x6b58994c2cbdc915 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783071494.870271:0:10292:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:0.0:1783071494.870288:0:10292:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 396658923145ns, next at 397658917765ns, rc = 0 00000004:00010000:0.0:1783071494.870428:0:10292:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f0700353 reply state 000000006aeef825 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864800/0x6b58994c2cbdc915 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071494.870441:0:10292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864800/0x6b58994c2cbdc915 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071494.870449:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f8b1011a100) 00010000:00010000:0.0:1783071494.870452:0:10292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1783071494.870455:0:10292:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783071494.871668:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37abf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+65:11409:x1869685692888064:12345-192.168.204.38@tcp:36:lhsmtool_posix.0 Request processed in 1786us (2012us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1783071494.871689:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 131 00000100:00100000:3.0:1783071494.875276:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071494.876980:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692888192 00000100:00100000:2.0:1783071494.876996:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692888192 00000100:00100000:2.0:1783071494.877077:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 132 00000100:00100000:2.0:1783071494.877089:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+65:11409:x1869685692888192:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783071494.877119:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071494.877141:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdc91c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98f2b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071494.877202:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdc91c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f2b expref: 66 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071494.877216:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdc91c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f2b expref: 66 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071494.877249:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f8b1011a100) 00010000:00010000:2.0:1783071494.877252:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783071494.877255:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b2fd66a00, rc 0) 00000100:00100000:2.0:1783071494.877331:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+66:11409:x1869685692888192:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 245us (2065us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071494.877339:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 132 00000100:00100000:2.0:1783071494.894232:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071494.894403:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692888320 00000100:00100000:3.0:1783071494.894416:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692888320 00000100:00100000:3.0:1783071494.894543:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 45 00000100:00100000:3.0:1783071494.894558:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3b77b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf7532e4-6153-424a-9f4e-84941256b41f+8:2405:x1869685692888320:12345-192.168.204.38@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1783071494.894813:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3b77b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf7532e4-6153-424a-9f4e-84941256b41f+9:2405:x1869685692888320:12345-192.168.204.38@tcp:2:lhsmtool_posix.0 Request processed in 260us (593us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1783071494.894822:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 45 00000100:00080000:0.0:1783071494.895931:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783071494.902117:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071494.902234:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692888576 00000100:00100000:2.0:1783071494.902244:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692888576 00000100:00100000:2.0:1783071494.902308:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30 00000100:00100000:2.0:1783071494.902319:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0397e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+66:11409:x1869685692888576:12345-192.168.204.38@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1783071494.902589:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0397e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+67:11409:x1869685692888576:12345-192.168.204.38@tcp:35:lhsmtool_posix.0 Request processed in 271us (486us total) trans 4294967402 rc 0/0 00000100:00100000:2.0:1783071494.902598:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30 00000100:00100000:2.0:1783071494.909167:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071494.909284:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692888832 00000100:00100000:1.0:1783071494.909302:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692888832 00000100:00100000:1.0:1783071494.909406:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 133 00000100:00100000:1.0:1783071494.909419:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3b77a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+67:11409:x1869685692888832:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1783071494.909544:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3b77a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+67:11409:x1869685692888832:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 Request processed in 128us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071494.909553:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 133 00000100:00100000:0.0:1783071494.915826:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071494.915939:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692888960 00000100:00100000:2.0:1783071494.915950:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692888960 00000100:00100000:2.0:1783071494.916024:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 134 00000100:00100000:2.0:1783071494.916034:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0397f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+67:11409:x1869685692888960:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783071494.916056:0:10292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071494.916076:0:10292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdc923 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98f32 expref: -99 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071494.916157:0:10292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdc92a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071494.916186:0:10292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdc92a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071494.916198:0:10292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdc92a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071494.916246:0:10292:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783071494.916265:0:10292:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdc92a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071494.919042:0:10292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdc923 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f32 expref: 69 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071494.919079:0:10292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdc92a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f32 expref: 68 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071494.919090:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f8b1011a100) 00010000:00010000:2.0:1783071494.919093:0:10292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1783071494.919097:0:10292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b2fd66200, rc 0) 00000100:00100000:2.0:1783071494.919192:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0397f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+68:11409:x1869685692888960:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 3159us (3378us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071494.919201:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 134 00000100:00100000:0.0:1783071494.933629:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071494.933725:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692889088 00000100:00100000:1.0:1783071494.933737:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692889088 00000100:00100000:1.0:1783071494.933806:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 46 00000100:00100000:1.0:1783071494.933819:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0397c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf7532e4-6153-424a-9f4e-84941256b41f+9:2406:x1869685692889088:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783071494.933840:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071494.933862:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070fd10ee/0x6b58994c2cbdc931 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98f39 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783071494.933904:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a478307, blocks: 0x0 00010000:00010000:1.0:1783071494.933930:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=396s v=(0 0) 00010000:00010000:1.0:1783071494.933936:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783071494.933959:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070fd10ee/0x6b58994c2cbdc931 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f39 expref: 10 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.933986:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000070fd10ee/0x6b58994c2cbdc931 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f39 expref: 10 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.934001:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a01749000, rc 0) 00000100:00100000:1.0:1783071494.934096:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0397c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf7532e4-6153-424a-9f4e-84941256b41f+10:2406:x1869685692889088:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 279us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071494.934104:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 46 00000100:00100000:3.0:1783071494.937743:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071494.937854:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692889344 00000100:00100000:1.0:1783071494.937875:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692889344 00000100:00100000:1.0:1783071494.938008:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 135 00000100:00100000:1.0:1783071494.938019:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c668380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+68:11409:x1869685692889344:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1783071494.938293:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c668380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+68:11409:x1869685692889344:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 Request processed in 275us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071494.938302:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 135 00000100:00100000:2.0:1783071494.943573:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071494.943675:0:8910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692889472 00000100:00100000:1.0:1783071494.943685:0:8910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692889472 00000100:00100000:1.0:1783071494.943743:0:8910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 47 00000100:00100000:1.0:1783071494.943754:0:8910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3b77ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf7532e4-6153-424a-9f4e-84941256b41f+10:11409:x1869685692889472:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783071494.943776:0:8910:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071494.943797:0:8910:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008774de30/0x6b58994c2cbdc938 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98f40 expref: -99 pid: 8910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.943831:0:8910:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000070fd10ee/0x6b58994c2cbdc931 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f39 expref: 11 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.943841:0:8910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783071494.943845:0:8910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783071494.943850:0:8910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008774de30/0x6b58994c2cbdc938 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f40 expref: 11 pid: 8910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.943915:0:8910:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000070fd10ee/0x6b58994c2cbdc931 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f39 expref: 11 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.943929:0:8910:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000070fd10ee/0x6b58994c2cbdc931 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f39 expref: 11 pid: 8431 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071494.943944:0:8910:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37abe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8910:1869685707636224:192.168.204.38@tcp:104: 00000100:00100000:1.0:1783071494.945264:0:8910:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b09bb1e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783071494.951299:0:8910:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37abe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8910:1869685707636224:192.168.204.38@tcp:104: 00010000:00010000:1.0:1783071494.951351:0:8910:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008774de30/0x6b58994c2cbdc938 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f40 expref: 11 pid: 8910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.951415:0:8910:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a01749600, rc 0) 00000100:00100000:1.0:1783071494.951491:0:8910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3b77ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf7532e4-6153-424a-9f4e-84941256b41f+11:11409:x1869685692889472:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 7738us (7932us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071494.951501:0:8910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 47 00000100:00100000:2.0:1783071494.954565:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071494.954670:0:7923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692889600 00000100:00100000:1.0:1783071494.954680:0:7923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692889600 00010000:00010000:1.0:1783071494.954719:0:7923:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000070fd10ee/0x6b58994c2cbdc931 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f39 expref: 11 pid: 8431 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071494.954762:0:7923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 73 00000100:00100000:1.0:1783071494.954772:0:7923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab8d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf7532e4-6153-424a-9f4e-84941256b41f+11:2405:x1869685692889600:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783071494.954803:0:7923:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071494.954828:0:7923:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000070fd10ee/0x6b58994c2cbdc931 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f39 expref: 11 pid: 8431 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.954844:0:7923:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000070fd10ee/0x6b58994c2cbdc931 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f39 expref: 11 pid: 8431 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.954880:0:7923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070fd10ee/0x6b58994c2cbdc931 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f39 expref: 11 pid: 8431 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.954898:0:7923:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783071494.954903:0:7923:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783071494.954913:0:7923:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008774de30/0x6b58994c2cbdc938 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f40 expref: 10 pid: 8910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.954925:0:7923:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008774de30/0x6b58994c2cbdc938 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f40 expref: 10 pid: 8910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.955073:0:7923:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008774de30/0x6b58994c2cbdc938 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f40 expref: 10 pid: 8910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071494.955169:0:7923:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37abe300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7923:1869685707636352:192.168.204.38@tcp:105: 00000100:00100000:1.0:1783071494.955300:0:7923:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b09bb1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783071494.959648:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071494.959758:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692889728 00000100:00100000:0.0:1783071494.959768:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692889728 00002000:00100000:0.0:1783071494.959823:0:8435:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8f8b3b778a80 x1869685692889728/t0(0) o4->bf7532e4-6153-424a-9f4e-84941256b41f@192.168.204.38@tcp:85/0 lens 504/0 e 0 to 0 dl 1783071505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783071494.959835:0:8435:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8f8b3b778a80 with x1869685692889728 ext(0->12) 00002000:00010000:0.0:1783071494.959840:0:8435:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f8b3b778a80 00000100:00100000:0.0:1783071494.959883:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2 00000100:00100000:0.0:1783071494.959894:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3b778a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bf7532e4-6153-424a-9f4e-84941256b41f+11:2406:x1869685692889728:12345-192.168.204.38@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1783071494.960698:0:7923:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37abe300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7923:1869685707636352:192.168.204.38@tcp:105: 00010000:00010000:1.0:1783071494.960721:0:7923:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071494.960788:0:7923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab8d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf7532e4-6153-424a-9f4e-84941256b41f+11:2405:x1869685692889600:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 6016us (6234us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071494.960797:0:7923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 73 00000100:00100000:0.0:1783071494.961223:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3b778a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bf7532e4-6153-424a-9f4e-84941256b41f+12:2406:x1869685692889728:12345-192.168.204.38@tcp:4:lhsmtool_posix.0 Request processed in 1329us (1582us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1783071494.961232:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2 00002000:00100000:0.0:1783071494.961258:0:8435:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8f8b3b778a80 x1869685692889728/t4294967309(0) o4->bf7532e4-6153-424a-9f4e-84941256b41f@192.168.204.38@tcp:85/0 lens 504/448 e 0 to 0 dl 1783071505 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783071494.961269:0:8435:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8f8b3b778a80 with x1869685692889728 ext(0->12) 00002000:00010000:0.0:1783071494.961275:0:8435:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f8b3b778a80 00000100:00100000:0.0:1783071494.966463:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071494.966563:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692889856 00000100:00100000:2.0:1783071494.966574:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692889856 00000100:00100000:2.0:1783071494.966635:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 136 00000100:00100000:2.0:1783071494.966661:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0397d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+68:11409:x1869685692889856:12345-192.168.204.38@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1783071494.969627:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:2.0:1783071494.969648:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000004:00080000:2.0:1783071494.969693:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:2.0:1783071494.969723:0:6495:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f8a0317e6c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1783071494.969730:0:6495:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8f8b3c64f600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f8a0317e480 00000020:00080000:2.0:1783071494.969733:0:6495:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8f8b3c64f800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f8b05a8d400 00000020:00080000:2.0:1783071494.969782:0:6495:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f8b3c766f00 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1783071494.969786:0:6495:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8f8b3c64f100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f8b3c766c00 00000020:00080000:2.0:1783071494.969789:0:6495:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8f8b3c64f700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f8a038adc00 00000020:00080000:2.0:1783071494.969800:0:6495:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:2.0:1783071494.969819:0:6549:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1783071494.969911:0:6549:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1783071494.970413:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37abe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707636480:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783071494.970483:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071494.970611:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37abd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707636608:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1783071494.970644:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0397ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707636736:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783071494.970842:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0397d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+22:11409:x1869685692889856:12345-192.168.204.38@tcp:44:lhsmtool_posix.0 Request processed in 4180us (4386us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071494.970854:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 136 00010000:00010000:3.0:1783071494.971457:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865000/0x6b58994c2cbdc63d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071494.971470:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865000/0x6b58994c2cbdc63d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071494.971478:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865000/0x6b58994c2cbdc63d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071494.971485:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03865000 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071494.971490:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865000/0x6b58994c2cbdc63d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071494.971520:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865000/0x6b58994c2cbdc63d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071494.971537:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f8a020ca400) 00010000:00010000:3.0:1783071494.971540:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071494.971545:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865000/0x6b58994c2cbdc63d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071494.971552:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865000/0x6b58994c2cbdc63d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071494.971575:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdc6e5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071494.971582:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdc6e5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071494.971587:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdc6e5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071494.971591:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd67400 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071494.971594:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdc6e5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071494.971600:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdc6e5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071494.971607:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f8b10db4c00) 00010000:00010000:3.0:1783071494.971610:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071494.971613:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdc6e5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071494.971627:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdc6e5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071494.971657:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdc763 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071494.971663:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdc763 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071494.971668:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdc763 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071494.971673:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01749e00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071494.971675:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdc763 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071494.971680:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdc763 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071494.971688:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f8b1011aa00) 00010000:00010000:3.0:1783071494.971691:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071494.971693:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdc763 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071494.971699:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdc763 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071494.971708:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdc786 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071494.971714:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdc786 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071494.971725:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdc786 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071494.971729:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01749c00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071494.971732:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdc786 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071494.971737:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdc786 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071494.971744:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f8b1011aa00) 00010000:00010000:3.0:1783071494.971746:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071494.971749:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdc786 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071494.971754:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdc786 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071494.971771:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc858 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071494.971777:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc858 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071494.971783:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc858 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071494.971787:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01748000 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071494.971790:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc858 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071494.971805:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc858 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071494.971814:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f8a020ca200) 00010000:00010000:3.0:1783071494.971816:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071494.971819:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc858 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071494.971824:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdc858 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071494.971837:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864800/0x6b58994c2cbdc915 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071494.971843:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864800/0x6b58994c2cbdc915 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071494.971849:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864800/0x6b58994c2cbdc915 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071494.971854:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03864800 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071494.971856:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864800/0x6b58994c2cbdc915 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071494.971862:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864800/0x6b58994c2cbdc915 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071494.971881:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f8b1011a100) 00010000:00010000:3.0:1783071494.971883:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783071494.971886:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864800/0x6b58994c2cbdc915 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071494.971917:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864800/0x6b58994c2cbdc915 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071494.972182:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071494.976187:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071494.979387:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707636480 00000100:00100000:1.0:1783071494.979404:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707636480 00000100:00100000:1.0:1783071494.979500:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707636736 00000100:00100000:1.0:1783071494.979504:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707636736 00000100:00100000:1.0:1783071494.979536:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783071494.979547:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3b778380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1869685707636480:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1783071494.979588:0:8431:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:1.0:1783071494.979620:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d161545a/0x6b58994c2cbdc93f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.979647:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a19eddc3/0x6b58994c2cbdc6f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e98 expref: 11 pid: 8910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.979657:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1783071494.979661:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783071494.979666:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d161545a/0x6b58994c2cbdc93f lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.979707:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a19eddc3/0x6b58994c2cbdc6f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e98 expref: 11 pid: 8910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.979725:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a19eddc3/0x6b58994c2cbdc6f3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e98 expref: 11 pid: 8910 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071494.979743:0:8431:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37abe680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8431:1869685707636864:192.168.204.38@tcp:104: 00000100:00100000:1.0:1783071494.979850:0:8431:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0317e780 going to sleep for 11 seconds 00000100:00100000:1.0:1783071494.979889:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783071494.979898:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0397ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3645:x1869685707636736:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1783071494.979913:0:8432:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00002000:00010000:1.0:1783071494.979937:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a478306, atime: 0x6a478306, ctime: 0x6a478306, blocks: 0x8 00010000:00010000:1.0:1783071494.980246:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b0b7a50/0x6b58994c2cbdc946 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.980328:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=396s v=(0 0) 00010000:00010000:1.0:1783071494.980332:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783071494.980337:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b0b7a50/0x6b58994c2cbdc946 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.980354:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b0b7a50/0x6b58994c2cbdc946 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.980401:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b0b7a50/0x6b58994c2cbdc946 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.980410:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b0b7a50/0x6b58994c2cbdc946 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071494.980425:0:8432:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783071494.980616:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0397ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3645:x1869685707636736:12345-0@lo:6:osp-syn-1-0.0 Request processed in 717us (8433us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1783071494.980625:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00010000:2.0:1783071494.980715:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783071494.980723:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b0b7a50/0x6b58994c2cbdc946 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071494.980731:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b421d9c00 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:2.0:1783071494.980735:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b0b7a50/0x6b58994c2cbdc946 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071494.980755:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b0b7a50/0x6b58994c2cbdc946 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071494.980774:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b0b7a50/0x6b58994c2cbdc946 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071494.980782:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b0b7a50/0x6b58994c2cbdc946 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071494.980805:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071494.980807:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071494.980809:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071494.981488:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3b77b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:feaa1501-b927-4e07-baad-3200e92d7497:3647:1869685707637120:0@lo:400:kworker.0 00000100:00100000:2.0:1783071494.981537:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071494.981570:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c68e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707637632:0@lo:400:kworker.0 00000100:00100000:2.0:1783071494.981596:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071494.981614:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b0ab60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1869685707638144:0@lo:400:kworker.0 00000100:00100000:2.0:1783071494.981636:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071494.981656:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1783071494.981662:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869685707637248:0@lo:400:kworker.0 00000100:00100000:2.0:1783071494.981682:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071494.981697:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c68f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1869685707637760:0@lo:400:kworker.0 00000100:00100000:2.0:1783071494.981716:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071494.981731:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1869685707638272:0@lo:400:kworker.0 00000100:00100000:2.0:1783071494.981763:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071494.981791:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707637120 00000100:00100000:2.0:1783071494.981797:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707637120 00000100:00100000:2.0:1783071494.981838:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1783071494.981845:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18685450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+24:3647:x1869685707637120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071494.981898:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18685450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+24:3647:x1869685707637120:12345-0@lo:400:kworker.0 Request processed in 53us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071494.981906:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1783071494.981956:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3b77b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:feaa1501-b927-4e07-baad-3200e92d7497:3647:1869685707637120:0@lo:400:kworker.0 00000100:00100000:2.0:1783071494.981991:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707637632 00000100:00100000:2.0:1783071494.981995:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707637632 00000100:00100000:2.0:1783071494.982021:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1783071494.982027:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0380b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707637632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071494.982064:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0380b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707637632:12345-0@lo:400:kworker.0 Request processed in 37us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071494.982071:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1783071494.982495:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c68e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707637632:0@lo:400:kworker.0 00000100:00100000:2.0:1783071494.982515:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707638144 00000100:00100000:2.0:1783071494.982519:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707638144 00000100:00100000:2.0:1783071494.982546:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707637248 00000100:00100000:2.0:1783071494.982549:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707637248 00000100:00100000:2.0:1783071494.982560:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707637760 00000100:00100000:2.0:1783071494.982562:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707637760 00000100:00100000:2.0:1783071494.982574:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707638272 00000100:00100000:2.0:1783071494.982576:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707638272 00000100:00100000:2.0:1783071494.982589:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1783071494.982595:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03808e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869685707638144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071494.982643:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03808e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869685707638144:12345-0@lo:400:kworker.0 Request processed in 47us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071494.982649:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1783071494.982660:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1783071494.982666:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03809f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869685707637248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071494.982690:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03809f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869685707637248:12345-0@lo:400:kworker.0 Request processed in 24us (1007us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071494.982696:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1783071494.982705:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1783071494.982710:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c685c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869685707637760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071494.982732:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c685c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869685707637760:12345-0@lo:400:kworker.0 Request processed in 22us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071494.982737:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1783071494.982746:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1783071494.982751:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869685707638272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071494.982771:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869685707638272:12345-0@lo:400:kworker.0 Request processed in 21us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071494.982777:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1783071494.982797:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869685707637248:0@lo:400:kworker.0 00000100:00100000:2.0:1783071494.982806:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c68f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1869685707637760:0@lo:400:kworker.0 00010000:00080000:2.0:1783071494.982817:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c78df80 x1869685707638272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071510 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071494.982826:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1869685707638272:0@lo:400:kworker.0 00000100:00100000:2.0:1783071494.982845:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b0ab60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1869685707638144:0@lo:400:kworker.0 00000100:00100000:0.0:1783071494.983192:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3b779c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707636992:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783071494.983227:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071494.983242:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01765c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869685707637504:0@lo:400:kworker.0 00000100:00100000:0.0:1783071494.983278:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071494.983303:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b0ab60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707638016:0@lo:400:kworker.0 00000100:00100000:0.0:1783071494.983326:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071494.983342:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1783071494.983349:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01767b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707637376:0@lo:400:kworker.0 00000100:00100000:0.0:1783071494.983389:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071494.983402:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1869685707637888:0@lo:400:kworker.0 00000100:00100000:0.0:1783071494.983421:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071494.983433:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707638400:0@lo:400:kworker.0 00000100:00100000:0.0:1783071494.983452:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783071494.983469:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783071494.983473:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783071494.983477:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783071494.983487:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1783071494.983550:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f8a0397ea00/2, rc 0, transno 4294967305 00000100:00100000:0.0:1783071494.983556:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0397ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707636736:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1783071494.983573:0:9413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707636992 00000100:00100000:0.0:1783071494.983576:0:9413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707636992 00000100:00100000:0.0:1783071494.983601:0:9413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707637376 00000100:00100000:0.0:1783071494.983604:0:9413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707637376 00000100:00100000:0.0:1783071494.983615:0:9413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1783071494.983621:0:9413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02e43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3646:x1869685707636992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783071494.983658:0:9413:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1783071494.983708:0:9413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02e43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3646:x1869685707636992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071494.983716:0:9413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1783071494.983734:0:9413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1783071494.983743:0:9413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707637376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071494.983748:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707636608 00000100:00100000:3.0:1783071494.983755:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707636608 00000100:00100000:0.0:1783071494.983773:0:9413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707637376:12345-0@lo:400:kworker.0 Request processed in 31us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071494.983781:0:9413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1783071494.983799:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707638016 00000100:00100000:3.0:1783071494.983804:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707638016 00000100:00100000:0.0:1783071494.983813:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01767b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707637376:0@lo:400:kworker.0 00000100:00100000:0.0:1783071494.983832:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3b779c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707636992:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783071494.983834:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707638400 00000100:00100000:3.0:1783071494.983839:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707638400 00000100:00080000:0.0:1783071494.983861:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783071494.983878:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783071494.983882:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1783071494.983893:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03905880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707638016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071494.983944:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03905880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707638016:12345-0@lo:400:kworker.0 Request processed in 54us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071494.983952:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1783071494.983965:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1783071494.983972:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707638400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071494.984137:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707638400:12345-0@lo:400:kworker.0 Request processed in 164us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071494.984143:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1783071494.984156:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783071494.984163:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02e41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3648:x1869685707636608:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1783071494.984402:0:8429:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1783071494.984406:0:8429:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1783071495 00002000:00010000:3.0:1783071494.984409:0:8429:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1783071494.984411:0:8429:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1783071495 -> 1783071495 00002000:00010000:3.0:1783071494.984413:0:8429:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1783071494.984481:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02e41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3648:x1869685707636608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 318us (8303us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1783071494.984488:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783071494.984544:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707637504 00000100:00100000:1.0:1783071494.984550:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707637504 00000100:00100000:1.0:1783071494.984589:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707637888 00000100:00100000:1.0:1783071494.984592:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707637888 00000100:00080000:1.0:1783071494.984610:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783071494.984630:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1783071494.984637:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3b4daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869685707637504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071494.984681:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3b4daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869685707637504:12345-0@lo:400:kworker.0 Request processed in 44us (1401us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071494.984686:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1783071494.984701:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1783071494.984707:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869685707637888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071494.984733:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869685707637888:12345-0@lo:400:kworker.0 Request processed in 26us (1310us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071494.984739:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00010000:00080000:0.0:1783071494.984813:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c6aa680 x1869685707637888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071510 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071494.984825:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1869685707637888:0@lo:400:kworker.0 00000100:00100000:0.0:1783071494.984836:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707638400:0@lo:400:kworker.0 00000100:00100000:0.0:1783071494.984859:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01765c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869685707637504:0@lo:400:kworker.0 00000100:00100000:0.0:1783071494.984881:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b0ab60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707638016:0@lo:400:kworker.0 00000004:00080000:0.0:1783071494.984919:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f8b37abd180/2, rc 0, transno 4294967310 00000100:00100000:0.0:1783071494.984925:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37abd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707636608:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1783071494.985814:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071494.986840:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692889984 00000100:00100000:3.0:1783071494.986852:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692889984 00000100:00100000:3.0:1783071494.986920:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 51 00000100:00100000:3.0:1783071494.986932:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf7532e4-6153-424a-9f4e-84941256b41f+12:2405:x1869685692889984:12345-192.168.204.38@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1783071494.989886:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071494.990762:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692890112 00000100:00100000:3.0:1783071494.990772:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692890112 00010000:00010000:3.0:1783071494.990815:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a19eddc3/0x6b58994c2cbdc6f3 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e98 expref: 13 pid: 8910 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071494.990875:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 74 00000100:00100000:3.0:1783071494.990885:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf7532e4-6153-424a-9f4e-84941256b41f+13:2405:x1869685692890112:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783071494.990901:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071494.990907:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a19eddc3/0x6b58994c2cbdc6f3 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e98 expref: 13 pid: 8910 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071494.990919:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a19eddc3/0x6b58994c2cbdc6f3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e98 expref: 13 pid: 8910 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071494.990955:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783071494.990960:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783071494.990966:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d161545a/0x6b58994c2cbdc93f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071494.990996:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d161545a/0x6b58994c2cbdc93f lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071494.991018:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783071494.991162:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf7532e4-6153-424a-9f4e-84941256b41f+13:2405:x1869685692890112:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 277us (1284us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071494.991170:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 74 00000001:00080000:3.0:1783071494.994517:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:3.0:1783071494.994534:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:0.0:1783071494.994737:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf7532e4-6153-424a-9f4e-84941256b41f+7:2405:x1869685692889984:12345-192.168.204.38@tcp:16:lhsmtool_posix.0 Request processed in 7802us (8922us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071494.994751:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 51 00010000:00010000:1.0:1783071495.001677:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a19eddc3/0x6b58994c2cbdc6f3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e98 expref: 6 pid: 8910 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071495.001707:0:8431:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37abe680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8431:1869685707636864:192.168.204.38@tcp:104: 00010000:00010000:1.0:1783071495.001737:0:8431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d161545a/0x6b58994c2cbdc93f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071495.001751:0:8431:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d161545a/0x6b58994c2cbdc93f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071495.001760:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d161545a/0x6b58994c2cbdc93f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071495.001794:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d161545a/0x6b58994c2cbdc93f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071495.001803:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d161545a/0x6b58994c2cbdc93f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071495.001822:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783071495.002087:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3b778380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1869685707636480:12345-0@lo:6:osp-syn-0-0.0 Request processed in 22540us (31602us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1783071495.002097:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:0.0:1783071495.002658:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783071495.002668:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d161545a/0x6b58994c2cbdc93f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071495.002680:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b421d9a00 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:0.0:1783071495.002685:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d161545a/0x6b58994c2cbdc93f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071495.002695:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d161545a/0x6b58994c2cbdc93f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071495.002718:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d161545a/0x6b58994c2cbdc93f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071495.002725:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d161545a/0x6b58994c2cbdc93f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071495.002764:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071495.002777:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071495.002778:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071495.003035:0:3647:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1783071495.003042:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:3.0:1783071495.003059:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f8b37abd180, transno 4294967310 00000100:00100000:3.0:1783071495.003084:0:3647:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff8f8b37abe300 x1869685707636480/t4294967311(4294967311) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1783071510 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1783071495.003096:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f8b37abe300/2, rc 0, transno 4294967311 00000100:00100000:3.0:1783071495.003102:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37abe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707636480:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1783071495.003276:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071495.003794:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692890368 00000100:00100000:3.0:1783071495.003803:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692890368 00000100:00100000:3.0:1783071495.003884:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 137 00000100:00100000:3.0:1783071495.003897:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+16:11409:x1869685692890368:12345-192.168.204.38@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783071495.003958:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071495.003988:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdc92a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f32 expref: 16 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071495.004006:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f8b1011a100) 00010000:00010000:3.0:1783071495.004021:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783071495.004062:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdc94d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071495.004092:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdc94d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071495.004103:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdc94d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783071495.004197:0:6516:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004454454e reply state 00000000281ea3ae transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdc94d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071495.004209:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdc94d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071495.004216:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f8b1011a100) 00010000:00010000:3.0:1783071495.004219:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783071495.004221:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783071495.004579:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+17:11409:x1869685692890368:12345-192.168.204.38@tcp:36:lhsmtool_posix.0 Request processed in 685us (1303us total) trans 4294967403 rc 0/0 00000100:00100000:3.0:1783071495.004587:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 137 00000100:00080000:1.0:1783071495.005456:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783071495.009192:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071495.009407:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692890496 00000100:00100000:1.0:1783071495.009419:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692890496 00000100:00100000:1.0:1783071495.009470:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 52 00000100:00100000:1.0:1783071495.009481:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c78e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf7532e4-6153-424a-9f4e-84941256b41f+6:2405:x1869685692890496:12345-192.168.204.38@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1783071495.009639:0:8432:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1783071495.009643:0:8432:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1783071495 -> 1783071494 00002000:00010000:1.0:1783071495.009646:0:8432:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1783071494 00002000:00010000:1.0:1783071495.009648:0:8432:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1783071495 -> 1783071494 00002000:00010000:1.0:1783071495.009650:0:8432:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1783071495.009712:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c78e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf7532e4-6153-424a-9f4e-84941256b41f+7:2405:x1869685692890496:12345-192.168.204.38@tcp:2:lhsmtool_posix.0 Request processed in 232us (529us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1783071495.009720:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 52 00000100:00100000:0.0:1783071495.018007:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071495.018195:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692890752 00000100:00100000:2.0:1783071495.018204:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692890752 00000100:00100000:2.0:1783071495.018271:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 138 00000100:00100000:2.0:1783071495.018282:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+17:11409:x1869685692890752:12345-192.168.204.38@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1783071495.018359:0:10292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc954 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071495.018420:0:10292:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdc90e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f24 expref: 17 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071495.018430:0:10292:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc954 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071495.018467:0:10292:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdc90e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f24 expref: 17 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071495.018482:0:10292:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdc90e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f24 expref: 17 pid: 13815 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071495.018497:0:10292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10292:1869685707638528:192.168.204.38@tcp:104: 00000100:00100000:2.0:1783071495.018594:0:10292:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a038cae40 going to sleep for 11 seconds 00000100:00100000:0.0:1783071495.030575:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071495.030647:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692890880 00000100:00100000:3.0:1783071495.030659:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692890880 00000100:00100000:2.0:1783071495.030708:0:10292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10292:1869685707638528:192.168.204.38@tcp:104: 00010000:00010000:3.0:1783071495.030710:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdc90e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f24 expref: 18 pid: 13815 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071495.030742:0:10292:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc954 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071495.030769:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 75 00000100:00100000:3.0:1783071495.030778:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c683b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf7532e4-6153-424a-9f4e-84941256b41f+18:2405:x1869685692890880:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783071495.030823:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071495.030831:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdc90e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f24 expref: 18 pid: 13815 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071495.030845:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdc90e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f24 expref: 18 pid: 13815 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071495.030879:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdc90e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f24 expref: 18 pid: 13815 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071495.030898:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f8b1011a100) 00010000:00010000:2.0:1783071495.030904:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc954 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071495.030915:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc954 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071495.030923:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc954 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071495.031096:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783071495.031212:0:10292:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc954 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071495.031220:0:10292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc954 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071495.031264:0:10292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc954 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071495.031272:0:10292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc954 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071495.031279:0:10292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc954 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071495.031298:0:10292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd67600 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:0.0:1783071495.031303:0:10292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc954 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071495.031311:0:10292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc954 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071495.031320:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f8b1011a100) 00010000:00010000:0.0:1783071495.031324:0:10292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1783071495.031327:0:10292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc954 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071495.031334:0:10292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdc954 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071495.031919:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c683b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf7532e4-6153-424a-9f4e-84941256b41f+17:2405:x1869685692890880:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1136us (1352us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071495.031931:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 75 00000100:00100000:0.0:1783071495.034790:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+16:11409:x1869685692890752:12345-192.168.204.38@tcp:55:lhsmtool_posix.0 Request processed in 16498us (16780us total) trans 0 rc -22/-22 00000100:00100000:0.0:1783071495.034808:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 138 00000100:00100000:0.0:1783071495.055338:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071495.056969:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692891008 00000100:00100000:3.0:1783071495.057003:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692891008 00000100:00100000:3.0:1783071495.057090:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 53 00000100:00100000:3.0:1783071495.057102:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c681500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf7532e4-6153-424a-9f4e-84941256b41f+7:2406:x1869685692891008:12345-192.168.204.38@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1783071495.057152:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b31633a2/0x6b58994c2cbdc95b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071495.057173:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008774de30/0x6b58994c2cbdc938 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f40 expref: 7 pid: 8910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071495.057182:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783071495.057186:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783071495.057190:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b31633a2/0x6b58994c2cbdc95b lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071495.057231:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008774de30/0x6b58994c2cbdc938 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f40 expref: 7 pid: 8910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071495.057246:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008774de30/0x6b58994c2cbdc938 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f40 expref: 7 pid: 8910 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071495.057261:0:8429:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03330000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8429:1869685707638656:192.168.204.38@tcp:104: 00000100:00100000:3.0:1783071495.057419:0:8429:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b05e0be40 going to sleep for 11 seconds 00000100:00100000:0.0:1783071495.060436:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071495.061068:0:8429:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03330000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8429:1869685707638656:192.168.204.38@tcp:104: 00010000:00010000:3.0:1783071495.061098:0:8429:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b31633a2/0x6b58994c2cbdc95b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071495.068325:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692891136 00000100:00100000:1.0:1783071495.068343:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692891136 00010000:00010000:1.0:1783071495.068425:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008774de30/0x6b58994c2cbdc938 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f40 expref: 8 pid: 8910 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071495.068465:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 76 00000100:00100000:1.0:1783071495.068476:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c688000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf7532e4-6153-424a-9f4e-84941256b41f+8:2405:x1869685692891136:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783071495.068492:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071495.068516:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008774de30/0x6b58994c2cbdc938 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f40 expref: 8 pid: 8910 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071495.068530:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008774de30/0x6b58994c2cbdc938 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f40 expref: 8 pid: 8910 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071495.068553:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008774de30/0x6b58994c2cbdc938 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f40 expref: 8 pid: 8910 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071495.068568:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783071495.068571:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783071495.068577:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b31633a2/0x6b58994c2cbdc95b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071495.068586:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b31633a2/0x6b58994c2cbdc95b lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071495.068621:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071495.068690:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c688000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf7532e4-6153-424a-9f4e-84941256b41f+7:2405:x1869685692891136:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 216us (8263us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071495.068698:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 76 00010000:00010000:3.0:1783071495.068836:0:8429:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b31633a2/0x6b58994c2cbdc95b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071495.068847:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b31633a2/0x6b58994c2cbdc95b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071495.068878:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b31633a2/0x6b58994c2cbdc95b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071495.068887:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b31633a2/0x6b58994c2cbdc95b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071495.068896:0:8429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b31633a2/0x6b58994c2cbdc95b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071495.068902:0:8429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b014b8c00 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:3.0:1783071495.068906:0:8429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b31633a2/0x6b58994c2cbdc95b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071495.068914:0:8429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b31633a2/0x6b58994c2cbdc95b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071495.068926:0:8429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b31633a2/0x6b58994c2cbdc95b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071495.068945:0:8429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b31633a2/0x6b58994c2cbdc95b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071495.068996:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c681500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf7532e4-6153-424a-9f4e-84941256b41f+6:2406:x1869685692891008:12345-192.168.204.38@tcp:1:lhsmtool_posix.0 Request processed in 11897us (13666us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071495.069005:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 53 00000100:00100000:0.0:1783071495.071344:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071495.071481:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692891392 00000100:00100000:2.0:1783071495.071492:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692891392 00000100:00100000:2.0:1783071495.071553:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 139 00000100:00100000:2.0:1783071495.071564:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c688a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+16:11409:x1869685692891392:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1783071495.071668:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67e00/0x6b58994c2cbdc962 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071495.071686:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66e00/0x6b58994c2cbdc851 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98eec expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071495.071696:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67e00/0x6b58994c2cbdc962 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071495.071737:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66e00/0x6b58994c2cbdc851 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98eec expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071495.071751:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66e00/0x6b58994c2cbdc851 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98eec expref: 16 pid: 6516 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071495.071767:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6518:1869685707638784:192.168.204.38@tcp:104: 00000100:00100000:2.0:1783071495.071856:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a038cae40 going to sleep for 11 seconds 00000100:00100000:0.0:1783071495.075114:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6518:1869685707638784:192.168.204.38@tcp:104: 00010000:00010000:0.0:1783071495.075144:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67e00/0x6b58994c2cbdc962 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071495.078179:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071495.078330:0:7923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692891520 00000100:00100000:1.0:1783071495.078340:0:7923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692891520 00010000:00010000:1.0:1783071495.078419:0:7923:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66e00/0x6b58994c2cbdc851 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98eec expref: 17 pid: 6516 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071495.078464:0:7923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 77 00000100:00100000:1.0:1783071495.078476:0:7923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c68aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf7532e4-6153-424a-9f4e-84941256b41f+17:2406:x1869685692891520:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783071495.078492:0:7923:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071495.078499:0:7923:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66e00/0x6b58994c2cbdc851 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98eec expref: 17 pid: 6516 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071495.078513:0:7923:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66e00/0x6b58994c2cbdc851 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98eec expref: 17 pid: 6516 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071495.078537:0:7923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66e00/0x6b58994c2cbdc851 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98eec expref: 17 pid: 6516 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071495.078553:0:7923:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f8a020ca200) 00010000:00010000:1.0:1783071495.078560:0:7923:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc8b3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f0f expref: 16 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071495.078570:0:7923:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67e00/0x6b58994c2cbdc962 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071495.078577:0:7923:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67e00/0x6b58994c2cbdc962 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071495.078584:0:7923:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67e00/0x6b58994c2cbdc962 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071495.078625:0:7923:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071495.078687:0:7923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c68aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf7532e4-6153-424a-9f4e-84941256b41f+16:2406:x1869685692891520:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 213us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071495.078696:0:7923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 77 00010000:00010000:0.0:1783071495.079802:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67e00/0x6b58994c2cbdc962 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071495.079815:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67e00/0x6b58994c2cbdc962 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071495.080029:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdc969 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071495.080044:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdc91c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f2b expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071495.080053:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdc969 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071495.080101:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdc91c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f2b expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071495.080136:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdc91c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f2b expref: 16 pid: 6516 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071495.080152:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c68b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6518:1869685707638912:192.168.204.38@tcp:104: 00000100:00100000:0.0:1783071495.080796:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a032c0540 going to sleep for 11 seconds 00000100:00100000:3.0:1783071495.091535:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071495.091964:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692891648 00000100:00100000:1.0:1783071495.091975:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692891648 00010000:00010000:1.0:1783071495.092020:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdc91c lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f2b expref: 17 pid: 6516 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071495.092055:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 78 00000100:00100000:1.0:1783071495.092065:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03330000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf7532e4-6153-424a-9f4e-84941256b41f+17:2405:x1869685692891648:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783071495.092082:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071495.092089:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdc91c lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f2b expref: 17 pid: 6516 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071495.092102:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdc91c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f2b expref: 17 pid: 6516 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071495.092127:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f8b1011a100) 00010000:00010000:1.0:1783071495.092133:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdc969 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071495.092145:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdc969 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071495.092152:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdc969 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071495.092189:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071495.092254:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03330000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf7532e4-6153-424a-9f4e-84941256b41f+17:2405:x1869685692891648:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 189us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071495.092261:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 78 00010000:00010000:2.0:1783071495.101248:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdc91c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f2b expref: 16 pid: 6516 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071495.101279:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c68b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6518:1869685707638912:192.168.204.38@tcp:104: 00010000:00010000:2.0:1783071495.101306:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdc969 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071495.101317:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdc969 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071495.101323:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdc969 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783071495.101512:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:2.0:1783071495.101644:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:2.0:1783071495.101687:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:2.0:1783071495.101778:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6518:1869685707639040:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1783071495.101858:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071495.101902:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a038ca3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783071495.102141:0:9413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707639040 00000100:00100000:0.0:1783071495.102149:0:9413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707639040 00000100:00100000:0.0:1783071495.102204:0:9413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1783071495.102214:0:9413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6518:x1869685707639040:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1783071495.102315:0:9413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6518:x1869685707639040:12345-0@lo:1000:mdt00_002.0 Request processed in 102us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071495.102323:0:9413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1783071495.102432:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6518:1869685707639040:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1783071495.102558:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:3.0:1783071495.102610:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03332300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6518:1869685707639168:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783071495.102644:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071495.102674:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b07686600 going to sleep for 11 seconds 00000100:00100000:0.0:1783071495.104182:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707639168 00000100:00100000:0.0:1783071495.104193:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707639168 00000100:00100000:0.0:1783071495.104259:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1783071495.104269:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03330e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6518:x1869685707639168:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1783071495.104499:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03330e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6518:x1869685707639168:12345-0@lo:1000:mdt00_002.0 Request processed in 231us (1853us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1783071495.104507:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1783071495.105967:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03332300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6518:1869685707639168:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1783071495.106025:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdc969 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071495.106037:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdc969 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071495.106045:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdc969 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071495.106052:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03865e00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071495.106056:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdc969 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071495.106086:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdc969 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071495.106103:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f8b1011a100) 00010000:00010000:3.0:1783071495.106106:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783071495.106111:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdc969 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071495.106117:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdc969 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071495.106141:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdc8ac lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071495.106147:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdc8ac lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071495.106153:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdc8ac lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071495.106158:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03864e00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071495.106161:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdc8ac lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071495.106166:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdc8ac lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071495.106174:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f8a020ca200) 00010000:00010000:3.0:1783071495.106177:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783071495.106184:0:6518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc8b3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f0f expref: 19 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071495.106205:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc8b3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f0f expref: 19 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071495.106214:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc8b3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f0f expref: 19 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071495.106252:0:6518:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc8b3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f0f expref: 19 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071495.106267:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6518:1869685707639296:192.168.204.38@tcp:105: 00000100:00100000:3.0:1783071495.106358:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b07686600 going to sleep for 11 seconds 00000100:00100000:3.0:1783071495.114888:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071495.114968:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692891776 00000100:00100000:0.0:1783071495.114978:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692891776 00000100:00100000:0.0:1783071495.115036:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 31 00000100:00100000:0.0:1783071495.115047:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b2fcb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+20:11407:x1869685692891776:12345-192.168.204.38@tcp:49:lfs.0 00000100:00100000:0.0:1783071495.115200:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b2fcb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+20:11407:x1869685692891776:12345-192.168.204.38@tcp:49:lfs.0 Request processed in 153us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071495.115225:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 31 00000100:00100000:2.0:1783071495.118560:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6518:1869685707639296:192.168.204.38@tcp:105: 00010000:00010000:2.0:1783071495.118597:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdc8ac lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071495.118610:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdc8ac lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071495.118651:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdc970 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071495.118666:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdc970 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071495.118678:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdc970 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071495.118690:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdc970 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071495.118697:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdc970 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071495.118711:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdc970 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071495.118736:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd67400 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:2.0:1783071495.118740:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdc970 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071495.118748:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdc970 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071495.118760:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f8a020ca200) 00010000:00010000:2.0:1783071495.118763:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071495.118767:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdc970 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071495.118772:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdc970 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071495.118783:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67e00/0x6b58994c2cbdc962 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071495.118789:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67e00/0x6b58994c2cbdc962 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071495.118795:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67e00/0x6b58994c2cbdc962 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071495.118799:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd67e00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:2.0:1783071495.118802:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67e00/0x6b58994c2cbdc962 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071495.118808:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67e00/0x6b58994c2cbdc962 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071495.118827:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f8a020ca200) 00010000:00010000:2.0:1783071495.118829:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783071495.118832:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67e00/0x6b58994c2cbdc962 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071495.118838:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67e00/0x6b58994c2cbdc962 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071495.119194:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c688a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+19:11409:x1869685692891392:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 Request processed in 47629us (47860us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1783071495.119206:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 139 00000020:00080000:2.0:1783071495.119211:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1783071495.123217:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071495.123326:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071495.123661:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692892288 00000100:00100000:0.0:1783071495.123671:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692892288 00000100:00100000:0.0:1783071495.123726:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 32 00000100:00100000:0.0:1783071495.123737:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0699c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+19:11409:x1869685692892288:12345-192.168.204.38@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1783071495.124040:0:6519:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1783071495.124080:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:0.0:1783071495.124114:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdc977 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071495.124131:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdc977 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071495.124142:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdc977 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071495.124152:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdc977 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071495.124159:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdc977 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071495.124166:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdc977 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071495.124186:0:6519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783071495.124303:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0699c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+21:11409:x1869685692892288:12345-192.168.204.38@tcp:35:lhsmtool_posix.0 Request processed in 567us (975us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1783071495.124310:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 32 00000020:00080000:0.0:1783071495.124326:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1783071495.124594:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692892032 00000100:00100000:1.0:1783071495.124601:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692892032 00000100:00100000:1.0:1783071495.124641:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 140 00000100:00100000:1.0:1783071495.124648:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01767b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+21:11407:x1869685692892032:12345-192.168.204.38@tcp:58:lfs.0 00000040:00080000:1.0:1783071495.124782:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1783071495.124835:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01767b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+21:11407:x1869685692892032:12345-192.168.204.38@tcp:58:lfs.0 Request processed in 187us (1627us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071495.124842:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 140 00010000:00010000:0.0:1783071495.125049:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783071495.125057:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdc977 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071495.125065:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03864600 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:0.0:1783071495.125070:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdc977 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071495.125078:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdc977 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071495.125094:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f8b1011a100) 00010000:00010000:0.0:1783071495.125097:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783071495.125102:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdc977 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071495.125108:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdc977 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071495.125122:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071495.125125:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071495.125126:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783071495.127229:0:13796:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783071495.127238:0:13796:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783071495.127381:0:13796:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1783071495.127390:0:13796:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783071495.127614:0:13796:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b2fcb3100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13796:1869685707639424:192.168.204.38@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783071495.129914:0:13796:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b07686cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071495.155467:0:13796:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b2fcb3100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13796:1869685707639424:192.168.204.38@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783071495.161500:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071495.161813:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692892416 00000100:00100000:2.0:1783071495.161823:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692892416 00000100:00100000:2.0:1783071495.161944:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 141 00000100:00100000:2.0:1783071495.161956:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c68a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+21:11412:x1869685692892416:12345-192.168.204.38@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783071495.162010:0:10292:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783071495.162150:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c68a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+21:11412:x1869685692892416:12345-192.168.204.38@tcp:53:lhsmtool_posix.0 Request processed in 195us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071495.162158:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 141 00000100:00100000:2.0:1783071495.172020:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071495.172131:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692892672 00000100:00100000:3.0:1783071495.172142:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692892672 00000100:00100000:3.0:1783071495.172209:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 142 00000100:00100000:3.0:1783071495.172220:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+21:11412:x1869685692892672:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783071495.172244:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071495.172279:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdc97e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98f47 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071495.172617:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67e00/0x6b58994c2cbdc985 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071495.172633:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67e00/0x6b58994c2cbdc985 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071495.172652:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67e00/0x6b58994c2cbdc985 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071495.172664:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1783071495.172792:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdc97e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f47 expref: 24 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071495.172810:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67e00/0x6b58994c2cbdc985 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f47 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071495.172820:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f8a020ca200) 00010000:00010000:2.0:1783071495.172823:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1783071495.172826:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b2fd67e00, rc 0) 00000100:00100000:2.0:1783071495.172937:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+23:11412:x1869685692892672:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 719us (928us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1783071495.172944:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 142 00000100:00100000:3.0:1783071495.173634:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071495.173716:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692892800 00000100:00100000:0.0:1783071495.173723:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692892800 00000100:00100000:0.0:1783071495.173772:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 143 00000100:00100000:0.0:1783071495.173782:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b2fcb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+23:11411:x1869685692892800:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1783071495.173800:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071495.173816:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864000/0x6b58994c2cbdc993 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98f4e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071495.173896:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865200/0x6b58994c2cbdc99a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071495.173909:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865200/0x6b58994c2cbdc99a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071495.173919:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865200/0x6b58994c2cbdc99a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071495.173935:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdc9a1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071495.173942:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdc9a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071495.173949:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdc9a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071495.174031:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864400/0x6b58994c2cbdc9a8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071495.174041:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdc89e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f08 expref: 24 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071495.174049:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864400/0x6b58994c2cbdc9a8 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071495.174152:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdc89e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f08 expref: 24 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071495.174179:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdc89e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f08 expref: 24 pid: 6518 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071495.174195:0:6517:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c68bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1869685707639552:192.168.204.38@tcp:104: 00000100:00100000:1.0:1783071495.175119:0:6517:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a032c0e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783071495.178445:0:6517:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c68bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1869685707639552:192.168.204.38@tcp:104: 00010000:00010000:3.0:1783071495.178483:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864400/0x6b58994c2cbdc9a8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071495.179182:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071495.179417:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692893056 00000100:00100000:0.0:1783071495.179425:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692893056 00000100:00100000:0.0:1783071495.179481:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 33 00000100:00100000:0.0:1783071495.179492:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b2fcb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+25:6169:x1869685692893056:12345-192.168.204.38@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1783071495.179940:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b2fcb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+26:6169:x1869685692893056:12345-192.168.204.38@tcp:35:ldlm_bl.0 Request processed in 448us (758us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1783071495.179949:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 33 00000100:00100000:0.0:1783071495.187622:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071495.187858:0:7923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692893184 00000100:00100000:1.0:1783071495.187882:0:7923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692893184 00010000:00010000:1.0:1783071495.187941:0:7923:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdc89e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f08 expref: 26 pid: 6518 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071495.187998:0:7923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 79 00000100:00100000:1.0:1783071495.188009:0:7923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c68bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf7532e4-6153-424a-9f4e-84941256b41f+26:2405:x1869685692893184:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783071495.188027:0:7923:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071495.188035:0:7923:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdc89e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f08 expref: 26 pid: 6518 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071495.188050:0:7923:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdc89e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f08 expref: 26 pid: 6518 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071495.188095:0:7923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdc89e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f08 expref: 26 pid: 6518 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071495.188113:0:7923:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f8a020ca200) 00010000:00010000:1.0:1783071495.188118:0:7923:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864400/0x6b58994c2cbdc9a8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071495.188130:0:7923:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864400/0x6b58994c2cbdc9a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071495.188138:0:7923:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864400/0x6b58994c2cbdc9a8 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071495.188337:0:7923:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071495.188443:0:7923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c68bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf7532e4-6153-424a-9f4e-84941256b41f+25:2405:x1869685692893184:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 435us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071495.188452:0:7923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 79 00010000:00010000:3.0:1783071495.188541:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864400/0x6b58994c2cbdc9a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071495.188550:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864400/0x6b58994c2cbdc9a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783071495.188605:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1783071495.188609:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783071495.188629:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864400/0x6b58994c2cbdc9a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071495.188642:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864400/0x6b58994c2cbdc9a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071495.188652:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865200/0x6b58994c2cbdc99a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071495.188659:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865200/0x6b58994c2cbdc99a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071495.188666:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865200/0x6b58994c2cbdc99a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071495.188683:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03865200 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071495.188687:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865200/0x6b58994c2cbdc99a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071495.188694:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865200/0x6b58994c2cbdc99a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071495.188704:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f8a0179f400) 00010000:00010000:3.0:1783071495.188707:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071495.188710:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865200/0x6b58994c2cbdc99a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071495.188716:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865200/0x6b58994c2cbdc99a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071495.188727:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdc9a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071495.188733:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdc9a1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071495.188738:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdc9a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071495.188743:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03865600 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071495.188745:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdc9a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071495.188752:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdc9a1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071495.188770:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f8b10db4600) 00010000:00010000:3.0:1783071495.188773:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071495.188776:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdc9a1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071495.188781:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdc9a1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071495.188826:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864000/0x6b58994c2cbdc993 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f4e expref: 25 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071495.188840:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864400/0x6b58994c2cbdc9a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f4e expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071495.188847:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f8a020ca200) 00010000:00010000:3.0:1783071495.188849:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783071495.188851:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a03864400, rc 0) 00000100:00100000:3.0:1783071495.188888:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b2fcb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+24:11411:x1869685692892800:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 15108us (15258us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071495.188895:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 143 00000100:00100000:0.0:1783071495.189477:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071495.192287:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692893440 00000100:00100000:2.0:1783071495.192304:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692893440 00000100:00100000:2.0:1783071495.192418:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 144 00000100:00100000:2.0:1783071495.192430:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c68b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+24:11412:x1869685692893440:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1783071495.192526:0:10292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdc9af lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071495.192549:0:10292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdc9af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071495.192561:0:10292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdc9af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071495.192785:0:10292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdc9af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071495.192793:0:10292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdc9af lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071495.192799:0:10292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdc9af lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071495.192805:0:10292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd66c00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:2.0:1783071495.192809:0:10292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdc9af lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071495.192817:0:10292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdc9af lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071495.192830:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f8a020ca200) 00010000:00010000:2.0:1783071495.192833:0:10292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783071495.192837:0:10292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdc9af lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071495.192843:0:10292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdc9af lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071495.192993:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c68b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+25:11412:x1869685692893440:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 Request processed in 565us (3517us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1783071495.193002:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 144 00000040:00080000:3.0:1783071495.193230:0:13796:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783071495.193235:0:13796:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783071495.193720:0:13796:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1783071495.193728:0:13796:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783071495.197338:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071495.197681:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692893696 00000100:00100000:1.0:1783071495.197690:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692893696 00000100:00100000:1.0:1783071495.197751:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 34 00000100:00100000:1.0:1783071495.197760:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0397d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+25:11412:x1869685692893696:12345-192.168.204.38@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1783071495.198019:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0397d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+26:11412:x1869685692893696:12345-192.168.204.38@tcp:35:lhsmtool_posix.0 Request processed in 259us (691us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1783071495.198027:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 34 00010000:00010000:0.0:1783071495.427400:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071495.496451:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37abd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707639680:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783071495.496614:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071495.496906:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707639680 00000100:00100000:0.0:1783071495.496914:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707639680 00000100:00100000:0.0:1783071495.497299:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1783071495.497310:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0397e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3646:x1869685707639680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783071495.497340:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 57344 free 3923525632 avail 3692003328 00000100:00100000:0.0:1783071495.497414:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0397e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3646:x1869685707639680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071495.497439:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1783071495.497466:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707639936:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783071495.497496:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071495.497521:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783071495.497975:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02c09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707639808:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783071495.498006:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071495.498070:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37abd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707639680:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783071495.498096:0:12254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707639936 00000100:00100000:0.0:1783071495.498101:0:12254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707639936 00000100:00100000:0.0:1783071495.498121:0:12254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707639808 00000100:00100000:0.0:1783071495.498123:0:12254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707639808 00000100:00100000:0.0:1783071495.498135:0:12254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1783071495.498140:0:12254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707639936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783071495.498154:0:12254:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:0.0:1783071495.498194:0:12254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707639936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071495.498200:0:12254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1783071495.498213:0:12254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1783071495.498219:0:12254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1869685707639808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783071495.498229:0:12254:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:0.0:1783071495.498250:0:12254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1869685707639808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 33us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071495.498256:0:12254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1783071495.498286:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02c09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707639808:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783071495.498298:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707639936:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783071495.499510:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783071495.499526:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37abe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707640064:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783071495.499576:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071495.499639:0:12254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707640064 00000100:00100000:1.0:1783071495.499646:0:12254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707640064 00000100:00100000:1.0:1783071495.499682:0:12254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1783071495.499689:0:12254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37abf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707640064:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783071495.499709:0:12254:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 57344 free 3923525632 avail 3692003328 00000100:00100000:1.0:1783071495.499745:0:12254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37abf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707640064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071495.499751:0:12254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1783071495.499790:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37abe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707640064:0@lo:13:osp-pre-1-1.0 00000001:00080000:0.0:1783071495.690116:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:0.0:1783071495.690137:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000040:00080000:2.0:1783071496.035102:0:14257:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783071496.035112:0:14257:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783071496.035144:0:14257:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1783071496.035160:0:14257:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783071496.225503:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071496.225540:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692893952 00000100:00100000:2.0:1783071496.225549:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692893952 00000100:00100000:2.0:1783071496.225602:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 145 00000100:00100000:2.0:1783071496.225612:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c78df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+26:11435:x1869685692893952:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1783071496.225635:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071496.225655:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdc9b6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98f55 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071496.225768:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66800/0x6b58994c2cbdc9bd lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071496.225786:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66800/0x6b58994c2cbdc9bd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071496.225800:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66800/0x6b58994c2cbdc9bd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071496.225811:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1783071496.225926:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdc9b6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f55 expref: 29 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071496.225942:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66800/0x6b58994c2cbdc9bd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f55 expref: 28 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071496.225951:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f8a020ca200) 00010000:00010000:2.0:1783071496.225954:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1783071496.225958:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b2fd66800, rc 0) 00000100:00100000:2.0:1783071496.226135:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c78df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+28:11435:x1869685692893952:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 524us (640us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1783071496.226150:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 145 00000100:00100000:0.0:1783071496.236130:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071496.236203:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692894080 00000100:00100000:3.0:1783071496.236212:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692894080 00000100:00100000:3.0:1783071496.236287:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 146 00000100:00100000:3.0:1783071496.236298:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+28:11435:x1869685692894080:12345-192.168.204.38@tcp:54:lfs.0 00010000:00010000:3.0:1783071496.236420:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdc9cb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071496.236439:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdc9cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071496.236450:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdc9cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071496.238611:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdc9cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071496.238628:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdc9cb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071496.238635:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdc9cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071496.238641:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b014b9000 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071496.238645:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdc9cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071496.238654:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdc9cb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071496.238670:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f8a020ca200) 00010000:00010000:3.0:1783071496.238672:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783071496.238676:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdc9cb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071496.238683:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdc9cb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071496.238813:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+28:11435:x1869685692894080:12345-192.168.204.38@tcp:54:lfs.0 Request processed in 2513us (2689us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071496.238824:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 146 00000100:00100000:0.0:1783071496.346622:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071496.346880:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692894208 00000100:00100000:1.0:1783071496.346891:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692894208 00000100:00100000:1.0:1783071496.346968:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 54 00000100:00100000:1.0:1783071496.346981:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf7532e4-6153-424a-9f4e-84941256b41f+6:2403:x1869685692894208:12345-192.168.204.38@tcp:101:cat.0 00010000:00010000:1.0:1783071496.346999:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071496.347022:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d161545a/0x6b58994c2cbdc9d2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98f5c expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783071496.347051:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a478306, atime: 0x6a478306, ctime: 0x6a478306, blocks: 0x8 00010000:00010000:1.0:1783071496.347077:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=398s v=(0 0) 00010000:00010000:1.0:1783071496.347082:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783071496.347093:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d161545a/0x6b58994c2cbdc9d2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f5c expref: 7 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071496.347113:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d161545a/0x6b58994c2cbdc9d2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f5c expref: 7 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071496.347148:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b421d9a00, rc 0) 00000100:00100000:1.0:1783071496.347215:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf7532e4-6153-424a-9f4e-84941256b41f+7:2403:x1869685692894208:12345-192.168.204.38@tcp:101:cat.0 Request processed in 237us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071496.347279:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 54 00000100:00080000:0.0:1783071496.349013:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783071496.354556:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071496.354799:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692894336 00000100:00100000:0.0:1783071496.354810:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692894336 00002000:00100000:0.0:1783071496.354879:0:8437:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff8f8b37abe680 x1869685692894336/t0(0) o3->bf7532e4-6153-424a-9f4e-84941256b41f@192.168.204.38@tcp:87/0 lens 488/0 e 0 to 0 dl 1783071507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783071496.354891:0:8437:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8f8b37abe680 with x1869685692894336 ext(0->4095) 00002000:00010000:0.0:1783071496.354897:0:8437:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f8b37abe680 00000100:00100000:0.0:1783071496.355008:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3 00000100:00100000:0.0:1783071496.355020:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37abe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bf7532e4-6153-424a-9f4e-84941256b41f+7:2406:x1869685692894336:12345-192.168.204.38@tcp:3:cat.0 00000100:00100000:0.0:1783071496.355237:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37abe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bf7532e4-6153-424a-9f4e-84941256b41f+7:2406:x1869685692894336:12345-192.168.204.38@tcp:3:cat.0 Request processed in 218us (691us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1783071496.355243:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3 00002000:00100000:0.0:1783071496.355250:0:8437:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff8f8b37abe680 x1869685692894336/t0(0) o3->bf7532e4-6153-424a-9f4e-84941256b41f@192.168.204.38@tcp:87/0 lens 488/4536 e 0 to 0 dl 1783071507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783071496.355258:0:8437:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8f8b37abe680 with x1869685692894336 ext(0->4095) 00002000:00010000:0.0:1783071496.355261:0:8437:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f8b37abe680 00010000:00010000:0.0:1783071496.450630:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071496.515832:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b2fcb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707640192:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783071496.515922:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071496.516108:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707640192 00000100:00100000:0.0:1783071496.516118:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707640192 00000100:00100000:0.0:1783071496.516170:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1783071496.516179:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37abd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707640192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783071496.516218:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783071496.516335:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37abd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707640192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 156us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071496.516343:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1783071496.516454:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b2fcb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707640192:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1783071497.478185:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071498.505834:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071498.522145:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071498.522206:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071498.522251:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071498.522310:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071498.522339:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071498.522359:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071498.522581:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692894464 00000100:00100000:0.0:1783071498.522592:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692894464 00000100:00100000:0.0:1783071498.522648:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 379 00000100:00100000:0.0:1783071498.522659:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18687450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:2405:x1869685692894464:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1783071498.522743:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18687450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:2405:x1869685692894464:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 85us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071498.522751:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 379 00000100:00100000:0.0:1783071498.522820:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692894720 00000100:00100000:0.0:1783071498.522823:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692894720 00000100:00100000:0.0:1783071498.522859:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692895232 00000100:00100000:0.0:1783071498.522862:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692895232 00000100:00100000:0.0:1783071498.522878:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692894592 00000100:00100000:0.0:1783071498.522881:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692894592 00000100:00100000:0.0:1783071498.522898:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 277 00000100:00100000:0.0:1783071498.522904:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b2fcb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+5:2405:x1869685692894720:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1783071498.522935:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b2fcb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+5:2405:x1869685692894720:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 32us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071498.522941:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 277 00000100:00100000:0.0:1783071498.522953:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 278 00000100:00100000:0.0:1783071498.522959:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a039d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2405:x1869685692895232:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1783071498.522982:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a039d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2405:x1869685692895232:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 23us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071498.523000:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 278 00000100:00100000:0.0:1783071498.523012:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 279 00000100:00100000:0.0:1783071498.523018:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a039d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+28:2405:x1869685692894592:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1783071498.523044:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a039d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+28:2405:x1869685692894592:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 26us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071498.523049:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 279 00000100:00080000:0.0:1783071498.523069:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783071498.523074:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783071498.523201:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071498.523291:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692895104 00000100:00100000:3.0:1783071498.523295:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692895104 00000100:00100000:3.0:1783071498.523327:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 280 00000100:00100000:3.0:1783071498.523333:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a039d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2405:x1869685692895104:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1783071498.523402:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a039d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2405:x1869685692895104:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 55us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071498.523408:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 280 00000100:00080000:1.0:1783071498.523772:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783071498.534017:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692894976 00000100:00100000:0.0:1783071498.534035:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692894976 00000100:00100000:0.0:1783071498.534149:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692894848 00000100:00100000:0.0:1783071498.534153:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692894848 00000100:00100000:0.0:1783071498.534208:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 129 00000100:00080000:1.0:1783071498.534332:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783071498.534337:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783071498.534388:0:8910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 130 00000100:00100000:1.0:1783071498.534399:0:8910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a039d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf7532e4-6153-424a-9f4e-84941256b41f+7:2405:x1869685692894848:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1783071498.534483:0:8910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a039d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf7532e4-6153-424a-9f4e-84941256b41f+7:2405:x1869685692894848:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 87us (12122us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071498.534491:0:8910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 130 00000100:00100000:0.0:1783071498.536014:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b2fcb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf7532e4-6153-424a-9f4e-84941256b41f+5:2405:x1869685692894976:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1783071498.536103:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b2fcb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf7532e4-6153-424a-9f4e-84941256b41f+5:2405:x1869685692894976:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 1884us (13850us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071498.536114:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 129 00010000:00010000:2.0:1783071499.523155:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071500.098660:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707640320:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783071500.098741:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071500.098932:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c68e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869685707640576:0@lo:400:kworker.0 00000100:00100000:3.0:1783071500.098936:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3b77b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707640832:0@lo:400:kworker.0 00000100:00100000:1.0:1783071500.099004:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c68f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:feaa1501-b927-4e07-baad-3200e92d7497:3648:1869685707640448:0@lo:400:kworker.0 00000100:00100000:0.0:1783071500.099052:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707640320 00000100:00100000:0.0:1783071500.099062:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707640320 00000100:00100000:0.0:1783071500.099104:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1783071500.099112:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a039d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707640320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783071500.099145:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1783071500.099199:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071500.099221:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03aef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707641344:0@lo:400:kworker.0 00000100:00100000:3.0:1783071500.099245:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071500.099271:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03aee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707641856:0@lo:400:kworker.0 00000100:00100000:3.0:1783071500.099293:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071500.099321:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707641344 00000100:00100000:3.0:1783071500.099325:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707641344 00000100:00100000:3.0:1783071500.099359:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707641856 00000100:00100000:3.0:1783071500.099388:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707641856 00000100:00100000:3.0:1783071500.099412:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1783071500.099420:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a039d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3647:x1869685707641344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071500.099458:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a039d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3647:x1869685707641344:12345-0@lo:400:kworker.0 Request processed in 40us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071500.099465:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1783071500.099477:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071500.099481:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1783071500.099487:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a039d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707641856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071500.099504:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03aef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1869685707641088:0@lo:400:kworker.0 00000100:00100000:3.0:1783071500.099512:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a039d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707641856:12345-0@lo:400:kworker.0 Request processed in 26us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071500.099518:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1783071500.099537:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071500.099553:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03aef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707641344:0@lo:400:kworker.0 00000100:00100000:2.0:1783071500.099553:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03aeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1869685707641600:0@lo:400:kworker.0 00000100:00100000:3.0:1783071500.099563:0:3647:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:3.0:1783071500.099568:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967305 00000100:00100000:2.0:1783071500.099583:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1783071500.099590:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f8b07796680, transno 4294967302 00000004:00080000:3.0:1783071500.099599:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000100:00100000:2.0:1783071500.099605:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1783071500.099611:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3b779c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869685707640704:0@lo:400:kworker.0 00000004:00080000:3.0:1783071500.099616:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f8a0397ea00, transno 4294967305 00000100:00100000:3.0:1783071500.099620:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03aee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707641856:0@lo:400:kworker.0 00000100:00100000:2.0:1783071500.099631:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071500.099647:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03aee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707641216:0@lo:400:kworker.0 00000100:00100000:2.0:1783071500.099667:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071500.099680:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03aed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707641728:0@lo:400:kworker.0 00000100:00100000:2.0:1783071500.099698:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071500.099720:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707641216 00000100:00100000:2.0:1783071500.099723:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707641216 00000100:00100000:2.0:1783071500.099742:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707641728 00000100:00100000:2.0:1783071500.099744:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707641728 00000100:00100000:2.0:1783071500.099755:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1783071500.099761:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03aed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707641216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071500.099806:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03aed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707641216:12345-0@lo:400:kworker.0 Request processed in 44us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071500.099812:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1783071500.099823:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1783071500.099834:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03aedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707641728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071500.099861:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03aedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707641728:12345-0@lo:400:kworker.0 Request processed in 27us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071500.099866:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1783071500.099884:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707640576 00000100:00100000:2.0:1783071500.099887:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707640576 00000100:00100000:2.0:1783071500.099910:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707641088 00000100:00100000:2.0:1783071500.099913:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707641088 00000100:00100000:2.0:1783071500.099926:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707641600 00000100:00100000:2.0:1783071500.099929:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707641600 00000100:00100000:2.0:1783071500.099941:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707640704 00000100:00100000:2.0:1783071500.099943:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707640704 00000100:00100000:2.0:1783071500.099969:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1783071500.099975:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03aefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1869685707640576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071500.099999:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071500.100000:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03aefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1869685707640576:12345-0@lo:400:kworker.0 Request processed in 26us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071500.100006:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1783071500.100017:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1783071500.100022:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03aed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1869685707641088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071500.100022:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03aece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1869685707640960:0@lo:400:kworker.0 00000100:00100000:1.0:1783071500.100043:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071500.100045:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03aed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1869685707641088:12345-0@lo:400:kworker.0 Request processed in 24us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071500.100050:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1783071500.100053:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03aec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1869685707641472:0@lo:400:kworker.0 00000100:00100000:2.0:1783071500.100058:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707640960 00000100:00100000:2.0:1783071500.100061:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707640960 00000100:00100000:1.0:1783071500.100070:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071500.100074:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707641472 00000100:00100000:2.0:1783071500.100077:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707641472 00000100:00100000:2.0:1783071500.100089:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1783071500.100094:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03aeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1869685707641600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071500.100096:0:9413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707640832 00000100:00100000:1.0:1783071500.100100:0:9413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707640832 00000100:00100000:1.0:1783071500.100123:0:9413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1783071500.100129:0:9413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a039d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707640832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071500.100130:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03aeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1869685707641600:12345-0@lo:400:kworker.0 Request processed in 37us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071500.100136:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1783071500.100147:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1783071500.100161:0:9413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a039d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707640832:12345-0@lo:400:kworker.0 Request processed in 33us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071500.100167:0:9413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1783071500.100171:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03aec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1869685707640704:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1783071500.100188:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783071500.100192:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783071500.100195:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783071500.100196:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03aec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1869685707640704:12345-0@lo:400:kworker.0 Request processed in 45us (564us total) trans 0 rc 0/0 00000100:00080000:1.0:1783071500.100197:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783071500.100206:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1783071500.100212:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37abea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869685707640960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071500.100244:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37abea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869685707640960:12345-0@lo:400:kworker.0 Request processed in 32us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071500.100250:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1783071500.100262:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1783071500.100268:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37abce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869685707641472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071500.100294:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37abce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869685707641472:12345-0@lo:400:kworker.0 Request processed in 27us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071500.100299:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1783071500.100326:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3b77b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707640832:0@lo:400:kworker.0 00000100:00100000:1.0:1783071500.100349:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03aece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1869685707640960:0@lo:400:kworker.0 00000100:00100000:1.0:1783071500.100357:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03aec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1869685707641472:0@lo:400:kworker.0 00000100:00100000:1.0:1783071500.100577:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707640448 00000100:00100000:1.0:1783071500.100581:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707640448 00000100:00100000:1.0:1783071500.100607:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:1.0:1783071500.100614:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18687850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+24:3648:x1869685707640448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071500.100656:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18687850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+24:3648:x1869685707640448:12345-0@lo:400:kworker.0 Request processed in 42us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071500.100663:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:1.0:1783071500.100695:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c68f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:feaa1501-b927-4e07-baad-3200e92d7497:3648:1869685707640448:0@lo:400:kworker.0 00000100:00100000:1.0:1783071500.100743:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3b779c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869685707640704:0@lo:400:kworker.0 00000100:00100000:1.0:1783071500.100752:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03aee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707641216:0@lo:400:kworker.0 00000100:00100000:1.0:1783071500.100760:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03aed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707641728:0@lo:400:kworker.0 00000100:00100000:1.0:1783071500.100784:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c68e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869685707640576:0@lo:400:kworker.0 00010000:00080000:1.0:1783071500.100796:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a03aef100 x1869685707641088/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071500.100805:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03aef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1869685707641088:0@lo:400:kworker.0 00010000:00080000:1.0:1783071500.100813:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a03aeca80 x1869685707641600/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071500.100820:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03aeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1869685707641600:0@lo:400:kworker.0 00000100:00100000:2.0:1783071500.100876:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1783071500.101397:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a039d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707640320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2283us (2659us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071500.101405:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1783071500.101495:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707640320:0@lo:41:osp-pre-0-1.0 00000001:00080000:1.0:1783071500.106072:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:1.0:1783071500.106108:0:6495:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f8b3c766c00 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1783071500.106114:0:6495:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8f8a0332c000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f8b05e0be40 00000020:00080000:1.0:1783071500.106118:0:6495:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8f8a0332c700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f8a032c3a00 00000020:00080000:1.0:1783071500.106145:0:6495:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00010000:00010000:2.0:1783071500.106207:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdc94d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071500.106219:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdc94d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071500.106227:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdc94d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071500.106233:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b014b8600 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:2.0:1783071500.106237:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdc94d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071500.106245:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdc94d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071500.106266:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f8b1011a100) 00010000:00010000:2.0:1783071500.106269:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071500.106275:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdc94d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071500.106281:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdc94d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783071500.106386:0:6549:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1783071500.106477:0:6549:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:0.0:1783071500.546659:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071500.610601:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707641984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783071500.610679:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071500.610754:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707642112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783071500.610805:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071500.611130:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707641984 00000100:00100000:0.0:1783071500.611140:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707641984 00000100:00100000:0.0:1783071500.611188:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707642112 00000100:00100000:0.0:1783071500.611191:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707642112 00000100:00100000:0.0:1783071500.611205:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1783071500.611213:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02c09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1869685707641984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783071500.611247:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1783071500.611289:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02c09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1869685707641984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071500.611297:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1783071500.611312:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1783071500.611318:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707642112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783071500.611332:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783071500.611356:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707642112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 39us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071500.611729:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1783071500.611836:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03aeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707642240:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783071500.611871:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071500.611936:0:12254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707642240 00000100:00100000:0.0:1783071500.611941:0:12254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707642240 00000100:00100000:0.0:1783071500.611961:0:12254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1783071500.611968:0:12254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03aedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707642240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783071500.612085:0:12254:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1783071500.612169:0:12254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03aedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707642240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 201us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071500.612176:0:12254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1783071500.612219:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707642112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783071500.612248:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707641984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783071500.612328:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03aeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707642240:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783071500.623437:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783071500.623466:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03aeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707642368:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783071500.623551:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071500.623623:0:12254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707642368 00000100:00100000:2.0:1783071500.623631:0:12254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707642368 00000100:00100000:2.0:1783071500.623685:0:12254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1783071500.623694:0:12254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03aec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707642368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783071500.623722:0:12254:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783071500.623792:0:12254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03aec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707642368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071500.623798:0:12254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1783071500.625418:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03aeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707642368:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783071501.122705:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071501.123700:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692895360 00000100:00100000:2.0:1783071501.123713:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692895360 00000100:00080000:1.0:1783071501.123847:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783071501.123901:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 147 00000100:00100000:2.0:1783071501.123913:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+14:11096:x1869685692895360:12345-192.168.204.38@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1783071501.124026:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+14:11096:x1869685692895360:12345-192.168.204.38@tcp:60:lhsmtool_posix.0 Request processed in 115us (1331us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071501.124034:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 147 00000001:00080000:0.0:1783071501.139468:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:0.0:1783071501.139488:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000100:00100000:2.0:1783071501.150730:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071501.151031:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692895488 00000100:00100000:0.0:1783071501.151042:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692895488 00000100:00100000:0.0:1783071501.151143:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 148 00000100:00100000:0.0:1783071501.151154:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03aef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+5:11096:x1869685692895488:12345-192.168.204.38@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1783071501.151264:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03aef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+5:11096:x1869685692895488:12345-192.168.204.38@tcp:60:lhsmtool_posix.0 Request processed in 113us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071501.151273:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 148 00000100:00080000:2.0:1783071501.151669:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783071501.156543:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071501.156627:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692895744 00000100:00100000:3.0:1783071501.156655:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692895744 00000100:00100000:3.0:1783071501.156727:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 35 00000100:00100000:3.0:1783071501.156772:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a039d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+14:11096:x1869685692895744:12345-192.168.204.38@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1783071501.157757:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a039d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+15:11096:x1869685692895744:12345-192.168.204.38@tcp:35:lhsmtool_posix.0 Request processed in 976us (1219us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1783071501.157768:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 35 00000040:00080000:3.0:1783071501.314646:0:13796:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783071501.314659:0:13796:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783071501.314688:0:13796:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1783071501.314700:0:13796:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783071501.374208:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071501.374358:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692895872 00000100:00100000:3.0:1783071501.374408:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692895872 00000100:00100000:3.0:1783071501.374588:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 149 00000100:00100000:3.0:1783071501.374599:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:11893:x1869685692895872:12345-192.168.204.38@tcp:101:lsof.0 00010000:00010000:3.0:1783071501.374622:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071501.374645:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9600/0x6b58994c2cbdc9d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98f63 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071501.374719:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9e00/0x6b58994c2cbdc9e0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071501.374732:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9e00/0x6b58994c2cbdc9e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071501.374757:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9e00/0x6b58994c2cbdc9e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783071501.374814:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783071501.374831:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00080000:2.0:1783071501.374864:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:3.0:1783071501.374877:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9e00/0x6b58994c2cbdc9e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071501.374924:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9600/0x6b58994c2cbdc9d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f63 expref: 7 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071501.374947:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9e00/0x6b58994c2cbdc9e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f63 expref: 6 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071501.374956:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8a020cad00) 00010000:00010000:3.0:1783071501.374959:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783071501.374963:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b014b9e00, rc 0) 00000100:00100000:3.0:1783071501.375051:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39473256-b7f7-4f8b-91c6-e632aff5be8d+6:11893:x1869685692895872:12345-192.168.204.38@tcp:101:lsof.0 Request processed in 452us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071501.375059:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 149 00010000:00010000:2.0:1783071501.570707:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783071501.571619:0:13798:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1783071501.634683:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a039d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707642496:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783071501.634778:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071501.640761:0:9413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707642496 00000100:00100000:2.0:1783071501.640786:0:9413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707642496 00000100:00100000:2.0:1783071501.640901:0:9413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1783071501.640915:0:9413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707642496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783071501.640972:0:9413:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783071501.641109:0:9413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707642496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 196us (6329us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071501.641117:0:9413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1783071501.642260:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a039d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707642496:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1783071502.595329:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071503.618964:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071503.641431:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071503.641596:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071503.641661:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071503.641699:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071503.641726:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692896256 00000100:00100000:2.0:1783071503.641741:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071503.641745:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692896256 00000100:00100000:2.0:1783071503.641786:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071503.641818:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692896512 00000100:00100000:0.0:1783071503.641825:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692896512 00000100:00100000:2.0:1783071503.641838:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071503.641845:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 287 00000100:00100000:1.0:1783071503.641858:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03aeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+5:2406:x1869685692896256:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1783071503.641885:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692896384 00000100:00100000:0.0:1783071503.641889:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692896384 00000100:00100000:0.0:1783071503.641918:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 135 00000100:00100000:0.0:1783071503.641925:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03aeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf7532e4-6153-424a-9f4e-84941256b41f+5:2406:x1869685692896512:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1783071503.641946:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692896768 00000100:00100000:2.0:1783071503.641957:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692896768 00000100:00100000:1.0:1783071503.641966:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03aeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+5:2406:x1869685692896256:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 110us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071503.641966:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03aeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf7532e4-6153-424a-9f4e-84941256b41f+5:2406:x1869685692896512:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 37us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071503.641976:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 135 00000100:00100000:1.0:1783071503.641977:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 287 00000100:00100000:1.0:1783071503.641996:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692896128 00000100:00100000:0.0:1783071503.641997:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 136 00000100:00100000:1.0:1783071503.642003:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692896128 00000100:00100000:0.0:1783071503.642007:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03aee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf7532e4-6153-424a-9f4e-84941256b41f+6:2406:x1869685692896384:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1783071503.642013:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692896640 00000100:00100000:2.0:1783071503.642019:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692896640 00000100:00100000:1.0:1783071503.642039:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 288 00000100:00100000:0.0:1783071503.642039:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03aee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf7532e4-6153-424a-9f4e-84941256b41f+6:2406:x1869685692896384:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 34us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071503.642046:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 136 00000100:00100000:1.0:1783071503.642053:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03aef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2406:x1869685692896768:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1783071503.642070:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 289 00000100:00100000:2.0:1783071503.642085:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03aed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+15:2406:x1869685692896128:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1783071503.642095:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03aef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2406:x1869685692896768:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 40us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071503.642104:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 290 00000100:00100000:0.0:1783071503.642115:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03aec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:39473256-b7f7-4f8b-91c6-e632aff5be8d+6:2406:x1869685692896640:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1783071503.642147:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03aec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:39473256-b7f7-4f8b-91c6-e632aff5be8d+6:2406:x1869685692896640:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 36us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071503.642640:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 288 00000100:00080000:1.0:1783071503.642676:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783071503.642682:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783071503.642684:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783071503.642687:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783071503.643771:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03aed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+15:2406:x1869685692896128:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 1682us (2023us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071503.643784:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 289 00000100:00100000:0.0:1783071503.646444:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 290 00000100:00100000:3.0:1783071503.647578:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692896000 00000100:00100000:3.0:1783071503.647598:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692896000 00000100:00100000:3.0:1783071503.648476:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 381 00000100:00100000:3.0:1783071503.648493:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18685850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:2406:x1869685692896000:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1783071503.648629:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18685850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:2406:x1869685692896000:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 128us (7204us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071503.648646:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 381 00000001:02000400:2.0:1783071504.528942:0:14454:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 05:38:24 (1783071504) 00010000:00010000:0.0:1783071504.642599:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071505.218748:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783071505.218772:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03b98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707642624:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783071505.218855:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071505.219158:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707642624 00000100:00100000:0.0:1783071505.219167:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707642624 00000100:00100000:0.0:1783071505.219226:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1783071505.219236:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a039d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707642624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783071505.219272:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1783071505.219326:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a039d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707642624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071505.219351:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1783071505.219440:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03b98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707642624:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783071505.220929:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03b99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869685707643008:0@lo:400:kworker.0 00000100:00100000:3.0:1783071505.220993:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071505.221072:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03b9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707643520:0@lo:400:kworker.0 00000100:00100000:3.0:1783071505.221100:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071505.221118:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03b9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707644032:0@lo:400:kworker.0 00000100:00100000:3.0:1783071505.221139:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071505.221162:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1783071505.221167:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03b98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869685707642880:0@lo:400:kworker.0 00000100:00100000:3.0:1783071505.221188:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071505.221205:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03b99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1869685707643392:0@lo:400:kworker.0 00000100:00100000:3.0:1783071505.221226:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071505.221241:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03b99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1869685707643904:0@lo:400:kworker.0 00000100:00100000:3.0:1783071505.221259:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071505.221287:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707643008 00000100:00100000:3.0:1783071505.221293:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707643008 00000100:00100000:3.0:1783071505.221335:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707642880 00000100:00100000:3.0:1783071505.221338:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707642880 00000100:00100000:3.0:1783071505.221351:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707643392 00000100:00100000:3.0:1783071505.221354:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707643392 00000100:00100000:3.0:1783071505.221407:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707643904 00000100:00100000:3.0:1783071505.221410:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707643904 00000100:00100000:3.0:1783071505.221425:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1783071505.221433:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a039d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869685707643008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071505.221490:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a039d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869685707643008:12345-0@lo:400:kworker.0 Request processed in 56us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071505.221497:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1783071505.221513:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1783071505.221519:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a039d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869685707642880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071505.221544:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a039d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869685707642880:12345-0@lo:400:kworker.0 Request processed in 26us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071505.221557:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1783071505.221569:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1783071505.221574:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a039d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869685707643392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071505.221608:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a039d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869685707643392:12345-0@lo:400:kworker.0 Request processed in 34us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071505.221614:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1783071505.221628:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1783071505.221636:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a039d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869685707643904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071505.221664:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a039d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869685707643904:12345-0@lo:400:kworker.0 Request processed in 29us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071505.221680:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1783071505.221687:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03b9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707643136:0@lo:400:kworker.0 00000100:00080000:3.0:1783071505.221705:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783071505.221719:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03b98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:feaa1501-b927-4e07-baad-3200e92d7497:3646:1869685707642752:0@lo:400:kworker.0 00000100:00100000:1.0:1783071505.221726:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071505.221753:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03b98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707643648:0@lo:400:kworker.0 00000100:00100000:3.0:1783071505.221761:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071505.221790:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071505.221792:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03b9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1869685707643264:0@lo:400:kworker.0 00000100:00100000:1.0:1783071505.221984:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03b99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707644160:0@lo:400:kworker.0 00000100:00100000:3.0:1783071505.221985:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071505.222009:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03b99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1869685707643776:0@lo:400:kworker.0 00000100:00100000:1.0:1783071505.222026:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071505.222167:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071505.222216:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03b98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869685707642880:0@lo:400:kworker.0 00010000:00080000:3.0:1783071505.222231:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a03b99880 x1869685707643392/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071505.222240:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03b99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1869685707643392:0@lo:400:kworker.0 00010000:00080000:3.0:1783071505.222250:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a03b99f80 x1869685707643904/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071505.222266:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03b99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1869685707643904:0@lo:400:kworker.0 00000100:00100000:3.0:1783071505.222278:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03b99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869685707643008:0@lo:400:kworker.0 00000100:00100000:3.0:1783071505.222303:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707643264 00000100:00100000:3.0:1783071505.222307:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707643264 00000100:00100000:1.0:1783071505.222336:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707642752 00000100:00100000:3.0:1783071505.222337:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707643776 00000100:00100000:3.0:1783071505.222343:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707643776 00000100:00100000:1.0:1783071505.222343:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707642752 00000100:00100000:3.0:1783071505.222396:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1783071505.222403:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a039d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869685707643264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071505.222411:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1783071505.222421:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18684c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+24:3646:x1869685707642752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071505.222450:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a039d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869685707643264:12345-0@lo:400:kworker.0 Request processed in 46us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071505.222458:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1783071505.222464:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18684c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+24:3646:x1869685707642752:12345-0@lo:400:kworker.0 Request processed in 44us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071505.222472:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1783071505.222477:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1783071505.222486:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a039d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869685707643776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071505.222512:0:8910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707643520 00000100:00100000:1.0:1783071505.222517:0:8910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707643520 00000100:00100000:3.0:1783071505.222522:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a039d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869685707643776:12345-0@lo:400:kworker.0 Request processed in 37us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071505.222529:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1783071505.222543:0:8910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707644032 00000100:00100000:1.0:1783071505.222548:0:8910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707644032 00000100:00080000:3.0:1783071505.222551:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783071505.222556:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783071505.222560:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783071505.222564:0:8910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707643648 00000100:00100000:1.0:1783071505.222568:0:8910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707643648 00000100:00100000:3.0:1783071505.222580:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03b98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:feaa1501-b927-4e07-baad-3200e92d7497:3646:1869685707642752:0@lo:400:kworker.0 00000100:00100000:3.0:1783071505.222593:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03b9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1869685707643264:0@lo:400:kworker.0 00000100:00100000:1.0:1783071505.222596:0:8910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707644160 00000100:00100000:1.0:1783071505.222601:0:8910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707644160 00000100:00100000:3.0:1783071505.222605:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03b99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1869685707643776:0@lo:400:kworker.0 00000100:00100000:1.0:1783071505.222622:0:8910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1783071505.222630:0:8910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a039d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707643520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071505.222665:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707643136 00000100:00100000:3.0:1783071505.222681:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707643136 00000100:00100000:1.0:1783071505.222684:0:8910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a039d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707643520:12345-0@lo:400:kworker.0 Request processed in 42us (1571us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071505.222694:0:8910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1783071505.222709:0:8910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1783071505.222717:0:8910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a039d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707644032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071505.222722:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1783071505.222732:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c68e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707643136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071505.222753:0:8910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a039d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707644032:12345-0@lo:400:kworker.0 Request processed in 36us (1611us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071505.222760:0:8910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1783071505.222778:0:8910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1783071505.222782:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c68e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707643136:12345-0@lo:400:kworker.0 Request processed in 50us (1054us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071505.222790:0:8910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c68f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707643648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071505.222793:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1783071505.222818:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1783071505.222826:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0397ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707644160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071505.222854:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0397ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707644160:12345-0@lo:400:kworker.0 Request processed in 29us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071505.222858:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:3.0:1783071505.222891:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783071505.222894:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783071505.222914:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03b9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707643520:0@lo:400:kworker.0 00000100:00100000:3.0:1783071505.222923:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03b9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707644032:0@lo:400:kworker.0 00000100:00100000:1.0:1783071505.222963:0:8910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c68f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707643648:12345-0@lo:400:kworker.0 Request processed in 176us (1173us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071505.222972:0:8910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1783071505.223004:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03b9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707643136:0@lo:400:kworker.0 00000100:00100000:1.0:1783071505.223013:0:3645:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:1.0:1783071505.223018:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f8b37abe300, transno 4294967311 00000004:00080000:1.0:1783071505.223036:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:1.0:1783071505.223051:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03b98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707643648:0@lo:400:kworker.0 00000100:00100000:1.0:1783071505.223062:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03b99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707644160:0@lo:400:kworker.0 00000001:00080000:2.0:1783071505.234640:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:2.0:1783071505.234655:0:6495:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1783071505.234743:0:6549:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1783071505.234755:0:6549:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:2.0:1783071505.666554:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071505.730713:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783071505.730739:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03b98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707644288:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783071505.730773:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783071505.730788:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707644416:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783071505.730822:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071505.730901:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071505.730988:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707644288 00000100:00100000:3.0:1783071505.730989:0:12254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707644416 00000100:00100000:3.0:1783071505.730998:0:12254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707644416 00000100:00100000:0.0:1783071505.730999:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707644288 00000100:00100000:3.0:1783071505.731087:0:12254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1783071505.731099:0:12254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3b77b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707644416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783071505.731136:0:12254:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783071505.731182:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783071505.731187:0:12254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3b77b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707644416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071505.731196:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03aece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707644544:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783071505.731198:0:12254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1783071505.731251:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071505.731281:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03aee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707644672:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783071505.731314:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071505.731328:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707644416:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783071505.731347:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707644544 00000100:00100000:1.0:1783071505.731352:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707644544 00000100:00100000:0.0:1783071505.733516:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707644672 00000100:00100000:0.0:1783071505.733532:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707644672 00000100:00100000:0.0:1783071505.733572:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1783071505.733583:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3b779c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707644288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783071505.733622:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1783071505.735755:0:12254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1783071505.735777:0:12254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707644672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783071505.735820:0:12254:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1783071505.735932:0:12254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707644672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 166us (4617us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071505.735940:0:12254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1783071505.737695:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3b779c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707644288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4105us (6866us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071505.737709:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1783071505.740914:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1783071505.740943:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03aef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707644544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783071505.740976:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783071505.741235:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03aef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707644544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 307us (9984us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071505.741242:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1783071505.741398:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03aee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707644672:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783071505.741422:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03b98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707644288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783071505.744456:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03aece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707644544:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783071505.894892:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071505.896981:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692897024 00000100:00100000:3.0:1783071505.896997:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692897024 00000100:00100000:2.0:1783071505.897266:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 150 00000100:00100000:2.0:1783071505.897278:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+14:12160:x1869685692897024:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783071505.897298:0:10292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071505.897587:0:10292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdc9e7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98f6a expref: -99 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071505.897679:0:10292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdc9ee lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071505.897694:0:10292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdc9ee lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071505.897706:0:10292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdc9ee lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071505.897751:0:10292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdc9f5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071505.897759:0:10292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdc9f5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071505.897766:0:10292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdc9f5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071505.897887:0:10292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdc9fc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071505.897897:0:10292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdc9fc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071505.897905:0:10292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdc9fc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071505.897916:0:10292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1783071505.898014:0:10292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdc9ee lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071505.898023:0:10292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdc9ee lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071505.898030:0:10292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdc9ee lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071505.898037:0:10292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd67c00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:2.0:1783071505.898041:0:10292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdc9ee lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071505.898048:0:10292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdc9ee lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071505.898060:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8f8a0179f000) 00010000:00010000:2.0:1783071505.898063:0:10292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071505.898068:0:10292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdc9ee lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071505.898084:0:10292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdc9ee lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071505.898099:0:10292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdc9f5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071505.898105:0:10292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdc9f5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071505.898110:0:10292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdc9f5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071505.898116:0:10292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd66c00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:2.0:1783071505.898119:0:10292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdc9f5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071505.898125:0:10292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdc9f5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071505.898133:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8f8a020ca700) 00010000:00010000:2.0:1783071505.898136:0:10292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071505.898138:0:10292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdc9f5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071505.898144:0:10292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdc9f5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1783071505.898596:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1783071505.898998:0:10292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdc9e7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f6a expref: 17 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071505.899030:0:10292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdc9fc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f6a expref: 16 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071505.899039:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f8b0d17fa00) 00010000:00010000:2.0:1783071505.899042:0:10292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071505.899045:0:10292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b2fd66a00, rc 0) 00000100:00100000:2.0:1783071505.899121:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+16:12160:x1869685692897024:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 1845us (4237us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1783071505.899130:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 150 00000100:00100000:2.0:1783071505.907587:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071505.907831:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692897152 00000100:00100000:3.0:1783071505.907842:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692897152 00000100:00100000:3.0:1783071505.907911:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 151 00000100:00100000:3.0:1783071505.908102:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03aee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+16:12160:x1869685692897152:12345-192.168.204.38@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1783071505.908357:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03aee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+16:12160:x1869685692897152:12345-192.168.204.38@tcp:59:lhsmtool_posix.0 Request processed in 259us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071505.908402:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 151 00000100:00100000:1.0:1783071505.912553:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071505.916582:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692897280 00000100:00100000:0.0:1783071505.916604:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692897280 00000100:00100000:2.0:1783071505.921795:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071505.921857:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692897408 00000100:00100000:3.0:1783071505.921867:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692897408 00000100:00100000:0.0:1783071505.921873:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 10 00000100:00100000:0.0:1783071505.921891:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf7532e4-6153-424a-9f4e-84941256b41f+16:2404:x1869685692897280:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783071505.921915:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1783071505.921935:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 152 00010000:00010000:0.0:1783071505.921944:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdc9fc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f6a expref: 16 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071505.921947:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03aece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+5:12160:x1869685692897408:12345-192.168.204.38@tcp:59:lhsmtool_posix.0 00010000:00010000:0.0:1783071505.921971:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f8b0d17fa00) 00010000:00010000:0.0:1783071505.921977:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071505.922049:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf7532e4-6153-424a-9f4e-84941256b41f+15:2404:x1869685692897280:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 163us (9507us total) trans 0 rc 0/0 00000100:00080000:2.0:1783071505.922056:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783071505.922057:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 10 00000100:00100000:3.0:1783071505.922130:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03aece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+5:12160:x1869685692897408:12345-192.168.204.38@tcp:59:lhsmtool_posix.0 Request processed in 185us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071505.922138:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 152 00000040:00080000:2.0:1783071506.434658:0:13796:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783071506.434672:0:13796:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783071506.434720:0:13796:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1783071506.434873:0:13796:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1783071506.691265:0:13798:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1783071506.695566:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071506.754564:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03b9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707644800:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783071506.754673:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071506.754793:0:9413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707644800 00000100:00100000:1.0:1783071506.754803:0:9413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707644800 00000100:00100000:1.0:1783071506.754878:0:9413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1783071506.754889:0:9413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03330000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707644800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783071506.754938:0:9413:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783071506.760135:0:9413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03330000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707644800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 5231us (5446us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071506.760154:0:9413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1783071506.764464:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03b9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707644800:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1783071507.715248:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071507.879186:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071507.879427:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692897536 00000100:00100000:2.0:1783071507.879437:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692897536 00000100:00100000:2.0:1783071507.879527:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 153 00000100:00080000:3.0:1783071507.879530:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783071507.879541:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+15:12202:x1869685692897536:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1783071507.879565:0:10292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071507.879596:0:10292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdca0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98f71 expref: -99 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071507.879685:0:10292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdca11 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071507.879702:0:10292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdca11 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071507.879713:0:10292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdca11 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071507.879725:0:10292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66400/0x6b58994c2cbdca18 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071507.879732:0:10292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66400/0x6b58994c2cbdca18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071507.879738:0:10292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66400/0x6b58994c2cbdca18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071507.879781:0:10292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdca11 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071507.879787:0:10292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdca11 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071507.879793:0:10292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdca11 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071507.879799:0:10292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd66200 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:2.0:1783071507.879803:0:10292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdca11 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071507.879819:0:10292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdca11 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071507.879833:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8a020cad00) 00010000:00010000:2.0:1783071507.879836:0:10292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071507.879840:0:10292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdca11 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071507.879847:0:10292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdca11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071507.880087:0:10292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66400/0x6b58994c2cbdca18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071507.880094:0:10292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66400/0x6b58994c2cbdca18 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071507.880099:0:10292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66400/0x6b58994c2cbdca18 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071507.880105:0:10292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd66400 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:2.0:1783071507.880107:0:10292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66400/0x6b58994c2cbdca18 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071507.880113:0:10292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66400/0x6b58994c2cbdca18 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071507.880122:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8f8a020ca700) 00010000:00010000:2.0:1783071507.880124:0:10292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071507.880127:0:10292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66400/0x6b58994c2cbdca18 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071507.880143:0:10292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66400/0x6b58994c2cbdca18 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071507.880173:0:10292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdca0a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f71 expref: 16 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071507.880181:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8a020cad00) 00010000:00010000:2.0:1783071507.880182:0:10292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071507.880185:0:10292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdca0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f71 expref: 16 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071507.880191:0:10292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b2fd67600, rc 0) 00000100:00100000:2.0:1783071507.880248:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+15:12202:x1869685692897536:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 712us (1073us total) trans 0 rc 301/301 00000100:00100000:2.0:1783071507.880254:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 153 00000100:00100000:2.0:1783071507.887673:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071507.887757:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692897792 00000100:00100000:3.0:1783071507.887767:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692897792 00000100:00100000:3.0:1783071507.887825:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 154 00000100:00100000:3.0:1783071507.887836:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03332300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+15:12202:x1869685692897792:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:3.0:1783071507.887909:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071507.887936:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdc35e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d95 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071507.887954:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8a020cad00) 00010000:00010000:3.0:1783071507.887959:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783071507.888020:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9600/0x6b58994c2cbdca1f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071507.888033:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9e00/0x6b58994c2cbdc9e0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f63 expref: 5 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071507.888041:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9600/0x6b58994c2cbdca1f lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071507.888077:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9e00/0x6b58994c2cbdc9e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f63 expref: 5 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071507.888089:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9e00/0x6b58994c2cbdc9e0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f63 expref: 5 pid: 6517 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071507.888102:0:6517:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37abe300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1869685707644928:192.168.204.38@tcp:104: 00000100:00100000:2.0:1783071507.888930:0:6517:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0324f600 going to sleep for 11 seconds 00000100:00100000:1.0:1783071507.900046:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071507.900105:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692897920 00000100:00100000:0.0:1783071507.900115:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692897920 00010000:00010000:0.0:1783071507.900175:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9e00/0x6b58994c2cbdc9e0 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f63 expref: 6 pid: 6517 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071507.900212:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 80 00000100:00100000:0.0:1783071507.900221:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:39473256-b7f7-4f8b-91c6-e632aff5be8d+6:2406:x1869685692897920:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783071507.900240:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071507.900247:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9e00/0x6b58994c2cbdc9e0 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f63 expref: 6 pid: 6517 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071507.900261:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9e00/0x6b58994c2cbdc9e0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f63 expref: 6 pid: 6517 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071507.900282:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8a020cad00) 00010000:00010000:0.0:1783071507.900287:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9600/0x6b58994c2cbdca1f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071507.900296:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9600/0x6b58994c2cbdca1f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071507.900304:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9600/0x6b58994c2cbdca1f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071507.900334:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071507.900411:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:39473256-b7f7-4f8b-91c6-e632aff5be8d+6:2406:x1869685692897920:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 190us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071507.900419:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 80 00000100:00080000:1.0:1783071507.900795:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783071507.901086:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9e00/0x6b58994c2cbdc9e0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f63 expref: 5 pid: 6517 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071507.901106:0:6517:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37abe300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1869685707644928:192.168.204.38@tcp:104: 00010000:00010000:3.0:1783071507.901130:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9600/0x6b58994c2cbdca1f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071507.901148:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9600/0x6b58994c2cbdca1f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071507.901156:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9600/0x6b58994c2cbdca1f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071507.901180:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdca26 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071507.901190:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdca26 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071507.901197:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdca26 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071507.902523:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8200/0x6b58994c2cbdca2d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071507.902541:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8200/0x6b58994c2cbdca2d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071507.902550:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8200/0x6b58994c2cbdca2d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783071507.902569:0:6517:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000019cd1da6 reply state 00000000bd05acd8 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8200/0x6b58994c2cbdca2d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071507.902581:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8200/0x6b58994c2cbdca2d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071507.902589:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f8a021bdc00) 00010000:00010000:3.0:1783071507.902801:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783071507.902804:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1783071507.902812:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1783071507.902821:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9600/0x6b58994c2cbdca1f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071507.902828:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9600/0x6b58994c2cbdca1f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071507.902834:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9600/0x6b58994c2cbdca1f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071507.902840:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b014b9600 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071507.902844:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9600/0x6b58994c2cbdca1f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071507.902943:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9600/0x6b58994c2cbdca1f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071507.902955:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8a020cad00) 00010000:00010000:3.0:1783071507.902958:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071507.902962:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9600/0x6b58994c2cbdca1f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071507.902968:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9600/0x6b58994c2cbdca1f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783071507.902984:0:6517:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000019cd1da6 reply state 00000000bd05acd8 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdca26 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071507.902992:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdca26 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071507.903006:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8f8a021bdf00) 00010000:00010000:3.0:1783071507.903009:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783071507.903010:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1783071507.903138:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03332300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+16:12202:x1869685692897792:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 15301us (15471us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1783071507.903146:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 154 00000100:00100000:1.0:1783071508.023047:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071508.023128:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692898048 00000100:00100000:3.0:1783071508.023139:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692898048 00000100:00100000:3.0:1783071508.023201:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 155 00000100:00100000:3.0:1783071508.023212:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+16:12210:x1869685692898048:12345-192.168.204.38@tcp:101:lctl.0 00010000:00010000:3.0:1783071508.023243:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071508.023266:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9600/0x6b58994c2cbdca34 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98f78 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.023332:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9e00/0x6b58994c2cbdca3b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.023346:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9e00/0x6b58994c2cbdca3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.023357:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9e00/0x6b58994c2cbdca3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783071508.023436:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783071508.023440:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783071508.023473:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9e00/0x6b58994c2cbdca3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.023498:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9600/0x6b58994c2cbdca34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f78 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.023533:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9e00/0x6b58994c2cbdca3b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f78 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.023541:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8a021bd600) 00010000:00010000:3.0:1783071508.023545:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783071508.023547:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b014b9e00, rc 0) 00000100:00100000:3.0:1783071508.023599:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+17:12210:x1869685692898048:12345-192.168.204.38@tcp:101:lctl.0 Request processed in 389us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071508.023605:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 155 00000100:00100000:1.0:1783071508.089319:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071508.089435:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692898176 00000100:00100000:0.0:1783071508.089456:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692898176 00000100:00100000:0.0:1783071508.089518:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 156 00000100:00100000:0.0:1783071508.089528:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07796680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+17:12216:x1869685692898176:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:0.0:1783071508.089554:0:13815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071508.089576:0:13815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864000/0x6b58994c2cbdca42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98f7f expref: -99 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071508.089815:0:13815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdca49 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071508.089843:0:13815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdca49 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071508.089855:0:13815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdca49 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071508.089866:0:13815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdca50 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071508.089877:0:13815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdca50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071508.089883:0:13815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdca50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071508.089982:0:13815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865000/0x6b58994c2cbdca57 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071508.089990:0:13815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865000/0x6b58994c2cbdca57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071508.089996:0:13815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865000/0x6b58994c2cbdca57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783071508.090027:0:13815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1783071508.090031:0:13815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783071508.090049:0:13815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865000/0x6b58994c2cbdca57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071508.090061:0:13815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdca49 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071508.090067:0:13815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdca49 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071508.090074:0:13815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdca49 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071508.090079:0:13815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03865e00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:0.0:1783071508.090083:0:13815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdca49 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071508.090089:0:13815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdca49 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071508.090100:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8a021bd600) 00010000:00010000:0.0:1783071508.090109:0:13815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071508.090114:0:13815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdca49 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071508.090121:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdca49 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071508.090134:0:13815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdca50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071508.090139:0:13815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdca50 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071508.090144:0:13815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdca50 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071508.090149:0:13815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03865c00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:0.0:1783071508.090152:0:13815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdca50 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071508.090158:0:13815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdca50 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071508.090166:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8f8a021bdf00) 00010000:00010000:0.0:1783071508.090168:0:13815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071508.090171:0:13815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdca50 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071508.090177:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdca50 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071508.090201:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864000/0x6b58994c2cbdca42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f7f expref: 19 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071508.090228:0:13815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865000/0x6b58994c2cbdca57 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f7f expref: 18 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071508.090235:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f8a021bdc00) 00010000:00010000:0.0:1783071508.090237:0:13815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1783071508.090240:0:13815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a03865000, rc 0) 00000100:00100000:0.0:1783071508.090496:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07796680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+18:12216:x1869685692898176:12345-192.168.204.38@tcp:101:bash.0 Request processed in 968us (1185us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071508.090505:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 156 00000100:00100000:0.0:1783071508.096053:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071508.096187:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692898432 00000100:00100000:3.0:1783071508.096197:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692898432 00000100:00100000:3.0:1783071508.096259:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 157 00000100:00100000:3.0:1783071508.096270:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+18:12216:x1869685692898432:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:3.0:1783071508.096291:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071508.096311:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9600/0x6b58994c2cbdca5e lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98f86 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.096450:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9400/0x6b58994c2cbdca65 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.096465:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9400/0x6b58994c2cbdca65 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.096476:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9400/0x6b58994c2cbdca65 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.096534:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdca6c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.096556:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdca6c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.096563:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdca6c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783071508.097824:0:6517:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:3.0:1783071508.098087:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdca73 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.098102:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdca73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.098112:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdca73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.098147:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9400/0x6b58994c2cbdca65 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.098153:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9400/0x6b58994c2cbdca65 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.098159:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9400/0x6b58994c2cbdca65 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.098164:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b014b9400 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071508.098168:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9400/0x6b58994c2cbdca65 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.098175:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9400/0x6b58994c2cbdca65 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.098203:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f8a021bdc00) 00010000:00010000:3.0:1783071508.098205:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071508.098210:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9400/0x6b58994c2cbdca65 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.098216:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9400/0x6b58994c2cbdca65 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783071508.098230:0:6517:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b6c1cf2a reply state 00000000b86a4c09 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdca6c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.098240:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdca6c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.098245:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f8a021bd500) 00010000:00010000:3.0:1783071508.098247:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783071508.098250:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783071508.098281:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9600/0x6b58994c2cbdca5e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f86 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.098293:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdca73 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f86 expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.098299:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f8a021bde00) 00010000:00010000:3.0:1783071508.098301:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783071508.098303:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b014b8c00, rc 0) 00000100:00100000:3.0:1783071508.098492:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+21:12216:x1869685692898432:12345-192.168.204.38@tcp:101:bash.0 Request processed in 2224us (2446us total) trans 4294967419 rc 0/0 00000100:00100000:3.0:1783071508.098501:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 157 00000100:00100000:1.0:1783071508.107615:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071508.107788:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692898560 00000100:00100000:3.0:1783071508.107798:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692898560 00000100:00100000:3.0:1783071508.107873:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 55 00000100:00100000:3.0:1783071508.107884:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07797800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf7532e4-6153-424a-9f4e-84941256b41f+5:2405:x1869685692898560:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:3.0:1783071508.107901:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071508.107921:0:8429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9e26a0a/0x6b58994c2cbdca81 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98f8d expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783071508.107945:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783071508.107965:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=409s v=(0 0) 00010000:00010000:3.0:1783071508.107969:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783071508.107977:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9e26a0a/0x6b58994c2cbdca81 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f8d expref: 6 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.107993:0:8429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c9e26a0a/0x6b58994c2cbdca81 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f8d expref: 6 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783071508.108085:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1783071508.108121:0:8429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b014b9600, rc 0) 00000100:00100000:3.0:1783071508.108248:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07797800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf7532e4-6153-424a-9f4e-84941256b41f+6:2405:x1869685692898560:12345-192.168.204.38@tcp:101:bash.0 Request processed in 366us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071508.108256:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 55 00000100:00100000:1.0:1783071508.119158:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071508.119256:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692898688 00000100:00100000:3.0:1783071508.119266:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692898688 00000100:00100000:3.0:1783071508.119330:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 56 00000100:00100000:3.0:1783071508.119342:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07797480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf7532e4-6153-424a-9f4e-84941256b41f+6:12216:x1869685692898688:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:3.0:1783071508.119398:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071508.119432:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b735a56/0x6b58994c2cbdca88 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98f94 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.119466:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c9e26a0a/0x6b58994c2cbdca81 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f8d expref: 7 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.119474:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783071508.119478:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783071508.119482:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b735a56/0x6b58994c2cbdca88 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f94 expref: 7 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.119515:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c9e26a0a/0x6b58994c2cbdca81 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f8d expref: 7 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.119529:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c9e26a0a/0x6b58994c2cbdca81 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f8d expref: 7 pid: 8429 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071508.119544:0:8432:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37abe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8432:1869685707645056:192.168.204.38@tcp:104: 00000100:00100000:3.0:1783071508.119660:0:8432:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0324f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783071508.124531:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071508.128266:0:7923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692898816 00000100:00100000:1.0:1783071508.128281:0:7923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692898816 00010000:00010000:1.0:1783071508.128336:0:7923:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c9e26a0a/0x6b58994c2cbdca81 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f8d expref: 8 pid: 8429 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071508.128428:0:7923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 81 00000100:00100000:1.0:1783071508.128439:0:7923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf7532e4-6153-424a-9f4e-84941256b41f+8:2406:x1869685692898816:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783071508.128454:0:7923:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071508.128489:0:7923:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c9e26a0a/0x6b58994c2cbdca81 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f8d expref: 8 pid: 8429 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071508.128504:0:7923:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c9e26a0a/0x6b58994c2cbdca81 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f8d expref: 8 pid: 8429 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071508.128549:0:7923:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783071508.128555:0:7923:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783071508.128566:0:7923:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007b735a56/0x6b58994c2cbdca88 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f94 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071508.128576:0:7923:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b735a56/0x6b58994c2cbdca88 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f94 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071508.128638:0:7923:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007b735a56/0x6b58994c2cbdca88 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f94 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071508.128653:0:7923:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37ab8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7923:1869685707645184:192.168.204.38@tcp:105: 00000100:00100000:1.0:1783071508.128756:0:7923:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b06c446c0 going to sleep for 11 seconds 00010000:00010000:3.0:1783071508.129896:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9e26a0a/0x6b58994c2cbdca81 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f8d expref: 8 pid: 8429 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071508.129919:0:8432:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37abe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8432:1869685707645056:192.168.204.38@tcp:104: 00010000:00010000:3.0:1783071508.129950:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007b735a56/0x6b58994c2cbdca88 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f94 expref: 7 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.129987:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b014b9400, rc 0) 00000100:00100000:3.0:1783071508.130047:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07797480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf7532e4-6153-424a-9f4e-84941256b41f+7:12216:x1869685692898688:12345-192.168.204.38@tcp:101:bash.0 Request processed in 10707us (10897us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071508.130055:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 56 00000100:00100000:1.0:1783071508.134633:0:7923:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37ab8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7923:1869685707645184:192.168.204.38@tcp:105: 00010000:00010000:1.0:1783071508.134660:0:7923:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071508.134836:0:7923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf7532e4-6153-424a-9f4e-84941256b41f+6:2406:x1869685692898816:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 6398us (10314us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071508.134849:0:7923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 81 00000100:00100000:2.0:1783071508.138426:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071508.139025:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692899072 00000100:00100000:0.0:1783071508.139036:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692899072 00000100:00100000:0.0:1783071508.139099:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 36 00000100:00100000:0.0:1783071508.139108:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03ad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+21:12216:x1869685692899072:12345-192.168.204.38@tcp:35:bash.0 00000100:00100000:0.0:1783071508.139440:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03ad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+22:12216:x1869685692899072:12345-192.168.204.38@tcp:35:bash.0 Request processed in 332us (1022us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1783071508.139448:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 36 00000100:00100000:0.0:1783071508.233237:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071508.233460:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692899328 00000100:00100000:2.0:1783071508.233469:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692899328 00000100:00100000:2.0:1783071508.233531:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 158 00000100:00100000:2.0:1783071508.233542:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+22:12226:x1869685692899328:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1783071508.233568:0:10292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071508.233587:0:10292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdca8f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98f9b expref: -99 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071508.233713:0:10292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1783071508.235014:0:10292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdca8f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f9b expref: 24 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071508.235034:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8a021bd600) 00010000:00010000:2.0:1783071508.235037:0:10292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783071508.235042:0:10292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdca8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f9b expref: 24 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071508.235058:0:10292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b2fd67c00, rc 0) 00000100:00100000:2.0:1783071508.235217:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+23:12226:x1869685692899328:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1676us (1990us total) trans 4294967421 rc 301/301 00000100:00100000:2.0:1783071508.235228:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 158 00000100:00100000:1.0:1783071508.239307:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071508.239399:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692899584 00000100:00100000:0.0:1783071508.239411:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692899584 00000100:00100000:0.0:1783071508.239522:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 37 00000100:00100000:0.0:1783071508.239533:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37ab8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+23:12226:x1869685692899584:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1783071508.239804:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37ab8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+24:12226:x1869685692899584:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 272us (506us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1783071508.239829:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 37 00000100:00100000:1.0:1783071508.307095:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071508.308087:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692899712 00000100:00100000:0.0:1783071508.308099:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692899712 00000100:00100000:0.0:1783071508.308175:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 159 00000100:00100000:0.0:1783071508.308185:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37abb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+24:12232:x1869685692899712:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1783071508.308212:0:13815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071508.308233:0:13815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdca9d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98fa2 expref: -99 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071508.308305:0:13815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdcaa4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071508.308322:0:13815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdcaa4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071508.308334:0:13815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdcaa4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783071508.308422:0:13815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1783071508.308426:0:13815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783071508.308445:0:13815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdcaa4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071508.308471:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdca9d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98fa2 expref: 26 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071508.308489:0:13815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdcaa4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98fa2 expref: 25 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071508.308518:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f8a021bdc00) 00010000:00010000:0.0:1783071508.308521:0:13815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783071508.308525:0:13815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a03865e00, rc 0) 00000100:00100000:0.0:1783071508.308621:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37abb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+25:12232:x1869685692899712:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 428us (1528us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071508.308629:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 159 00000100:00100000:1.0:1783071508.314422:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071508.314826:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692899968 00000100:00100000:3.0:1783071508.314837:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692899968 00000100:00100000:3.0:1783071508.314899:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 160 00000100:00100000:3.0:1783071508.314910:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b37ab8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+25:12232:x1869685692899968:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1783071508.314938:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071508.314961:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9600/0x6b58994c2cbdcaab lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98fa9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.315956:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8000/0x6b58994c2cbdcab2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.315975:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8000/0x6b58994c2cbdcab2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.316065:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8000/0x6b58994c2cbdcab2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783071508.316079:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1783071508.316212:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9600/0x6b58994c2cbdcaab lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98fa9 expref: 28 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.316235:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8000/0x6b58994c2cbdcab2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98fa9 expref: 27 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.316268:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f8a021bde00) 00010000:00010000:3.0:1783071508.316271:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783071508.316276:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b014b8000, rc 0) 00000100:00100000:3.0:1783071508.316361:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b37ab8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+27:12232:x1869685692899968:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1453us (2004us total) trans 4294967423 rc 0/0 00000100:00100000:3.0:1783071508.316388:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 160 00000100:00100000:1.0:1783071508.322830:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071508.322881:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071508.323412:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692900224 00000100:00100000:2.0:1783071508.323423:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692900224 00000100:00100000:2.0:1783071508.323487:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 161 00000100:00100000:2.0:1783071508.323498:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+27:12232:x1869685692900224:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1783071508.323525:0:10292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071508.323547:0:10292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdcac0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98fb0 expref: -99 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071508.323665:0:10292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdcac7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071508.323681:0:10292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdcac7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071508.323720:0:10292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdcac7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071508.323735:0:10292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1783071508.323851:0:10292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdcac0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98fb0 expref: 30 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071508.323872:0:10292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdcac7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98fb0 expref: 29 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071508.323882:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f8a021bde00) 00010000:00010000:2.0:1783071508.323885:0:10292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1783071508.323889:0:10292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b2fd66c00, rc 0) 00000100:00100000:2.0:1783071508.324154:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+29:12232:x1869685692900224:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 657us (1337us total) trans 4294967424 rc 0/0 00000100:00100000:2.0:1783071508.324164:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 161 00000100:00100000:0.0:1783071508.325490:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692900352 00000100:00100000:0.0:1783071508.325503:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692900352 00000100:00100000:1.0:1783071508.325768:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11 00000100:00100000:1.0:1783071508.325799:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a9e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf7532e4-6153-424a-9f4e-84941256b41f+29:2404:x1869685692900352:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783071508.325816:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071508.325839:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8000/0x6b58994c2cbdcab2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98fa9 expref: 29 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071508.325858:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f8a021bde00) 00010000:00010000:1.0:1783071508.325863:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071508.325924:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a9e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf7532e4-6153-424a-9f4e-84941256b41f+28:2404:x1869685692900352:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 129us (3042us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071508.326360:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11 00000100:00100000:1.0:1783071508.331920:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071508.332018:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692900480 00000100:00100000:3.0:1783071508.332029:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692900480 00000100:00100000:3.0:1783071508.332092:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 57 00000100:00100000:3.0:1783071508.332103:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf7532e4-6153-424a-9f4e-84941256b41f+6:2406:x1869685692900480:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:3.0:1783071508.332153:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9e26a0a/0x6b58994c2cbdcad5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.332173:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007b735a56/0x6b58994c2cbdca88 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f94 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.332181:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1783071508.332185:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783071508.332189:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9e26a0a/0x6b58994c2cbdcad5 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.332225:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007b735a56/0x6b58994c2cbdca88 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f94 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.332239:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007b735a56/0x6b58994c2cbdca88 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f94 expref: 6 pid: 8432 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071508.332269:0:8429:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37abe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8429:1869685707645312:192.168.204.38@tcp:104: 00000100:00100000:3.0:1783071508.332516:0:8429:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0324f180 going to sleep for 11 seconds 00000100:00100000:2.0:1783071508.339242:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071508.339404:0:8429:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37abe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8429:1869685707645312:192.168.204.38@tcp:104: 00010000:00010000:0.0:1783071508.339435:0:8429:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c9e26a0a/0x6b58994c2cbdcad5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071508.339756:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692900608 00000100:00100000:1.0:1783071508.339763:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692900608 00002000:00100000:1.0:1783071508.339813:0:8437:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8f8a03ad6a00 x1869685692900608/t0(0) o4->bf7532e4-6153-424a-9f4e-84941256b41f@192.168.204.38@tcp:99/0 lens 504/0 e 0 to 0 dl 1783071519 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783071508.339824:0:8437:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8f8a03ad6a00 with x1869685692900608 ext(0->12) 00010000:00010000:1.0:1783071508.339831:0:8437:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007b735a56/0x6b58994c2cbdca88 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f94 expref: 7 pid: 8432 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071508.339847:0:8437:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007b735a56/0x6b58994c2cbdca88 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f94 expref: 7 pid: 8432 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783071508.339855:0:8437:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8f8a03ad6a00 00000100:00100000:1.0:1783071508.339890:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2 00000100:00100000:1.0:1783071508.339900:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bf7532e4-6153-424a-9f4e-84941256b41f+7:2405:x1869685692900608:12345-192.168.204.38@tcp:4:lfs.0 00000100:00100000:1.0:1783071508.341247:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bf7532e4-6153-424a-9f4e-84941256b41f+9:2405:x1869685692900608:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 1341us (2007us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1783071508.341269:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2 00002000:00100000:1.0:1783071508.341281:0:8437:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8f8a03ad6a00 x1869685692900608/t4294967306(0) o4->bf7532e4-6153-424a-9f4e-84941256b41f@192.168.204.38@tcp:99/0 lens 504/448 e 0 to 0 dl 1783071519 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783071508.341290:0:8437:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8f8a03ad6a00 with x1869685692900608 ext(0->12) 00010000:00010000:1.0:1783071508.341298:0:8437:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007b735a56/0x6b58994c2cbdca88 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f94 expref: 9 pid: 8432 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071508.341315:0:8437:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007b735a56/0x6b58994c2cbdca88 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f94 expref: 9 pid: 8432 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783071508.341322:0:8437:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8f8a03ad6a00 00000100:00100000:1.0:1783071508.344605:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071508.346323:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692900736 00000100:00100000:0.0:1783071508.346341:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692900736 00010000:00010000:0.0:1783071508.346413:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007b735a56/0x6b58994c2cbdca88 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f94 expref: 9 pid: 8432 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071508.346511:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 82 00000100:00100000:0.0:1783071508.346524:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a9d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf7532e4-6153-424a-9f4e-84941256b41f+9:2405:x1869685692900736:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783071508.346542:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1783071508.346562:0:6502:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1783071508.346565:0:6502:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1783071508 00002000:00010000:0.0:1783071508.346567:0:6502:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1783071509 00002000:00010000:0.0:1783071508.346569:0:6502:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1783071508 00002000:00010000:0.0:1783071508.346571:0:6502:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1783071508.346591:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007b735a56/0x6b58994c2cbdca88 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f94 expref: 9 pid: 8432 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071508.346607:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007b735a56/0x6b58994c2cbdca88 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f94 expref: 9 pid: 8432 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071508.346649:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b735a56/0x6b58994c2cbdca88 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f94 expref: 9 pid: 8432 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071508.346668:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783071508.346673:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783071508.346679:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c9e26a0a/0x6b58994c2cbdcad5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071508.346699:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9e26a0a/0x6b58994c2cbdcad5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071508.346738:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071508.346805:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a9d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf7532e4-6153-424a-9f4e-84941256b41f+8:2405:x1869685692900736:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 284us (2210us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071508.346813:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 82 00010000:00010000:2.0:1783071508.346877:0:8429:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c9e26a0a/0x6b58994c2cbdcad5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071508.346887:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9e26a0a/0x6b58994c2cbdcad5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071508.346907:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9e26a0a/0x6b58994c2cbdcad5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071508.346916:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c9e26a0a/0x6b58994c2cbdcad5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071508.346929:0:8429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c9e26a0a/0x6b58994c2cbdcad5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071508.346944:0:8429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b014b9600 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:2.0:1783071508.346948:0:8429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9e26a0a/0x6b58994c2cbdcad5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071508.346958:0:8429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9e26a0a/0x6b58994c2cbdcad5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071508.346970:0:8429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c9e26a0a/0x6b58994c2cbdcad5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071508.346977:0:8429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9e26a0a/0x6b58994c2cbdcad5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071508.347037:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf7532e4-6153-424a-9f4e-84941256b41f+7:2406:x1869685692900480:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 14937us (15127us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071508.347046:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 57 00000100:00100000:2.0:1783071508.350828:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071508.356239:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692900992 00000100:00100000:3.0:1783071508.356253:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692900992 00000100:00100000:3.0:1783071508.356330:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 38 00000100:00100000:3.0:1783071508.356340:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0699e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+28:12232:x1869685692900992:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:3.0:1783071508.356480:0:6520:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdcac7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98fb0 expref: 28 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783071508.357234:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:3.0:1783071508.357271:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:3.0:1783071508.357761:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:3.0:1783071508.357814:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8000/0x6b58994c2cbdcadc lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.357841:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdca73 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f86 expref: 32 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.357851:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8000/0x6b58994c2cbdcadc lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.358209:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdca73 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f86 expref: 32 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.358228:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdca73 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f86 expref: 32 pid: 6517 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071508.358267:0:6520:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37abe300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6520:1869685707645440:192.168.204.38@tcp:104: 00000100:00100000:3.0:1783071508.363543:0:6520:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0324f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783071508.363842:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071508.364091:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692901120 00000100:00100000:0.0:1783071508.364101:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692901120 00010000:00010000:0.0:1783071508.364143:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdca73 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f86 expref: 33 pid: 6517 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071508.364176:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 83 00000100:00100000:0.0:1783071508.364186:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03ad4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf7532e4-6153-424a-9f4e-84941256b41f+33:2406:x1869685692901120:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783071508.364217:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071508.364225:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdca73 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f86 expref: 33 pid: 6517 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071508.364239:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdca73 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f86 expref: 33 pid: 6517 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071508.364262:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f8a021bde00) 00010000:00010000:0.0:1783071508.364267:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8000/0x6b58994c2cbdcadc lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071508.364276:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8000/0x6b58994c2cbdcadc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071508.364285:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8000/0x6b58994c2cbdcadc lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071508.364304:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071508.364390:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03ad4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf7532e4-6153-424a-9f4e-84941256b41f+33:2406:x1869685692901120:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 180us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071508.364398:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 83 00010000:00010000:3.0:1783071508.365279:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdca73 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f86 expref: 32 pid: 6517 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071508.365303:0:6520:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37abe300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6520:1869685707645440:192.168.204.38@tcp:104: 00010000:00010000:3.0:1783071508.365327:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8000/0x6b58994c2cbdcadc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.365337:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8000/0x6b58994c2cbdcadc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.365343:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8000/0x6b58994c2cbdcadc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783071508.365504:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:3.0:1783071508.365633:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:3.0:1783071508.365728:0:6520:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b37abe300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6520:1869685707645568:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1783071508.365789:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071508.365942:0:6520:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0324f300 going to sleep for 11 seconds 00000100:00100000:1.0:1783071508.366794:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707645568 00000100:00100000:1.0:1783071508.366803:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707645568 00000100:00100000:1.0:1783071508.367018:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1783071508.367029:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c5aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6520:x1869685707645568:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1783071508.367154:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c5aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6520:x1869685707645568:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 127us (1364us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071508.367162:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1783071508.367253:0:6520:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b37abe300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6520:1869685707645568:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1783071508.367419:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:2.0:1783071508.367484:0:6520:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03ad5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6520:1869685707645696:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1783071508.367539:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783071508.367975:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783071508.368208:0:6520:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a038bcd80 going to sleep for 11 seconds 00000100:00100000:0.0:1783071508.368338:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707645696 00000100:00100000:0.0:1783071508.368349:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707645696 00000100:00100000:0.0:1783071508.368409:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1783071508.368417:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6520:x1869685707645696:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1783071508.368578:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6520:x1869685707645696:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 162us (1039us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1783071508.368586:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1783071508.368735:0:6520:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03ad5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6520:1869685707645696:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1783071508.368790:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:2.0:1783071508.368832:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8000/0x6b58994c2cbdcadc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071508.368843:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8000/0x6b58994c2cbdcadc lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071508.368850:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8000/0x6b58994c2cbdcadc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071508.368856:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b014b8000 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:2.0:1783071508.368860:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8000/0x6b58994c2cbdcadc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071508.369071:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8000/0x6b58994c2cbdcadc lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071508.369090:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f8a021bde00) 00010000:00010000:2.0:1783071508.369094:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1783071508.369100:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8000/0x6b58994c2cbdcadc lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071508.369106:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8000/0x6b58994c2cbdcadc lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783071508.369352:0:6520:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1783071508.369441:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:2.0:1783071508.369454:0:6520:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 410158088997ns, next at 411158086497ns, rc = 0 00000001:00080000:2.0:1783071508.369475:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:2.0:1783071508.369504:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f8a021bde00) 00010000:00010000:2.0:1783071508.369507:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1783071508.369515:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdcac7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98fb0 expref: 36 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071508.369648:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0699e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+35:12232:x1869685692900992:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 13308us (18828us total) trans 4294967433 rc 0/0 00000100:00100000:2.0:1783071508.369657:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 38 00000020:00080000:2.0:1783071508.369661:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1783071508.374638:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071508.374747:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692901248 00000100:00100000:0.0:1783071508.374757:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692901248 00000100:00100000:0.0:1783071508.374840:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 162 00000100:00100000:0.0:1783071508.374851:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03ad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+35:12232:x1869685692901248:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1783071508.374885:0:13815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071508.374908:0:13815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdcae3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98fb7 expref: -99 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071508.375159:0:13815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdcae3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98fb7 expref: 36 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071508.375186:0:13815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdcae3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98fb7 expref: 36 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071508.375207:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f8b10db4800) 00010000:00010000:0.0:1783071508.375211:0:13815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783071508.375214:0:13815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a03865c00, rc 0) 00000100:00100000:0.0:1783071508.375276:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03ad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+36:12232:x1869685692901248:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 427us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071508.375284:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 162 00000100:00100000:1.0:1783071508.380238:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071508.380330:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692901504 00000100:00100000:0.0:1783071508.380339:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692901504 00000100:00100000:0.0:1783071508.380793:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 39 00000100:00100000:0.0:1783071508.380805:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+36:12232:x1869685692901504:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1783071508.381645:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+37:12232:x1869685692901504:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 838us (1693us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1783071508.381656:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 39 00000100:00100000:2.0:1783071508.493602:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071508.494068:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692901760 00000100:00100000:0.0:1783071508.494080:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692901760 00000100:00100000:0.0:1783071508.494184:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 163 00000100:00100000:0.0:1783071508.494206:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+37:12242:x1869685692901760:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1783071508.494232:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071508.494253:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864800/0x6b58994c2cbdcaea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98fbe expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783071508.494355:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1783071508.495894:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864800/0x6b58994c2cbdcaea lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98fbe expref: 39 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071508.495916:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8a021bd600) 00010000:00010000:1.0:1783071508.495919:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783071508.495942:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864800/0x6b58994c2cbdcaea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98fbe expref: 39 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071508.495961:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a03864800, rc 0) 00000100:00100000:1.0:1783071508.496051:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+38:12242:x1869685692901760:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1847us (2457us total) trans 4294967435 rc 301/301 00000100:00100000:1.0:1783071508.496059:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 163 00000100:00100000:3.0:1783071508.499029:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071508.499180:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692901888 00000100:00100000:1.0:1783071508.499189:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692901888 00000100:00100000:1.0:1783071508.499249:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 164 00000100:00100000:1.0:1783071508.499260:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03bd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+38:12242:x1869685692901888:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:1.0:1783071508.499339:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9e00/0x6b58994c2cbdcaf8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071508.499356:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9e00/0x6b58994c2cbdcaf8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071508.499394:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9e00/0x6b58994c2cbdcaf8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071508.499406:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d8600/0x6b58994c2cbdcaff lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071508.499413:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d8600/0x6b58994c2cbdcaff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071508.499419:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d8600/0x6b58994c2cbdcaff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071508.499520:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d8400/0x6b58994c2cbdcb06 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071508.499536:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d8400/0x6b58994c2cbdcb06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071508.499544:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d8400/0x6b58994c2cbdcb06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783071508.499600:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d8400/0x6b58994c2cbdcb06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071508.499632:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9e00/0x6b58994c2cbdcaf8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071508.499640:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9e00/0x6b58994c2cbdcaf8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071508.499646:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9e00/0x6b58994c2cbdcaf8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071508.499653:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b421d9e00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:1.0:1783071508.499657:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9e00/0x6b58994c2cbdcaf8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071508.499665:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9e00/0x6b58994c2cbdcaf8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071508.499677:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f8a021bdc00) 00010000:00010000:1.0:1783071508.499680:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071508.499695:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9e00/0x6b58994c2cbdcaf8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071508.499702:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9e00/0x6b58994c2cbdcaf8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071508.499725:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d8600/0x6b58994c2cbdcaff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071508.499732:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d8600/0x6b58994c2cbdcaff lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071508.499738:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d8600/0x6b58994c2cbdcaff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071508.499743:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b421d8600 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:1.0:1783071508.499746:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d8600/0x6b58994c2cbdcaff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071508.499753:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d8600/0x6b58994c2cbdcaff lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071508.499773:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f8a021bd500) 00010000:00010000:1.0:1783071508.499776:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071508.499779:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d8600/0x6b58994c2cbdcaff lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071508.499786:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d8600/0x6b58994c2cbdcaff lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071508.499799:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d8400/0x6b58994c2cbdcb06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071508.499805:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d8400/0x6b58994c2cbdcb06 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071508.499811:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d8400/0x6b58994c2cbdcb06 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071508.499823:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b421d8400 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:1.0:1783071508.499826:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d8400/0x6b58994c2cbdcb06 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071508.499832:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d8400/0x6b58994c2cbdcb06 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071508.499841:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f8b10db4800) 00010000:00010000:1.0:1783071508.499843:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071508.499846:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d8400/0x6b58994c2cbdcb06 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071508.499852:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d8400/0x6b58994c2cbdcb06 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071508.500287:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03bd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+38:12242:x1869685692901888:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 1025us (1262us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071508.500296:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 164 00000100:00100000:3.0:1783071508.503747:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071508.503985:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692902144 00000100:00100000:2.0:1783071508.503996:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692902144 00000100:00100000:2.0:1783071508.504061:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 40 00000100:00100000:2.0:1783071508.504072:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03bd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+38:12242:x1869685692902144:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1783071508.504311:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03bd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+39:12242:x1869685692902144:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 240us (573us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1783071508.504319:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 40 00000100:00100000:2.0:1783071508.558451:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071508.558547:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692902400 00000100:00100000:3.0:1783071508.558558:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692902400 00000100:00100000:3.0:1783071508.558630:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 165 00000100:00100000:3.0:1783071508.558642:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+39:12245:x1869685692902400:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1783071508.558683:0:13815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071508.558715:0:13815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdcb0d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98fc5 expref: -99 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.558802:0:13815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8000/0x6b58994c2cbdcb14 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.558816:0:13815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8000/0x6b58994c2cbdcb14 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.558828:0:13815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8000/0x6b58994c2cbdcb14 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.558837:0:13815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9400/0x6b58994c2cbdcb1b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.558844:0:13815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9400/0x6b58994c2cbdcb1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.558851:0:13815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9400/0x6b58994c2cbdcb1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.558958:0:13815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9600/0x6b58994c2cbdcb22 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.558966:0:13815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9600/0x6b58994c2cbdcb22 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.558973:0:13815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9600/0x6b58994c2cbdcb22 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783071508.558982:0:13815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1783071508.559409:0:13815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8000/0x6b58994c2cbdcb14 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.559418:0:13815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8000/0x6b58994c2cbdcb14 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.559425:0:13815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8000/0x6b58994c2cbdcb14 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.559430:0:13815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b014b8000 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071508.559435:0:13815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8000/0x6b58994c2cbdcb14 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.559442:0:13815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8000/0x6b58994c2cbdcb14 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.559454:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f8a021bdc00) 00010000:00010000:3.0:1783071508.559457:0:13815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071508.559461:0:13815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8000/0x6b58994c2cbdcb14 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.559467:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8000/0x6b58994c2cbdcb14 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.559478:0:13815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9400/0x6b58994c2cbdcb1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.559484:0:13815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9400/0x6b58994c2cbdcb1b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.559490:0:13815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9400/0x6b58994c2cbdcb1b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.559505:0:13815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b014b9400 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071508.559508:0:13815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9400/0x6b58994c2cbdcb1b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.559514:0:13815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9400/0x6b58994c2cbdcb1b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.559522:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f8a021bd500) 00010000:00010000:3.0:1783071508.559525:0:13815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071508.559527:0:13815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9400/0x6b58994c2cbdcb1b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.559533:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9400/0x6b58994c2cbdcb1b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.559568:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdcb0d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98fc5 expref: 42 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.559580:0:13815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9600/0x6b58994c2cbdcb22 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98fc5 expref: 41 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.559587:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f8b10db4800) 00010000:00010000:3.0:1783071508.559590:0:13815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783071508.559592:0:13815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b014b9600, rc 0) 00000100:00100000:3.0:1783071508.559726:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+41:12245:x1869685692902400:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1086us (1283us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1783071508.559733:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 165 00000100:00100000:3.0:1783071508.565226:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071508.565574:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692902528 00000100:00100000:1.0:1783071508.565593:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692902528 00000100:00100000:1.0:1783071508.565668:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 166 00000100:00100000:1.0:1783071508.565681:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03bd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+41:12245:x1869685692902528:12345-192.168.204.38@tcp:54:lfs.0 00010000:00010000:1.0:1783071508.565884:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d8600/0x6b58994c2cbdcb30 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071508.565901:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d8600/0x6b58994c2cbdcb30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071508.565912:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d8600/0x6b58994c2cbdcb30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071508.565955:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d8600/0x6b58994c2cbdcb30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071508.565962:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d8600/0x6b58994c2cbdcb30 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071508.565968:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d8600/0x6b58994c2cbdcb30 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071508.565973:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b421d8600 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:1.0:1783071508.565977:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d8600/0x6b58994c2cbdcb30 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071508.565984:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d8600/0x6b58994c2cbdcb30 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071508.566107:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f8b10db4800) 00010000:00010000:1.0:1783071508.566111:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783071508.566116:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d8600/0x6b58994c2cbdcb30 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071508.566122:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d8600/0x6b58994c2cbdcb30 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071508.566208:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03bd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+41:12245:x1869685692902528:12345-192.168.204.38@tcp:54:lfs.0 Request processed in 529us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071508.566216:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 166 00000100:00100000:1.0:1783071508.569404:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071508.569503:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692902784 00000100:00100000:2.0:1783071508.569513:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692902784 00000100:00100000:2.0:1783071508.572494:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 41 00000100:00100000:2.0:1783071508.572536:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+41:12245:x1869685692902784:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1783071508.573126:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+42:12245:x1869685692902784:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 607us (3728us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1783071508.576089:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 41 00010000:00010000:0.0:1783071508.739699:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071508.756349:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071508.756414:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692902912 00000100:00100000:2.0:1783071508.756423:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071508.756426:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692902912 00000100:00100000:3.0:1783071508.756499:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 383 00000100:00100000:0.0:1783071508.756500:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692903168 00000100:00100000:0.0:1783071508.756507:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692903168 00000100:00100000:3.0:1783071508.756516:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b18684850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:2406:x1869685692902912:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1783071508.756569:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 297 00000100:00100000:0.0:1783071508.756592:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03ad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+5:2406:x1869685692903168:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1783071508.756596:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b18684850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:2406:x1869685692902912:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 83us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071508.756616:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 383 00000100:00100000:0.0:1783071508.756652:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03ad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+5:2406:x1869685692903168:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 64us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071508.756659:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 297 00000100:00080000:2.0:1783071508.756866:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783071508.761805:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071508.761913:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071508.761957:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071508.762033:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692903680 00000100:00100000:2.0:1783071508.762043:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692903680 00000100:00100000:2.0:1783071508.762109:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692903040 00000100:00100000:2.0:1783071508.762112:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692903040 00000100:00100000:2.0:1783071508.762135:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 298 00000100:00100000:2.0:1783071508.762146:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2406:x1869685692903680:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1783071508.762235:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2406:x1869685692903680:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 77us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071508.762243:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 298 00000100:00100000:2.0:1783071508.762262:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 299 00000100:00100000:2.0:1783071508.762270:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03bd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+42:2405:x1869685692903040:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1783071508.762305:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03bd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+42:2405:x1869685692903040:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 35us (347us total) trans 0 rc 0/0 00000100:00080000:3.0:1783071508.762306:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783071508.762315:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 299 00000100:00100000:2.0:1783071508.762355:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071508.766172:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071508.766354:0:8910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692903424 00000100:00100000:0.0:1783071508.766407:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692903552 00000100:00100000:0.0:1783071508.766414:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692903552 00000100:00100000:0.0:1783071508.766471:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 300 00000100:00100000:0.0:1783071508.766480:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2405:x1869685692903552:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1783071508.766548:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2405:x1869685692903552:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 69us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071508.766555:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 300 00000100:00100000:3.0:1783071508.766826:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692903296 00000100:00100000:3.0:1783071508.766831:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692903296 00000100:00100000:3.0:1783071508.766885:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 141 00000100:00100000:3.0:1783071508.766895:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf7532e4-6153-424a-9f4e-84941256b41f+6:2405:x1869685692903296:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1783071508.766929:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf7532e4-6153-424a-9f4e-84941256b41f+6:2405:x1869685692903296:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 36us (4572us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071508.766936:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 141 00000100:00080000:2.0:1783071508.767226:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783071508.770328:0:8910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692903424 00000100:00100000:1.0:1783071508.770458:0:8910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 142 00000100:00100000:1.0:1783071508.770471:0:8910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03bd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf7532e4-6153-424a-9f4e-84941256b41f+7:2406:x1869685692903424:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1783071508.771342:0:8910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03bd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf7532e4-6153-424a-9f4e-84941256b41f+7:2406:x1869685692903424:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 870us (9542us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071508.771352:0:8910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 142 00000100:00100000:2.0:1783071508.871792:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071508.873002:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692903936 00000100:00100000:3.0:1783071508.873015:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692903936 00000100:00100000:3.0:1783071508.873149:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 167 00000100:00100000:3.0:1783071508.873163:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03ad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+42:12276:x1869685692903936:12345-192.168.204.38@tcp:101:cat.0 00010000:00010000:3.0:1783071508.873185:0:10292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071508.873210:0:10292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdcb37 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98fcc expref: -99 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.873320:0:10292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9400/0x6b58994c2cbdcb3e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.873355:0:10292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9400/0x6b58994c2cbdcb3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.873385:0:10292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9400/0x6b58994c2cbdcb3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783071508.873399:0:10292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1783071508.873539:0:10292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdcb37 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98fcc expref: 45 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.873559:0:10292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9400/0x6b58994c2cbdcb3e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98fcc expref: 44 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.873567:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f8b10db4800) 00010000:00010000:3.0:1783071508.873571:0:10292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783071508.873575:0:10292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b014b9400, rc 0) 00000100:00100000:3.0:1783071508.873722:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03ad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+44:12276:x1869685692903936:12345-192.168.204.38@tcp:101:cat.0 Request processed in 561us (1939us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1783071508.873730:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 167 00000100:00100000:0.0:1783071508.880756:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071508.880840:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071508.882181:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692904320 00000100:00100000:2.0:1783071508.882194:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692904320 00000100:00100000:2.0:1783071508.882270:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 42 00000100:00100000:2.0:1783071508.882281:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+44:12276:x1869685692904320:12345-192.168.204.38@tcp:35:cat.0 00000100:00100000:2.0:1783071508.882648:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+45:12276:x1869685692904320:12345-192.168.204.38@tcp:35:cat.0 Request processed in 368us (1807us total) trans 4294967440 rc 0/0 00000100:00100000:2.0:1783071508.882674:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 42 00000100:00100000:1.0:1783071508.882938:0:7923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692904064 00000100:00100000:1.0:1783071508.882944:0:7923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692904064 00000100:00100000:1.0:1783071508.882990:0:7923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 12 00000100:00100000:1.0:1783071508.882999:0:7923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b98380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf7532e4-6153-424a-9f4e-84941256b41f+45:2404:x1869685692904064:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783071508.883011:0:7923:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071508.883033:0:7923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9400/0x6b58994c2cbdcb3e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98fcc expref: 45 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071508.883051:0:7923:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f8b10db4800) 00010000:00010000:1.0:1783071508.883056:0:7923:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071508.883081:0:7923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b98380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf7532e4-6153-424a-9f4e-84941256b41f+44:2404:x1869685692904064:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 84us (2336us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071508.883088:0:7923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 12 00000100:00100000:0.0:1783071508.945492:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071508.945620:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692904576 00000100:00100000:3.0:1783071508.945631:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692904576 00000100:00100000:3.0:1783071508.945693:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 168 00000100:00100000:3.0:1783071508.945704:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+44:12282:x1869685692904576:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:3.0:1783071508.945729:0:13815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071508.945731:0:13815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1783071508.945758:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdcaa4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98fa2 expref: 44 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.945789:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f8a021bdc00) 00010000:00010000:3.0:1783071508.945794:0:13815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783071508.945808:0:13815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8000/0x6b58994c2cbdcb4c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98fd3 expref: -99 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.945913:0:13815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdcb53 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.945928:0:13815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9600/0x6b58994c2cbdcb22 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98fc5 expref: 44 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.945935:0:13815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdcb53 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.945967:0:13815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9600/0x6b58994c2cbdcb22 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98fc5 expref: 44 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.945980:0:13815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9600/0x6b58994c2cbdcb22 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98fc5 expref: 44 pid: 13815 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071508.945994:0:13815:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03bd0700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13815:1869685707645824:192.168.204.38@tcp:104: 00000100:00100000:3.0:1783071508.946097:0:13815:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0324fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1783071508.954017:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071508.954100:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692904704 00000100:00100000:0.0:1783071508.954109:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692904704 00010000:00010000:0.0:1783071508.954167:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9600/0x6b58994c2cbdcb22 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98fc5 expref: 45 pid: 13815 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071508.954210:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 84 00000100:00100000:0.0:1783071508.954220:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab88050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf7532e4-6153-424a-9f4e-84941256b41f+45:2405:x1869685692904704:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783071508.954235:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071508.954242:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9600/0x6b58994c2cbdcb22 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98fc5 expref: 45 pid: 13815 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071508.954254:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9600/0x6b58994c2cbdcb22 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98fc5 expref: 45 pid: 13815 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071508.954276:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f8b10db4800) 00010000:00010000:0.0:1783071508.954281:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdcb53 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071508.954291:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdcb53 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071508.954298:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdcb53 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071508.954316:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071508.954391:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab88050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf7532e4-6153-424a-9f4e-84941256b41f+45:2405:x1869685692904704:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 171us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071508.954399:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 84 00010000:00010000:3.0:1783071508.957945:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9600/0x6b58994c2cbdcb22 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98fc5 expref: 44 pid: 13815 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071508.957973:0:13815:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03bd0700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13815:1869685707645824:192.168.204.38@tcp:104: 00010000:00010000:3.0:1783071508.958015:0:13815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdcb53 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.958025:0:13815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdcb53 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.958031:0:13815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdcb53 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783071508.958054:0:13815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1783071508.958217:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8000/0x6b58994c2cbdcb4c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98fd3 expref: 45 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.958232:0:13815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdcb53 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98fd3 expref: 44 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.958241:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f8b10db4800) 00010000:00010000:3.0:1783071508.958244:0:13815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783071508.958248:0:13815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b014b8c00, rc 0) 00000100:00100000:3.0:1783071508.958319:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+44:12282:x1869685692904576:12345-192.168.204.38@tcp:101:dd.0 Request processed in 12616us (12835us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1783071508.958328:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 168 00000100:00100000:2.0:1783071508.964888:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071508.964976:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692904832 00000100:00100000:3.0:1783071508.964987:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692904832 00000100:00100000:3.0:1783071508.965047:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 169 00000100:00100000:3.0:1783071508.965056:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03ad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+44:12282:x1869685692904832:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:3.0:1783071508.965079:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071508.965097:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8000/0x6b58994c2cbdcb61 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98fda expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.965253:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9600/0x6b58994c2cbdcb68 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.965268:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9600/0x6b58994c2cbdcb68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.965279:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9600/0x6b58994c2cbdcb68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071508.969910:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8000/0x6b58994c2cbdcb61 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98fda expref: 46 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071508.970018:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9600/0x6b58994c2cbdcb68 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98fda expref: 45 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071508.970029:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f8b10db4800) 00010000:00010000:2.0:1783071508.970033:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783071508.970036:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b014b9600, rc 0) 00000100:00100000:2.0:1783071508.970248:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03ad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+45:12282:x1869685692904832:12345-192.168.204.38@tcp:101:dd.0 Request processed in 5191us (5367us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071508.970257:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 169 00000100:00100000:1.0:1783071508.974883:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071508.975073:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692905088 00000100:00100000:3.0:1783071508.975085:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692905088 00000100:00100000:3.0:1783071508.975157:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 170 00000100:00100000:3.0:1783071508.975169:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+45:12282:x1869685692905088:12345-192.168.204.38@tcp:36:dd.0 00010000:00010000:3.0:1783071508.975427:0:10292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8000/0x6b58994c2cbdcb6f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.975445:0:10292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8000/0x6b58994c2cbdcb6f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.975456:0:10292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8000/0x6b58994c2cbdcb6f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783071508.975496:0:10292:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:3.0:1783071508.975520:0:10292:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000084988841 reply state 000000005e34fb3b transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8000/0x6b58994c2cbdcb6f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.975532:0:10292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8000/0x6b58994c2cbdcb6f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.975539:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f8b10db4800) 00010000:00010000:3.0:1783071508.975556:0:10292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783071508.975559:0:10292:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783071508.977348:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+48:12282:x1869685692905088:12345-192.168.204.38@tcp:36:dd.0 Request processed in 2170us (2464us total) trans 4294967443 rc 0/0 00000100:00100000:3.0:1783071508.977360:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 170 00000020:00080000:3.0:1783071508.977380:0:10292:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1783071509.347057:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071509.347175:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692905216 00000100:00100000:3.0:1783071509.347186:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692905216 00000100:00100000:3.0:1783071509.347265:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 171 00000100:00100000:3.0:1783071509.347278:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+48:12296:x1869685692905216:12345-192.168.204.38@tcp:101:stat.0 00010000:00010000:3.0:1783071509.347303:0:13815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071509.347326:0:13815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9400/0x6b58994c2cbdcb76 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98fe1 expref: -99 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.347443:0:13815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdcb7d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.347459:0:13815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdcb7d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.347472:0:13815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdcb7d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.347482:0:13815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdcb84 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.347489:0:13815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdcb84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.347495:0:13815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdcb84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.347589:0:13815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdcb8b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.347611:0:13815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdcb53 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98fd3 expref: 49 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.347620:0:13815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdcb8b lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.347655:0:13815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdcb53 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98fd3 expref: 49 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.347808:0:13815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdcb53 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98fd3 expref: 49 pid: 13815 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071509.347821:0:13815:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03bd0700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13815:1869685707645952:192.168.204.38@tcp:104: 00000100:00080000:2.0:1783071509.347960:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783071509.348028:0:13815:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0324fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1783071509.357754:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071509.357969:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692905472 00000100:00100000:0.0:1783071509.357981:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692905472 00000100:00100000:0.0:1783071509.358055:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 43 00000100:00100000:0.0:1783071509.358067:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03ad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+50:6637:x1869685692905472:12345-192.168.204.38@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1783071509.358453:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03ad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+51:6637:x1869685692905472:12345-192.168.204.38@tcp:35:ldlm_bl.0 Request processed in 389us (712us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1783071509.358462:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 43 00000100:00100000:3.0:1783071509.359269:0:13815:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03bd0700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13815:1869685707645952:192.168.204.38@tcp:104: 00010000:00010000:3.0:1783071509.359296:0:13815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdcb8b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071509.361491:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071509.361590:0:7923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692905600 00000100:00100000:2.0:1783071509.361609:0:7923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692905600 00010000:00010000:2.0:1783071509.361678:0:7923:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdcb53 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98fd3 expref: 51 pid: 13815 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071509.361721:0:7923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 85 00000100:00100000:2.0:1783071509.361731:0:7923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a9df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf7532e4-6153-424a-9f4e-84941256b41f+51:2406:x1869685692905600:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783071509.361746:0:7923:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071509.361754:0:7923:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdcb53 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98fd3 expref: 51 pid: 13815 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071509.361782:0:7923:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdcb53 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98fd3 expref: 51 pid: 13815 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071509.361805:0:7923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8c00/0x6b58994c2cbdcb53 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98fd3 expref: 51 pid: 13815 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071509.361823:0:7923:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f8b10db4800) 00010000:00010000:2.0:1783071509.361828:0:7923:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdcb8b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071509.361838:0:7923:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdcb8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071509.361847:0:7923:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdcb8b lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071509.362078:0:7923:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071509.362150:0:7923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a9df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf7532e4-6153-424a-9f4e-84941256b41f+50:2406:x1869685692905600:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 418us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071509.362158:0:7923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 85 00010000:00010000:3.0:1783071509.363186:0:13815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdcb8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.363199:0:13815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdcb8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783071509.363258:0:13815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1783071509.363274:0:13815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783071509.363300:0:13815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdcb8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.363315:0:13815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdcb8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.363327:0:13815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdcb7d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.363333:0:13815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdcb7d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.363341:0:13815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdcb7d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.363347:0:13815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01749600 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071509.363351:0:13815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdcb7d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.363358:0:13815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdcb7d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.367199:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f8a021bdc00) 00010000:00010000:3.0:1783071509.367204:0:13815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071509.367212:0:13815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdcb7d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.367221:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdcb7d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.367243:0:13815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdcb84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.367273:0:13815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdcb84 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.367279:0:13815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdcb84 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.367284:0:13815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01749400 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071509.367288:0:13815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdcb84 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.367296:0:13815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdcb84 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.367304:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f8a021bd500) 00010000:00010000:3.0:1783071509.367307:0:13815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071509.367310:0:13815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdcb84 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.367316:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdcb84 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.367404:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9400/0x6b58994c2cbdcb76 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98fe1 expref: 50 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.367425:0:13815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdcb8b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98fe1 expref: 49 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.367432:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f8b10db4800) 00010000:00010000:3.0:1783071509.367434:0:13815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783071509.367444:0:13815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a01748000, rc 0) 00000100:00100000:3.0:1783071509.367532:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+49:12296:x1869685692905216:12345-192.168.204.38@tcp:101:stat.0 Request processed in 20257us (20483us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071509.367541:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 171 00000100:00100000:1.0:1783071509.429775:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071509.429900:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692905856 00000100:00100000:2.0:1783071509.429909:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692905856 00000100:00100000:2.0:1783071509.429971:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 172 00000100:00100000:2.0:1783071509.429988:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+49:12302:x1869685692905856:12345-192.168.204.38@tcp:36:truncate.0 00010000:00010000:2.0:1783071509.430049:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071509.430081:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdcb8b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98fe1 expref: 49 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071509.430120:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f8b10db4800) 00010000:00010000:2.0:1783071509.430126:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783071509.430345:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdcb92 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071509.430416:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdcb92 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071509.430429:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdcb92 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783071509.430475:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:2.0:1783071509.430494:0:6516:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003429c8f9 reply state 00000000a58badaf transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdcb92 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071509.430507:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdcb92 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071509.430514:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f8b10db4800) 00010000:00010000:2.0:1783071509.430517:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783071509.430519:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783071509.430635:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+51:12302:x1869685692905856:12345-192.168.204.38@tcp:36:truncate.0 Request processed in 646us (869us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1783071509.430643:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 172 00000020:00080000:2.0:1783071509.430647:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1783071509.600989:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071509.601079:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692905984 00000100:00100000:3.0:1783071509.601088:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692905984 00000100:00100000:3.0:1783071509.601150:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 173 00000100:00100000:3.0:1783071509.601161:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+51:12316:x1869685692905984:12345-192.168.204.38@tcp:101:stat.0 00010000:00010000:3.0:1783071509.601195:0:10292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071509.601216:0:10292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdcb99 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98fe8 expref: -99 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.601306:0:10292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdcba0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.601321:0:10292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdcba0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.601333:0:10292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdcba0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.601344:0:10292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdcba7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.601351:0:10292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdcba7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.601357:0:10292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdcba7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.601480:0:10292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdcbae lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.601498:0:10292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdcbae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.601506:0:10292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdcbae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783071509.601548:0:10292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1783071509.601552:0:10292:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783071509.601571:0:10292:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdcbae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.601582:0:10292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdcbae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.601604:0:10292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdcba0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.601611:0:10292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdcba0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.601618:0:10292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdcba0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.601933:0:10292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01749600 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071509.601938:0:10292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdcba0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.601946:0:10292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdcba0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.601958:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f8a021bdc00) 00010000:00010000:3.0:1783071509.601968:0:10292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071509.601973:0:10292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdcba0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.601979:0:10292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdcba0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.601992:0:10292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdcba7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.601998:0:10292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdcba7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.602003:0:10292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdcba7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.602008:0:10292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01749c00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071509.602010:0:10292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdcba7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.602016:0:10292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdcba7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.602023:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f8a021bd500) 00010000:00010000:3.0:1783071509.602025:0:10292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071509.602028:0:10292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdcba7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.602033:0:10292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdcba7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.602061:0:10292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdcb99 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98fe8 expref: 53 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.602091:0:10292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdcbae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98fe8 expref: 52 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.602098:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f8b10db4800) 00010000:00010000:3.0:1783071509.602100:0:10292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783071509.602103:0:10292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a01749e00, rc 0) 00000100:00100000:3.0:1783071509.602271:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+52:12316:x1869685692905984:12345-192.168.204.38@tcp:101:stat.0 Request processed in 1111us (1290us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071509.602279:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 173 00000100:00100000:3.0:1783071509.710490:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071509.710624:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692906240 00000100:00100000:0.0:1783071509.710636:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692906240 00000100:00100000:0.0:1783071509.710712:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 174 00000100:00100000:0.0:1783071509.710723:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03bd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+52:12326:x1869685692906240:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1783071509.710746:0:13815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071509.710767:0:13815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864000/0x6b58994c2cbdcbb5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98fef expref: -99 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783071509.710879:0:13815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1783071509.710998:0:13815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864000/0x6b58994c2cbdcbb5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98fef expref: 54 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071509.711012:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8a021bd600) 00010000:00010000:0.0:1783071509.711027:0:13815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783071509.711034:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864000/0x6b58994c2cbdcbb5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98fef expref: 54 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071509.711049:0:13815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a03864000, rc 0) 00000100:00100000:0.0:1783071509.711118:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03bd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+53:12326:x1869685692906240:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 398us (639us total) trans 4294967447 rc 301/301 00000100:00100000:0.0:1783071509.711141:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 174 00000100:00100000:0.0:1783071509.714016:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071509.714215:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692906496 00000100:00100000:3.0:1783071509.714225:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692906496 00000100:00100000:3.0:1783071509.714294:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 44 00000100:00100000:3.0:1783071509.714309:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0699d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+53:12326:x1869685692906496:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1783071509.714686:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0699d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+54:12326:x1869685692906496:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 378us (676us total) trans 4294967448 rc 0/0 00000100:00100000:3.0:1783071509.714695:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 44 00010000:00010000:2.0:1783071509.762580:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071509.782886:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071509.783101:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692906752 00000100:00100000:0.0:1783071509.783110:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692906752 00000100:00100000:0.0:1783071509.783183:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 175 00000100:00100000:0.0:1783071509.783195:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+54:12332:x1869685692906752:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:0.0:1783071509.783221:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071509.783243:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864000/0x6b58994c2cbdcbc3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98ff6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071509.783352:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdcbca lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071509.783547:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdcbae lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98fe8 expref: 55 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071509.783558:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdcbca lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071509.783604:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdcbae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98fe8 expref: 55 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071509.783618:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdcbae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98fe8 expref: 55 pid: 10292 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071509.783632:0:6517:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03b9aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1869685707646080:192.168.204.38@tcp:104: 00000100:00100000:0.0:1783071509.783773:0:6517:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b10119b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783071509.786559:0:6517:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03b9aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1869685707646080:192.168.204.38@tcp:104: 00010000:00010000:0.0:1783071509.786601:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdcbca lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071509.787243:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071509.787649:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692906880 00000100:00100000:0.0:1783071509.787657:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692906880 00010000:00010000:0.0:1783071509.787700:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdcbae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98fe8 expref: 56 pid: 10292 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071509.787740:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 86 00000100:00100000:0.0:1783071509.787750:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a9f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf7532e4-6153-424a-9f4e-84941256b41f+56:2405:x1869685692906880:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783071509.787763:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071509.787770:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdcbae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98fe8 expref: 56 pid: 10292 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071509.787904:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdcbae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98fe8 expref: 56 pid: 10292 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071509.787931:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdcbae lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98fe8 expref: 56 pid: 10292 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071509.787948:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f8b10db4800) 00010000:00010000:0.0:1783071509.787952:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdcbca lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071509.787962:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdcbca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071509.787970:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdcbca lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071509.788206:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071509.788270:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a9f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf7532e4-6153-424a-9f4e-84941256b41f+55:2405:x1869685692906880:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 520us (1027us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071509.788278:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 86 00010000:00010000:2.0:1783071509.788327:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdcbca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071509.788334:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdcbca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071509.788360:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1783071509.788612:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864000/0x6b58994c2cbdcbc3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ff6 expref: 56 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071509.788629:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdcbca lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ff6 expref: 55 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071509.788636:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f8b10db4800) 00010000:00010000:2.0:1783071509.788639:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783071509.788641:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a03865600, rc 0) 00000100:00100000:2.0:1783071509.788669:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+55:12332:x1869685692906752:12345-192.168.204.38@tcp:101:bash.0 Request processed in 5478us (5792us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1783071509.788676:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 175 00000100:00100000:1.0:1783071509.796207:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071509.796326:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692907136 00000100:00100000:2.0:1783071509.796338:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692907136 00000100:00100000:2.0:1783071509.796641:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 176 00000100:00100000:2.0:1783071509.796652:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+55:12332:x1869685692907136:12345-192.168.204.38@tcp:36:bash.0 00010000:00010000:2.0:1783071509.796925:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66400/0x6b58994c2cbdcbd8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071509.796945:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66400/0x6b58994c2cbdcbd8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071509.796957:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66400/0x6b58994c2cbdcbd8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783071509.797021:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:2.0:1783071509.797067:0:6518:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000056de04d4 reply state 0000000050bd545f transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66400/0x6b58994c2cbdcbd8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071509.797081:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66400/0x6b58994c2cbdcbd8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071509.797089:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f8b10db4800) 00010000:00010000:2.0:1783071509.797091:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783071509.797095:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783071509.797249:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+58:12332:x1869685692907136:12345-192.168.204.38@tcp:36:bash.0 Request processed in 597us (1055us total) trans 4294967451 rc 0/0 00000100:00100000:2.0:1783071509.797257:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 176 00000020:00080000:2.0:1783071509.797263:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1783071509.804861:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071509.804983:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692907264 00000100:00100000:2.0:1783071509.804992:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692907264 00000100:00100000:2.0:1783071509.805112:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 177 00000100:00100000:2.0:1783071509.805123:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+58:12332:x1869685692907264:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:2.0:1783071509.805148:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071509.805168:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdcbdf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d98ffd expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071509.805265:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdcbe6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071509.805282:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdcbca lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ff6 expref: 59 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071509.805291:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdcbe6 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071509.805328:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdcbca lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ff6 expref: 59 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071509.805351:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdcbca lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ff6 expref: 59 pid: 6517 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071509.805392:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03ad4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6516:1869685707646208:192.168.204.38@tcp:104: 00000100:00100000:2.0:1783071509.805492:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a038bcb40 going to sleep for 11 seconds 00000100:00100000:1.0:1783071509.812716:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071509.812810:0:7923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692907392 00000100:00100000:3.0:1783071509.812820:0:7923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692907392 00010000:00010000:3.0:1783071509.812863:0:7923:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdcbca lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ff6 expref: 60 pid: 6517 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071509.812906:0:7923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 87 00000100:00100000:3.0:1783071509.812916:0:7923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a9e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf7532e4-6153-424a-9f4e-84941256b41f+60:2405:x1869685692907392:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783071509.812936:0:7923:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071509.812959:0:7923:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdcbca lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ff6 expref: 60 pid: 6517 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.812973:0:7923:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdcbca lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ff6 expref: 60 pid: 6517 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.812996:0:7923:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f8b10db4800) 00010000:00010000:3.0:1783071509.813001:0:7923:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdcbe6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.813011:0:7923:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdcbe6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.813018:0:7923:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdcbe6 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.813036:0:7923:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783071509.813096:0:7923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a9e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf7532e4-6153-424a-9f4e-84941256b41f+60:2405:x1869685692907392:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 181us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071509.813103:0:7923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 87 00010000:00010000:2.0:1783071509.813916:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdcbca lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ff6 expref: 59 pid: 6517 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071509.813936:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03ad4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6516:1869685707646208:192.168.204.38@tcp:104: 00010000:00010000:2.0:1783071509.813958:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdcbe6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071509.813968:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdcbe6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071509.813974:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdcbe6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071509.814029:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1783071509.814035:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783071509.814057:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdcbe6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071509.814088:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdcbdf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ffd expref: 59 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071509.814103:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdcbe6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ffd expref: 58 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071509.814121:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f8b10db4800) 00010000:00010000:2.0:1783071509.814123:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783071509.814126:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b2fd66600, rc 0) 00000100:00100000:2.0:1783071509.816017:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+58:12332:x1869685692907264:12345-192.168.204.38@tcp:101:bash.0 Request processed in 10884us (11155us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071509.816028:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 177 00000100:00100000:1.0:1783071509.823449:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071509.823960:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692907648 00000100:00100000:2.0:1783071509.823970:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692907648 00000100:00100000:2.0:1783071509.824034:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 45 00000100:00100000:2.0:1783071509.824044:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+58:12332:x1869685692907648:12345-192.168.204.38@tcp:35:bash.0 00000100:00100000:2.0:1783071509.824276:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+59:12332:x1869685692907648:12345-192.168.204.38@tcp:35:bash.0 Request processed in 233us (837us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1783071509.824285:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 45 00000100:00100000:1.0:1783071509.915133:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071509.915247:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692907904 00000100:00100000:2.0:1783071509.915257:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692907904 00000100:00100000:2.0:1783071509.915324:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 178 00000100:00100000:2.0:1783071509.915334:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+59:12342:x1869685692907904:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1783071509.915359:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071509.915415:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdcbed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d99004 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071509.915517:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1783071509.915639:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdcbed lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99004 expref: 61 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071509.915673:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8a021bd600) 00010000:00010000:2.0:1783071509.915676:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783071509.915682:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdcbed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99004 expref: 61 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071509.915697:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b2fd67600, rc 0) 00000100:00100000:2.0:1783071509.915752:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+60:12342:x1869685692907904:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 419us (628us total) trans 4294967453 rc 301/301 00000100:00100000:2.0:1783071509.915759:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 178 00000100:00100000:1.0:1783071509.919961:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071509.920050:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692908032 00000100:00100000:2.0:1783071509.920061:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692908032 00000100:00100000:2.0:1783071509.920129:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 179 00000100:00100000:2.0:1783071509.920140:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+60:12342:x1869685692908032:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:2.0:1783071509.920218:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66e00/0x6b58994c2cbdcbfb lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071509.920237:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66e00/0x6b58994c2cbdcbfb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071509.920248:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66e00/0x6b58994c2cbdcbfb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071509.920261:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdcc02 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071509.920269:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdcc02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071509.920297:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdcc02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071509.920424:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdcc09 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071509.920434:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdcc09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071509.920441:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdcc09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783071509.920492:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdcc09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071509.920507:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66e00/0x6b58994c2cbdcbfb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071509.920513:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66e00/0x6b58994c2cbdcbfb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071509.920520:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66e00/0x6b58994c2cbdcbfb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071509.920527:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd66e00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:2.0:1783071509.920531:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66e00/0x6b58994c2cbdcbfb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071509.920539:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66e00/0x6b58994c2cbdcbfb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071509.920552:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f8a021bdc00) 00010000:00010000:2.0:1783071509.920560:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071509.920566:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66e00/0x6b58994c2cbdcbfb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071509.920573:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66e00/0x6b58994c2cbdcbfb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071509.920596:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdcc02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071509.920602:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdcc02 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071509.920608:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdcc02 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071509.920613:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd67400 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:2.0:1783071509.920616:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdcc02 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071509.920623:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdcc02 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071509.920630:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f8a021bd500) 00010000:00010000:2.0:1783071509.920632:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071509.920635:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdcc02 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071509.920640:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdcc02 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071509.920650:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdcc09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071509.920673:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdcc09 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071509.920681:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdcc09 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071509.920686:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd67200 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:2.0:1783071509.920689:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdcc09 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071509.920695:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdcc09 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071509.920703:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f8b10db4800) 00010000:00010000:2.0:1783071509.920705:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071509.920708:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdcc09 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071509.920713:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdcc09 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071509.920791:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+60:12342:x1869685692908032:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 652us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071509.921172:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 179 00000100:00100000:1.0:1783071509.929724:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071509.929855:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692908288 00000100:00100000:3.0:1783071509.929865:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692908288 00000100:00100000:3.0:1783071509.929925:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 46 00000100:00100000:3.0:1783071509.929936:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+60:12342:x1869685692908288:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1783071509.930181:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+61:12342:x1869685692908288:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 247us (466us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1783071509.930189:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 46 00000100:00100000:1.0:1783071509.998026:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071509.998281:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692908544 00000100:00100000:3.0:1783071509.998291:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692908544 00000100:00100000:3.0:1783071509.998402:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 180 00000100:00100000:3.0:1783071509.998412:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+61:12345:x1869685692908544:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1783071509.998438:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071509.998459:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdcc10 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d9900b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.998552:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdcc17 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.998568:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdcc17 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.998579:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdcc17 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.998601:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdcc1e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.998609:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdcc1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.998616:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdcc1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.998742:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdcc25 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.998752:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdcc25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.998759:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdcc25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783071509.998781:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1783071509.998865:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdcc17 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.998872:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdcc17 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.998879:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdcc17 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.998885:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01749c00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071509.998889:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdcc17 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.998896:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdcc17 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.998908:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f8a021bdc00) 00010000:00010000:3.0:1783071509.998911:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071509.998915:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdcc17 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.998921:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdcc17 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.998933:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdcc1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.998939:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdcc1e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.998954:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdcc1e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.998959:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01749600 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071509.998962:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdcc1e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.998968:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdcc1e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.998976:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f8a021bd500) 00010000:00010000:3.0:1783071509.998978:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071509.998981:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdcc1e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.998987:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdcc1e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.999038:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdcc10 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9900b expref: 64 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.999053:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdcc25 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9900b expref: 63 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071509.999059:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f8b10db4800) 00010000:00010000:3.0:1783071509.999061:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783071509.999064:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a01749000, rc 0) 00000100:00100000:3.0:1783071509.999131:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+63:12345:x1869685692908544:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 720us (1123us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1783071509.999148:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 180 00000100:00100000:1.0:1783071510.004081:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071510.004411:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692908800 00000100:00100000:0.0:1783071510.004421:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692908800 00000100:00100000:0.0:1783071510.004478:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 181 00000100:00100000:0.0:1783071510.004488:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+63:12345:x1869685692908800:12345-192.168.204.38@tcp:54:lfs.0 00010000:00010000:0.0:1783071510.004569:0:13815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865200/0x6b58994c2cbdcc33 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.004596:0:13815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865200/0x6b58994c2cbdcc33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.004610:0:13815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865200/0x6b58994c2cbdcc33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.004646:0:13815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865200/0x6b58994c2cbdcc33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.004654:0:13815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865200/0x6b58994c2cbdcc33 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.004671:0:13815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865200/0x6b58994c2cbdcc33 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.004678:0:13815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03865200 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:0.0:1783071510.004683:0:13815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865200/0x6b58994c2cbdcc33 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.004707:0:13815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865200/0x6b58994c2cbdcc33 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.004719:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f8b10db4800) 00010000:00010000:0.0:1783071510.004722:0:13815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783071510.004727:0:13815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865200/0x6b58994c2cbdcc33 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.004732:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865200/0x6b58994c2cbdcc33 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071510.004800:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+63:12345:x1869685692908800:12345-192.168.204.38@tcp:54:lfs.0 Request processed in 313us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071510.004808:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 181 00000100:00100000:1.0:1783071510.008077:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071510.009305:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071510.009487:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692909056 00000100:00100000:0.0:1783071510.009497:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692909056 00000100:00100000:0.0:1783071510.009560:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 47 00000100:00100000:0.0:1783071510.009570:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+63:12345:x1869685692909056:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1783071510.009820:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+64:12345:x1869685692909056:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 250us (517us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1783071510.009828:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 47 00000100:00100000:2.0:1783071510.014332:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692908672 00000100:00100000:2.0:1783071510.014348:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692908672 00000100:00100000:2.0:1783071510.014707:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 13 00000100:00100000:2.0:1783071510.014719:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a9d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf7532e4-6153-424a-9f4e-84941256b41f+64:2405:x1869685692908672:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783071510.014739:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071510.014784:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdcc25 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9900b expref: 64 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.014805:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f8b10db4800) 00010000:00010000:2.0:1783071510.014810:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071510.014880:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a9d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf7532e4-6153-424a-9f4e-84941256b41f+63:2405:x1869685692908672:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 163us (6812us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071510.014892:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 13 00000100:00100000:1.0:1783071510.197247:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071510.197402:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692909312 00000100:00100000:2.0:1783071510.197411:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692909312 00000100:00100000:2.0:1783071510.197733:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 182 00000100:00100000:2.0:1783071510.197744:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+63:12363:x1869685692909312:12345-192.168.204.38@tcp:101:cat.0 00010000:00010000:2.0:1783071510.197769:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071510.197788:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdcc3a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d99012 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.197914:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdcc41 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.197929:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdcc41 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.200668:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdcc41 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071510.200703:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1783071510.200875:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdcc3a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99012 expref: 66 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.200914:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdcc41 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99012 expref: 65 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.200923:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f8b10db4800) 00010000:00010000:2.0:1783071510.200926:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1783071510.200929:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b2fd67400, rc 0) 00000100:00100000:2.0:1783071510.201002:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+65:12363:x1869685692909312:12345-192.168.204.38@tcp:101:cat.0 Request processed in 3259us (3763us total) trans 4294967457 rc 0/0 00000100:00100000:2.0:1783071510.201012:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 182 00000100:00100000:1.0:1783071510.236606:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071510.236791:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692909440 00000100:00100000:2.0:1783071510.236800:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692909440 00000100:00100000:2.0:1783071510.236860:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 183 00000100:00100000:2.0:1783071510.236870:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+65:12364:x1869685692909440:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1783071510.236893:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071510.236915:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdcc4f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d99019 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.237166:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66e00/0x6b58994c2cbdcc56 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.237185:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66e00/0x6b58994c2cbdcc56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.237198:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66e00/0x6b58994c2cbdcc56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071510.237246:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1783071510.237273:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783071510.237293:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66e00/0x6b58994c2cbdcc56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.237318:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdcc4f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99019 expref: 67 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.237335:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66e00/0x6b58994c2cbdcc56 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99019 expref: 66 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.237344:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f8a021bdc00) 00010000:00010000:2.0:1783071510.237346:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783071510.237350:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b2fd66e00, rc 0) 00000100:00100000:2.0:1783071510.237550:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+66:12364:x1869685692909440:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 681us (970us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071510.237558:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 183 00000100:00100000:1.0:1783071510.252827:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071510.255297:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692909824 00000100:00100000:0.0:1783071510.255313:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692909824 00000100:00100000:0.0:1783071510.255406:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 48 00000100:00100000:0.0:1783071510.255419:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+66:12364:x1869685692909824:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1783071510.256242:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+67:12364:x1869685692909824:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 821us (3421us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1783071510.256269:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 48 00000100:00100000:1.0:1783071510.265646:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071510.265797:0:7923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692909952 00000100:00100000:3.0:1783071510.265808:0:7923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692909952 00000100:00100000:3.0:1783071510.265881:0:7923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 14 00000100:00100000:3.0:1783071510.265893:0:7923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf7532e4-6153-424a-9f4e-84941256b41f+67:12364:x1869685692909952:12345-192.168.204.38@tcp:103:lfs.0 00010000:00010000:3.0:1783071510.265911:0:7923:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1783071510.265936:0:7923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdcbe6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ffd expref: 67 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071510.265960:0:7923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdcc41 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99012 expref: 66 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071510.265973:0:7923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdcae3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98fb7 expref: 65 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071510.265983:0:7923:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f8b10db4800) 00010000:00010000:3.0:1783071510.265989:0:7923:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783071510.266058:0:7923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf7532e4-6153-424a-9f4e-84941256b41f+64:12364:x1869685692909952:12345-192.168.204.38@tcp:103:lfs.0 Request processed in 167us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071510.266066:0:7923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 14 00000100:00100000:1.0:1783071510.272686:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071510.272884:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692910080 00000100:00100000:3.0:1783071510.272894:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692910080 00000100:00100000:3.0:1783071510.272968:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 184 00000100:00100000:3.0:1783071510.272979:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+64:12364:x1869685692910080:12345-192.168.204.38@tcp:58:lfs.0 00010000:00010000:3.0:1783071510.273135:0:10292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdcc5d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071510.273164:0:10292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdcc5d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071510.273177:0:10292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdcc5d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783071510.273283:0:10292:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1783071510.273406:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+64:12364:x1869685692910080:12345-192.168.204.38@tcp:58:lfs.0 Request processed in 428us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071510.273415:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 184 00000100:00100000:1.0:1783071510.297754:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071510.298310:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692910208 00000100:00100000:2.0:1783071510.298321:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692910208 00000100:00100000:2.0:1783071510.298460:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 185 00000100:00100000:2.0:1783071510.298471:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+64:12366:x1869685692910208:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1783071510.298492:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071510.298515:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdcc64 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d99020 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.298638:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdcc6b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.298972:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdcc6b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.298998:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdcc6b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.299011:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdcc72 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.299037:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdcc72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.299045:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdcc72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.299126:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdcc79 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.299136:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdcc79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.299143:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdcc79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071510.299188:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1783071510.299192:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783071510.299211:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdcc79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.299224:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdcc79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.299233:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdcc6b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.299250:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdcc6b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.299257:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdcc6b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.299263:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd67600 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:2.0:1783071510.299267:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdcc6b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.299275:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdcc6b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.299288:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f8a021bdc00) 00010000:00010000:2.0:1783071510.299291:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071510.299296:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdcc6b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.299303:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdcc6b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.299317:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdcc72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.299323:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdcc72 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.299328:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdcc72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.299333:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd67c00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:2.0:1783071510.299342:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdcc72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.299348:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdcc72 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.299357:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f8a021bd500) 00010000:00010000:2.0:1783071510.299360:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071510.299414:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdcc72 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.299422:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdcc72 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.299453:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdcc64 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99020 expref: 66 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.299466:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdcc79 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99020 expref: 65 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.299473:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f8b10db4800) 00010000:00010000:2.0:1783071510.299475:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783071510.299478:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b2fd66c00, rc 0) 00000100:00100000:2.0:1783071510.299554:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+65:12366:x1869685692910208:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1084us (1809us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071510.299569:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 185 00000100:00100000:0.0:1783071510.341405:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03b99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869685707646464:0@lo:400:kworker.0 00000100:00100000:0.0:1783071510.341487:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071510.341553:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03b99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1869685707646976:0@lo:400:kworker.0 00000100:00100000:0.0:1783071510.341602:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071510.341638:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1869685707647488:0@lo:400:kworker.0 00000100:00100000:0.0:1783071510.341672:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071510.341700:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1783071510.341707:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03b9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:feaa1501-b927-4e07-baad-3200e92d7497:3648:1869685707646336:0@lo:400:kworker.0 00000100:00100000:0.0:1783071510.341734:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071510.341751:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03b99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707646848:0@lo:400:kworker.0 00000100:00100000:0.0:1783071510.341774:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071510.341796:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03b9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707647360:0@lo:400:kworker.0 00000100:00100000:0.0:1783071510.341849:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071510.341868:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c688000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707647872:0@lo:400:kworker.0 00000100:00100000:0.0:1783071510.341892:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071510.341918:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03b9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707646592:0@lo:400:kworker.0 00000100:00100000:0.0:1783071510.341940:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071510.341956:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03b99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1869685707647104:0@lo:400:kworker.0 00000100:00100000:0.0:1783071510.341975:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071510.341989:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b0ab60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1869685707647616:0@lo:400:kworker.0 00000100:00100000:0.0:1783071510.342007:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071510.342035:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1783071510.342047:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03b98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869685707646720:0@lo:400:kworker.0 00000100:00100000:0.0:1783071510.342069:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071510.342080:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03b98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707647232:0@lo:400:kworker.0 00000100:00100000:0.0:1783071510.342097:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071510.342109:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707647744:0@lo:400:kworker.0 00000100:00100000:0.0:1783071510.342137:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071510.342168:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707646848 00000100:00100000:0.0:1783071510.342175:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707646848 00000100:00100000:0.0:1783071510.342215:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707646592 00000100:00100000:0.0:1783071510.342218:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707646592 00000100:00100000:0.0:1783071510.342235:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1783071510.342242:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707646848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071510.342299:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707646848:12345-0@lo:400:kworker.0 Request processed in 56us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071510.342307:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1783071510.342326:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1783071510.342333:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707646592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071510.342385:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707646592:12345-0@lo:400:kworker.0 Request processed in 30us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071510.342392:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1783071510.342418:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707647360 00000100:00100000:0.0:1783071510.342422:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707647360 00000100:00100000:0.0:1783071510.342454:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707647872 00000100:00100000:0.0:1783071510.342459:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707647872 00000100:00100000:0.0:1783071510.342474:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707647232 00000100:00100000:0.0:1783071510.342477:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707647232 00000100:00100000:0.0:1783071510.342488:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707647744 00000100:00100000:0.0:1783071510.342490:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707647744 00000100:00100000:0.0:1783071510.342513:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1783071510.342519:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707647360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071510.342539:0:8910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1783071510.342552:0:8910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3648:x1869685707647872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071510.342557:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707647360:12345-0@lo:400:kworker.0 Request processed in 36us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071510.342564:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1783071510.342592:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1783071510.342602:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707647232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071510.342610:0:8910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3648:x1869685707647872:12345-0@lo:400:kworker.0 Request processed in 61us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071510.342618:0:8910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1783071510.342639:0:8910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1783071510.342640:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707647232:12345-0@lo:400:kworker.0 Request processed in 39us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071510.342648:0:8910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707647744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071510.342650:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1783071510.342689:0:8910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707647744:12345-0@lo:400:kworker.0 Request processed in 43us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071510.342696:0:8910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1783071510.342701:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03b98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707647232:0@lo:400:kworker.0 00000100:00100000:0.0:1783071510.342716:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707647744:0@lo:400:kworker.0 00000100:00100000:0.0:1783071510.342726:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03b9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707646592:0@lo:400:kworker.0 00000100:00100000:1.0:1783071510.342741:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707646464 00000100:00100000:1.0:1783071510.342746:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707646464 00000100:00100000:0.0:1783071510.342760:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03b80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707648000:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783071510.342786:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707646976 00000100:00100000:0.0:1783071510.342791:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071510.342792:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707646976 00000100:00100000:1.0:1783071510.342814:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707647488 00000100:00100000:1.0:1783071510.342817:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707647488 00000100:00100000:0.0:1783071510.342821:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03b99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707646848:0@lo:400:kworker.0 00000100:00100000:0.0:1783071510.342837:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03b9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707647360:0@lo:400:kworker.0 00000100:00100000:1.0:1783071510.342838:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707647104 00000100:00100000:1.0:1783071510.342843:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707647104 00000100:00100000:0.0:1783071510.342853:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c688000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707647872:0@lo:400:kworker.0 00000100:00100000:1.0:1783071510.342860:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707647616 00000100:00100000:1.0:1783071510.342865:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707647616 00000100:00100000:0.0:1783071510.342885:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707648000 00000100:00100000:0.0:1783071510.342889:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707648000 00000100:00100000:0.0:1783071510.342913:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1783071510.342919:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707648000:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783071510.342944:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1783071510.342982:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707646720 00000100:00100000:1.0:1783071510.342987:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707646720 00000100:00100000:0.0:1783071510.342994:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707648000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071510.343003:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1783071510.343008:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1783071510.343016:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c68aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869685707646464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071510.343042:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03b80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707648000:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783071510.343060:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c68aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869685707646464:12345-0@lo:400:kworker.0 Request processed in 44us (1572us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071510.343061:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03b99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869685707646464:0@lo:400:kworker.0 00000100:00100000:1.0:1783071510.343074:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1783071510.343101:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1783071510.343110:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c68bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869685707646976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071510.343147:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c68bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869685707646976:12345-0@lo:400:kworker.0 Request processed in 39us (1544us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071510.343153:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1783071510.343234:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1783071510.343241:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869685707647488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071510.343271:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869685707647488:12345-0@lo:400:kworker.0 Request processed in 31us (1598us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071510.343277:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1783071510.343327:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707646336 00000100:00100000:3.0:1783071510.343333:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707646336 00000100:00100000:3.0:1783071510.343360:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1783071510.343386:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07695850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+24:3648:x1869685707646336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071510.343425:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07695850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+24:3648:x1869685707646336:12345-0@lo:400:kworker.0 Request processed in 40us (1690us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071510.343431:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1783071510.343471:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1783071510.343478:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1869685707647104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071510.343512:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1869685707647104:12345-0@lo:400:kworker.0 Request processed in 35us (1536us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071510.343527:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00010000:00080000:3.0:1783071510.343833:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a03b99880 x1869685707647104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071510.343845:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1783071510.343847:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03b99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1869685707647104:0@lo:400:kworker.0 00000100:00100000:1.0:1783071510.343860:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1869685707647616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071510.343864:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03b9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:feaa1501-b927-4e07-baad-3200e92d7497:3648:1869685707646336:0@lo:400:kworker.0 00000100:00100000:3.0:1783071510.343879:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1783071510.343884:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03b99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1869685707646976:0@lo:400:kworker.0 00000100:00100000:0.0:1783071510.343900:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1869685707647488:0@lo:400:kworker.0 00000100:00100000:3.0:1783071510.343902:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1869685707646720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071510.343947:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1869685707646720:12345-0@lo:400:kworker.0 Request processed in 50us (1875us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071510.343954:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1783071510.343960:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03b98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869685707646720:0@lo:400:kworker.0 00000100:00100000:1.0:1783071510.344049:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1869685707647616:12345-0@lo:400:kworker.0 Request processed in 193us (2039us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071510.344056:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00080000:2.0:1783071510.344742:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783071510.344749:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783071510.344752:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783071510.344755:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783071510.345587:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b0ab60a80 x1869685707647616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071510.345602:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b0ab60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1869685707647616:0@lo:400:kworker.0 00000040:00080000:2.0:1783071510.530562:0:13796:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783071510.530582:0:13796:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783071510.530610:0:13796:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1783071510.530620:0:13796:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783071510.530773:0:13796:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03ad4000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13796:1869685707648128:192.168.204.38@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783071510.530883:0:13796:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a038bc240 going to sleep for 11 seconds 00000100:00100000:2.0:1783071510.534347:0:13796:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03ad4000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13796:1869685707648128:192.168.204.38@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783071510.539429:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071510.539478:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692910336 00000100:00100000:0.0:1783071510.539489:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692910336 00000100:00100000:0.0:1783071510.539566:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 186 00000100:00100000:0.0:1783071510.539818:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+65:12378:x1869685692910336:12345-192.168.204.38@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783071510.539857:0:6516:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783071510.540006:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+65:12378:x1869685692910336:12345-192.168.204.38@tcp:53:lhsmtool_posix.0 Request processed in 193us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071510.540015:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 186 00000100:00100000:1.0:1783071510.545194:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071510.545330:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692910464 00000100:00100000:0.0:1783071510.545664:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692910464 00000100:00100000:0.0:1783071510.545739:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 187 00000100:00100000:0.0:1783071510.545751:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+65:12378:x1869685692910464:12345-192.168.204.38@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1783071510.545830:0:13815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdcc80 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.545848:0:13815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdcc80 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.545859:0:13815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdcc80 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.545922:0:13815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdcc87 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.545931:0:13815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdcc87 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.545938:0:13815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdcc87 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.545966:0:13815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdcc8e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.545975:0:13815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdcc8e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.545981:0:13815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdcc8e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783071510.546045:0:13815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1783071510.546050:0:13815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783071510.546064:0:13815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdcc8e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.546076:0:13815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdcc80 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.546083:0:13815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdcc80 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.546090:0:13815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdcc80 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.546096:0:13815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03864e00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:0.0:1783071510.546100:0:13815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdcc80 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.546108:0:13815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdcc80 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.546121:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f8b0d17fa00) 00010000:00010000:0.0:1783071510.546124:0:13815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071510.546130:0:13815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdcc80 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.546136:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdcc80 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.546153:0:13815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdcc87 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.546168:0:13815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdcc87 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.546174:0:13815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdcc87 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.546178:0:13815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03865a00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:0.0:1783071510.546181:0:13815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdcc87 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.546187:0:13815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdcc87 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.546195:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff8f8b10db4300) 00010000:00010000:0.0:1783071510.546198:0:13815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071510.546201:0:13815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdcc87 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.546206:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdcc87 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.546718:0:13815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdcc8e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.546726:0:13815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdcc8e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.546732:0:13815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdcc8e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.546737:0:13815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03864600 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:0.0:1783071510.546748:0:13815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdcc8e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.546754:0:13815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdcc8e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.546763:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f8b10db4800) 00010000:00010000:0.0:1783071510.546765:0:13815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071510.546767:0:13815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdcc8e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.546773:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdcc8e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071510.546863:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+65:12378:x1869685692910464:12345-192.168.204.38@tcp:34:lhsmtool_posix.0 Request processed in 1113us (1675us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071510.546872:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 187 00000100:00100000:1.0:1783071510.549353:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071510.549862:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692910720 00000100:00100000:2.0:1783071510.549873:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692910720 00000100:00100000:2.0:1783071510.549940:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 188 00000100:00100000:2.0:1783071510.549950:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+65:12378:x1869685692910720:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783071510.549983:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071510.550008:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdcc95 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d99027 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.550138:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdcc9c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.550157:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdcc9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.550169:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdcc9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071510.550180:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1783071510.550266:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdcc9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.550274:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdcc9c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.550288:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdcc9c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.550294:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd67600 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:2.0:1783071510.550298:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdcc9c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.550306:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdcc9c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.550317:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f8b10db4800) 00010000:00010000:2.0:1783071510.550321:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783071510.550326:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdcc9c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.550331:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdcc9c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.550502:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdcc95 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99027 expref: 67 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.550514:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f8b0d17fa00) 00010000:00010000:2.0:1783071510.550517:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783071510.550521:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdcc95 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99027 expref: 67 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.550531:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b2fd67c00, rc 0) 00000100:00100000:2.0:1783071510.554679:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+66:12378:x1869685692910720:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 4719us (5323us total) trans 4294967459 rc 301/301 00000100:00100000:2.0:1783071510.554712:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 188 00000100:00100000:1.0:1783071510.561274:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071510.561414:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692910848 00000100:00100000:3.0:1783071510.561425:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692910848 00000100:00100000:3.0:1783071510.561484:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 189 00000100:00100000:3.0:1783071510.561494:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+66:12378:x1869685692910848:12345-192.168.204.38@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783071510.561535:0:10292:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783071510.562088:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+66:12378:x1869685692910848:12345-192.168.204.38@tcp:53:lhsmtool_posix.0 Request processed in 593us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071510.562096:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 189 00000100:00100000:1.0:1783071510.569596:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071510.569715:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692911104 00000100:00100000:0.0:1783071510.569727:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692911104 00000100:00100000:0.0:1783071510.569798:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 190 00000100:00100000:0.0:1783071510.569809:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+66:12378:x1869685692911104:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783071510.569829:0:13815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071510.569832:0:13815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1783071510.569862:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66e00/0x6b58994c2cbdcc56 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99019 expref: 66 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.569883:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f8a021bdc00) 00010000:00010000:0.0:1783071510.569887:0:13815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783071510.569902:0:13815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdccaa lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d9902e expref: -99 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783071510.570420:0:13815:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:0.0:1783071510.570597:0:13815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdccb1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.570612:0:13815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdccb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.570623:0:13815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdccb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.570689:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdccaa lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9902e expref: 68 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.570705:0:13815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdccb1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9902e expref: 67 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.570712:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f8b10db4300) 00010000:00010000:0.0:1783071510.570715:0:13815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783071510.570718:0:13815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a03865a00, rc 0) 00000100:00100000:0.0:1783071510.570798:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+67:12378:x1869685692911104:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 990us (1214us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1783071510.570808:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 190 00000100:00100000:1.0:1783071510.582434:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071510.582799:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692911360 00000100:00100000:2.0:1783071510.582809:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692911360 00000100:00100000:2.0:1783071510.582870:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 191 00000100:00100000:2.0:1783071510.582881:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+67:12378:x1869685692911360:12345-192.168.204.38@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783071510.582953:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071510.582981:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdccb1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9902e expref: 67 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.583002:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f8b10db4300) 00010000:00010000:2.0:1783071510.583025:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783071510.583047:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdccbf lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.583061:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdccbf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.583072:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdccbf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.583088:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdccc6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xc52efd6d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.583096:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdccc6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xc52efd6d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.583102:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdccc6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xc52efd6d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.583169:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdccbf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.583177:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdccbf lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.583184:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdccbf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.583191:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd67600 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:2.0:1783071510.583196:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdccbf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.583202:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdccbf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.583209:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f8a021bdc00) 00010000:00010000:2.0:1783071510.583210:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071510.583213:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdccbf lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.583217:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdccbf lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.583224:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdccc6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xc52efd6d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.583227:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdccc6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xc52efd6d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.583231:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdccc6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xc52efd6d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.583239:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd66a00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:2.0:1783071510.583242:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdccc6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xc52efd6d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.583248:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdccc6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xc52efd6d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.583256:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xc52efd6d (ffff8f8a020ca700) 00010000:00010000:2.0:1783071510.583258:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071510.583261:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdccc6 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xc52efd6d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.583268:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdccc6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xc52efd6d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071510.583352:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+66:12378:x1869685692911360:12345-192.168.204.38@tcp:36:lhsmtool_posix.0 Request processed in 472us (929us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783071510.583359:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 191 00000100:00100000:3.0:1783071510.589108:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071510.589214:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692911488 00000100:00100000:1.0:1783071510.589225:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692911488 00000100:00100000:1.0:1783071510.589300:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 192 00000100:00100000:1.0:1783071510.589312:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03bd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+66:12378:x1869685692911488:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783071510.589338:0:10292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071510.589458:0:10292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9000/0x6b58994c2cbdcccd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d99035 expref: -99 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071510.589508:0:10292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9c00/0x6b58994c2cbdccd4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071510.589522:0:10292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9c00/0x6b58994c2cbdccd4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071510.589534:0:10292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9c00/0x6b58994c2cbdccd4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071510.589734:0:10292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9000/0x6b58994c2cbdcccd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99035 expref: 68 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071510.589754:0:10292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9c00/0x6b58994c2cbdccd4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99035 expref: 67 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071510.589762:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f8b11ce3c00) 00010000:00010000:1.0:1783071510.589765:0:10292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783071510.589768:0:10292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b421d9c00, rc 0) 00000100:00100000:1.0:1783071510.590134:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03bd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+67:12378:x1869685692911488:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 822us (1039us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071510.590142:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 192 00000100:00100000:1.0:1783071510.602259:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071510.602339:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692911744 00000100:00100000:2.0:1783071510.602350:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692911744 00000100:00100000:2.0:1783071510.602430:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 193 00000100:00100000:2.0:1783071510.602442:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+67:12378:x1869685692911744:12345-192.168.204.38@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783071510.602527:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdccdb lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.603025:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdccdb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.603040:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdccdb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783071510.603464:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1783071510.603476:0:6516:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 412392111150ns, next at 413392108562ns, rc = 0 00000004:00010000:3.0:1783071510.607055:0:6516:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f9ee54c0 reply state 00000000bdc1b560 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdccdb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071510.607085:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdccdb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071510.607092:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f8b11ce3c00) 00010000:00010000:3.0:1783071510.607094:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1783071510.607098:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783071510.607229:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+69:12378:x1869685692911744:12345-192.168.204.38@tcp:36:lhsmtool_posix.0 Request processed in 4786us (4978us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1783071510.607239:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 193 00000100:00100000:2.0:1783071510.611901:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071510.611960:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692911872 00000100:00100000:3.0:1783071510.611987:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692911872 00000100:00100000:3.0:1783071510.612234:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 194 00000100:00100000:3.0:1783071510.612248:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03ad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+69:12378:x1869685692911872:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783071510.612277:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071510.612304:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdcce2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d9903c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071510.612402:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdcce2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9903c expref: 70 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071510.612418:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdcce2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9903c expref: 70 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071510.612438:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f8b11ce3c00) 00010000:00010000:3.0:1783071510.612441:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783071510.612444:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a01749600, rc 0) 00000100:00100000:3.0:1783071510.612518:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03ad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+70:12378:x1869685692911872:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 274us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071510.612527:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 194 00000100:00100000:1.0:1783071510.616112:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071510.616321:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692912000 00000100:00100000:3.0:1783071510.616332:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692912000 00000100:00100000:3.0:1783071510.616862:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 58 00000100:00100000:3.0:1783071510.616874:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf7532e4-6153-424a-9f4e-84941256b41f+6:2406:x1869685692912000:12345-192.168.204.38@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1783071510.616989:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783071510.617582:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf7532e4-6153-424a-9f4e-84941256b41f+7:2406:x1869685692912000:12345-192.168.204.38@tcp:2:lhsmtool_posix.0 Request processed in 697us (1467us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1783071510.617592:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 58 00000100:00100000:3.0:1783071510.621884:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071510.622038:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692912256 00000100:00100000:1.0:1783071510.622049:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692912256 00000100:00100000:1.0:1783071510.622114:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 49 00000100:00100000:1.0:1783071510.622126:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03bd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+70:12378:x1869685692912256:12345-192.168.204.38@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1783071510.622843:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03bd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+71:12378:x1869685692912256:12345-192.168.204.38@tcp:35:lhsmtool_posix.0 Request processed in 715us (1197us total) trans 4294967462 rc 0/0 00000100:00100000:1.0:1783071510.622852:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 49 00000100:00100000:2.0:1783071510.625291:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071510.627076:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692912512 00000100:00100000:1.0:1783071510.627089:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692912512 00000100:00100000:1.0:1783071510.627308:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 195 00000100:00100000:1.0:1783071510.627321:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+71:12378:x1869685692912512:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1783071510.628731:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+71:12378:x1869685692912512:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 Request processed in 1405us (3441us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071510.628743:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 195 00000100:00100000:3.0:1783071510.635511:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071510.635564:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692912640 00000100:00100000:0.0:1783071510.635590:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692912640 00000100:00100000:0.0:1783071510.635694:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 196 00000100:00100000:0.0:1783071510.635714:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+71:12378:x1869685692912640:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783071510.635736:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071510.635775:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdcce9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d99043 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.635865:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdccf0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.635882:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdccf0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.635894:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdccf0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783071510.635958:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783071510.635980:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdccf0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.636006:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdcce9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99043 expref: 73 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.636027:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdccf0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99043 expref: 72 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.636037:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f8b11ce3c00) 00010000:00010000:0.0:1783071510.636041:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1783071510.636045:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a03864e00, rc 0) 00000100:00100000:0.0:1783071510.636131:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+72:12378:x1869685692912640:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 428us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071510.636139:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 196 00000100:00100000:3.0:1783071510.643279:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071510.644046:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692912768 00000100:00100000:0.0:1783071510.644059:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692912768 00000100:00100000:0.0:1783071510.644137:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 59 00000100:00100000:0.0:1783071510.644149:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03bd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf7532e4-6153-424a-9f4e-84941256b41f+7:2405:x1869685692912768:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783071510.644172:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071510.644196:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049e80cbc/0x6b58994c2cbdccf7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d9904a expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783071510.644224:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a478317, blocks: 0x0 00010000:00010000:0.0:1783071510.644244:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=412s v=(0 0) 00010000:00010000:0.0:1783071510.644249:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071510.644260:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049e80cbc/0x6b58994c2cbdccf7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9904a expref: 8 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.644280:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000049e80cbc/0x6b58994c2cbdccf7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9904a expref: 8 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.644293:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a03865a00, rc 0) 00000100:00100000:0.0:1783071510.644384:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03bd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf7532e4-6153-424a-9f4e-84941256b41f+8:2405:x1869685692912768:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 237us (1114us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071510.644392:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 59 00000100:00100000:3.0:1783071510.649241:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071510.649388:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692913024 00000100:00100000:1.0:1783071510.649398:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692913024 00000100:00100000:1.0:1783071510.649455:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 197 00000100:00100000:1.0:1783071510.649464:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03bd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+72:12378:x1869685692913024:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1783071510.649580:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03bd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+72:12378:x1869685692913024:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 Request processed in 105us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071510.649599:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 197 00000100:00100000:3.0:1783071510.654064:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071510.654324:0:8910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692913152 00000100:00100000:1.0:1783071510.654336:0:8910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692913152 00000100:00100000:1.0:1783071510.654421:0:8910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 60 00000100:00100000:1.0:1783071510.654433:0:8910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03bd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf7532e4-6153-424a-9f4e-84941256b41f+8:12378:x1869685692913152:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783071510.654453:0:8910:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071510.654474:0:8910:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef65c43c/0x6b58994c2cbdccfe lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d99051 expref: -99 pid: 8910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071510.654508:0:8910:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000049e80cbc/0x6b58994c2cbdccf7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9904a expref: 9 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071510.654517:0:8910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783071510.654521:0:8910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783071510.654526:0:8910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef65c43c/0x6b58994c2cbdccfe lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99051 expref: 9 pid: 8910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071510.654561:0:8910:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000049e80cbc/0x6b58994c2cbdccf7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9904a expref: 9 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071510.654587:0:8910:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000049e80cbc/0x6b58994c2cbdccf7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9904a expref: 9 pid: 8432 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071510.654602:0:8910:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03b82300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8910:1869685707648256:192.168.204.38@tcp:104: 00000100:00100000:1.0:1783071510.655223:0:8910:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b06c44540 going to sleep for 11 seconds 00000100:00100000:2.0:1783071510.669951:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071510.670588:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692913280 00000100:00100000:0.0:1783071510.670600:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692913280 00010000:00010000:0.0:1783071510.670648:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000049e80cbc/0x6b58994c2cbdccf7 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9904a expref: 10 pid: 8432 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071510.670690:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 88 00000100:00100000:0.0:1783071510.670702:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03ad5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf7532e4-6153-424a-9f4e-84941256b41f+10:2405:x1869685692913280:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783071510.670724:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071510.670746:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000049e80cbc/0x6b58994c2cbdccf7 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9904a expref: 10 pid: 8432 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.670760:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000049e80cbc/0x6b58994c2cbdccf7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9904a expref: 10 pid: 8432 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.670786:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071510.670790:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071510.670799:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ef65c43c/0x6b58994c2cbdccfe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99051 expref: 10 pid: 8910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.670810:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef65c43c/0x6b58994c2cbdccfe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99051 expref: 10 pid: 8910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.670853:0:6501:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ef65c43c/0x6b58994c2cbdccfe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99051 expref: 10 pid: 8910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071510.670869:0:6501:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03b84700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6501:1869685707648384:192.168.204.38@tcp:105: 00000100:00100000:0.0:1783071510.670961:0:6501:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a038a8e40 going to sleep for 11 seconds 00010000:00010000:1.0:1783071510.678674:0:8910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049e80cbc/0x6b58994c2cbdccf7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9904a expref: 10 pid: 8432 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071510.678696:0:8910:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03b82300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8910:1869685707648256:192.168.204.38@tcp:104: 00010000:00010000:1.0:1783071510.678727:0:8910:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ef65c43c/0x6b58994c2cbdccfe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99051 expref: 9 pid: 8910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071510.678743:0:8910:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b421d8400, rc 0) 00000100:00100000:1.0:1783071510.678816:0:8910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03bd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf7532e4-6153-424a-9f4e-84941256b41f+9:12378:x1869685692913152:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 24386us (24761us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071510.678828:0:8910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 60 00000100:00100000:0.0:1783071510.679023:0:6501:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03b84700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6501:1869685707648384:192.168.204.38@tcp:105: 00010000:00010000:0.0:1783071510.679040:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071510.679084:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03ad5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf7532e4-6153-424a-9f4e-84941256b41f+8:2405:x1869685692913280:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 8384us (9144us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071510.679092:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 88 00000100:00100000:2.0:1783071510.692796:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071510.692895:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692913408 00000100:00100000:0.0:1783071510.692906:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692913408 00002000:00100000:0.0:1783071510.692977:0:8436:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8f8a03ad6300 x1869685692913408/t0(0) o4->bf7532e4-6153-424a-9f4e-84941256b41f@192.168.204.38@tcp:101/0 lens 504/0 e 0 to 0 dl 1783071521 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783071510.692988:0:8436:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8f8a03ad6300 with x1869685692913408 ext(0->8) 00002000:00010000:0.0:1783071510.692994:0:8436:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f8a03ad6300 00000100:00100000:0.0:1783071510.693030:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 4 00000100:00100000:0.0:1783071510.693041:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03ad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bf7532e4-6153-424a-9f4e-84941256b41f+8:2406:x1869685692913408:12345-192.168.204.38@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1783071510.695471:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03ad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bf7532e4-6153-424a-9f4e-84941256b41f+10:2406:x1869685692913408:12345-192.168.204.38@tcp:4:lhsmtool_posix.0 Request processed in 2423us (2676us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1783071510.696502:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 4 00002000:00100000:0.0:1783071510.696520:0:8436:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8f8a03ad6300 x1869685692913408/t4294967315(0) o4->bf7532e4-6153-424a-9f4e-84941256b41f@192.168.204.38@tcp:101/0 lens 504/448 e 0 to 0 dl 1783071521 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783071510.696539:0:8436:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8f8a03ad6300 with x1869685692913408 ext(0->8) 00002000:00010000:0.0:1783071510.696547:0:8436:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f8a03ad6300 00000100:00100000:0.0:1783071510.697982:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071510.698079:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692913536 00000100:00100000:1.0:1783071510.698088:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692913536 00000100:00100000:1.0:1783071510.698146:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 198 00000100:00100000:1.0:1783071510.698155:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+72:12378:x1869685692913536:12345-192.168.204.38@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1783071510.708520:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:2.0:1783071510.708538:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:2.0:1783071510.708607:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:2.0:1783071510.708637:0:6495:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f8a038bca80 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1783071510.708643:0:6495:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8f8a033ab200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f8a038bc780 00000020:00080000:2.0:1783071510.708647:0:6495:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8f8a033ab400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f8a03bbd800 00010000:00010000:0.0:1783071510.708834:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdca26 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.708846:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdca26 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.708853:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdca26 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.708860:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b014b9000 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:0.0:1783071510.708864:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdca26 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.708896:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdca26 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.708914:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8f8a021bdf00) 00010000:00010000:0.0:1783071510.708917:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071510.708921:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdca26 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.708928:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9000/0x6b58994c2cbdca26 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.708944:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8200/0x6b58994c2cbdca2d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.708950:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8200/0x6b58994c2cbdca2d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.708955:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8200/0x6b58994c2cbdca2d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.708960:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b014b8200 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:0.0:1783071510.708963:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8200/0x6b58994c2cbdca2d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.708969:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8200/0x6b58994c2cbdca2d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.708976:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f8a021bdc00) 00010000:00010000:0.0:1783071510.708978:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071510.708981:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8200/0x6b58994c2cbdca2d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.708997:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8200/0x6b58994c2cbdca2d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.709012:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdca6c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.709019:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdca6c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.709024:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdca6c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.709028:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b014b8600 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:0.0:1783071510.709031:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdca6c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.709037:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdca6c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.709044:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f8a021bd500) 00010000:00010000:0.0:1783071510.709047:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071510.709050:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdca6c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.709055:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8600/0x6b58994c2cbdca6c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.709068:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8000/0x6b58994c2cbdcb6f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.709074:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8000/0x6b58994c2cbdcb6f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.709086:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8000/0x6b58994c2cbdcb6f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.709092:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b014b8000 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:0.0:1783071510.709094:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8000/0x6b58994c2cbdcb6f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.709101:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8000/0x6b58994c2cbdcb6f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.709109:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f8b10db4800) 00010000:00010000:0.0:1783071510.709111:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071510.709114:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8000/0x6b58994c2cbdcb6f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.709119:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b8000/0x6b58994c2cbdcb6f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.709132:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdcb92 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.709139:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdcb92 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.709143:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdcb92 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.709148:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd66200 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:0.0:1783071510.709150:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdcb92 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.709166:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdcb92 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.709174:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f8b10db4800) 00010000:00010000:0.0:1783071510.709176:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071510.709179:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdcb92 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.709185:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdcb92 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.709196:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66400/0x6b58994c2cbdcbd8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.709201:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66400/0x6b58994c2cbdcbd8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.709208:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66400/0x6b58994c2cbdcbd8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.709213:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd66400 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:0.0:1783071510.709215:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66400/0x6b58994c2cbdcbd8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.709221:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66400/0x6b58994c2cbdcbd8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.709228:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f8b10db4800) 00010000:00010000:0.0:1783071510.709230:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071510.709232:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66400/0x6b58994c2cbdcbd8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.709246:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66400/0x6b58994c2cbdcbd8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.709257:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdccdb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.709263:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdccdb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.709270:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdccdb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.709275:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd67600 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:0.0:1783071510.709278:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdccdb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.709284:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdccdb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.709292:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f8b11ce3c00) 00010000:00010000:0.0:1783071510.709294:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783071510.709297:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdccdb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.709302:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdccdb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783071510.709319:0:6549:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1783071510.709407:0:6549:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1783071510.709426:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03ad7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707648512:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1783071510.709501:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071510.709648:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+20:12378:x1869685692913536:12345-192.168.204.38@tcp:44:lhsmtool_posix.0 Request processed in 11489us (11667us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071510.709659:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 198 00000100:00100000:2.0:1783071510.710190:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707648512 00000100:00100000:2.0:1783071510.710198:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707648512 00000100:00100000:2.0:1783071510.710246:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783071510.710255:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707648512:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1783071510.710384:0:8432:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1783071510.710389:0:8432:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1783071511 00002000:00010000:2.0:1783071510.710391:0:8432:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1783071510.710394:0:8432:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1783071511 -> 1783071511 00002000:00010000:2.0:1783071510.710397:0:8432:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1783071510.710444:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1869685707648512:12345-0@lo:2:osp-syn-0-0.0 Request processed in 189us (943us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1783071510.710451:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783071510.712510:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03ad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707648640:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1783071510.712587:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071510.712706:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707648640 00000100:00100000:2.0:1783071510.712713:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707648640 00000100:00100000:2.0:1783071510.712764:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1783071510.712774:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1869685707648640:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783071510.712814:0:8431:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00002000:00010000:2.0:1783071510.712844:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a478314, atime: 0x6a478315, ctime: 0x6a478314, blocks: 0x8 00010000:00010000:2.0:1783071510.712853:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002814545e/0x6b58994c2cbdcd05 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.712871:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=412s v=(0 0) 00010000:00010000:2.0:1783071510.712875:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783071510.712882:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002814545e/0x6b58994c2cbdcd05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.712898:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002814545e/0x6b58994c2cbdcd05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.712908:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002814545e/0x6b58994c2cbdcd05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.712917:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002814545e/0x6b58994c2cbdcd05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.712937:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783071510.713103:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3646:x1869685707648640:12345-0@lo:6:osp-syn-1-0.0 Request processed in 329us (515us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1783071510.713111:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00010000:0.0:1783071510.713233:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783071510.713241:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002814545e/0x6b58994c2cbdcd05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.713250:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd67200 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:0.0:1783071510.713254:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002814545e/0x6b58994c2cbdcd05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.713264:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002814545e/0x6b58994c2cbdcd05 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.713281:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002814545e/0x6b58994c2cbdcd05 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.713289:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002814545e/0x6b58994c2cbdcd05 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.713307:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071510.713309:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071510.713311:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1783071510.713341:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f8a03ad7b80/2, rc 0, transno 4294967308 00000100:00100000:0.0:1783071510.713347:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03ad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707648640:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1783071510.716303:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f8a03ad7480/2, rc 0, transno 4294967316 00000100:00100000:3.0:1783071510.716321:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03ad7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707648512:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1783071510.717687:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071510.717965:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692913664 00000100:00100000:0.0:1783071510.717992:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692913664 00000100:00100000:0.0:1783071510.718070:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 63 00000100:00100000:0.0:1783071510.718082:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03ad4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf7532e4-6153-424a-9f4e-84941256b41f+10:2406:x1869685692913664:12345-192.168.204.38@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1783071510.723327:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:1.0:1783071510.723349:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:0.0:1783071510.726026:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03ad4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf7532e4-6153-424a-9f4e-84941256b41f+7:2406:x1869685692913664:12345-192.168.204.38@tcp:16:lhsmtool_posix.0 Request processed in 7936us (8336us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071510.726041:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 63 00000100:00100000:0.0:1783071510.732682:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071510.732955:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692913920 00000100:00100000:2.0:1783071510.732965:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692913920 00000100:00100000:2.0:1783071510.733027:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 199 00000100:00100000:2.0:1783071510.733044:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+20:12378:x1869685692913920:12345-192.168.204.38@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783071510.733098:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071510.733125:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdccf0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99043 expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.733143:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f8b11ce3c00) 00010000:00010000:2.0:1783071510.733148:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783071510.733179:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdcd0c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.733196:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdcd0c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.733206:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdcd0c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783071510.733612:0:6516:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a42d76d2 reply state 000000006f4c513e transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdcd0c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.733689:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdcd0c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.733769:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f8b11ce3c00) 00010000:00010000:2.0:1783071510.733772:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783071510.733775:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783071510.733889:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+21:12378:x1869685692913920:12345-192.168.204.38@tcp:36:lhsmtool_posix.0 Request processed in 846us (1211us total) trans 4294967463 rc 0/0 00000100:00100000:2.0:1783071510.733898:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 199 00000100:00100000:1.0:1783071510.739191:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071510.742168:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692914048 00000100:00100000:2.0:1783071510.742184:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692914048 00000100:00100000:2.0:1783071510.742252:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 64 00000100:00100000:2.0:1783071510.742262:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf7532e4-6153-424a-9f4e-84941256b41f+7:2405:x1869685692914048:12345-192.168.204.38@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1783071510.742466:0:8431:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1783071510.742470:0:8431:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1783071511 -> 1783071510 00002000:00010000:2.0:1783071510.742472:0:8431:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1783071509 00002000:00010000:2.0:1783071510.742474:0:8431:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1783071511 -> 1783071510 00002000:00010000:2.0:1783071510.742476:0:8431:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1783071510.742552:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf7532e4-6153-424a-9f4e-84941256b41f+8:2405:x1869685692914048:12345-192.168.204.38@tcp:2:lhsmtool_posix.0 Request processed in 291us (3381us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1783071510.742560:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 64 00000100:00100000:1.0:1783071510.752009:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071510.752199:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692914304 00000100:00100000:3.0:1783071510.752214:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692914304 00000100:00100000:3.0:1783071510.752304:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 200 00000100:00100000:3.0:1783071510.752318:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+21:12378:x1869685692914304:12345-192.168.204.38@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1783071510.752465:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdcd13 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071510.752488:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9c00/0x6b58994c2cbdccd4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99035 expref: 21 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071510.752500:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdcd13 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071510.752549:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9c00/0x6b58994c2cbdccd4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99035 expref: 21 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071510.752579:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9c00/0x6b58994c2cbdccd4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99035 expref: 21 pid: 10292 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071510.752619:0:6517:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03bd0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1869685707648768:192.168.204.38@tcp:104: 00000100:00100000:3.0:1783071510.753130:0:6517:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a03022c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783071510.757447:0:6517:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03bd0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1869685707648768:192.168.204.38@tcp:104: 00010000:00010000:3.0:1783071510.757495:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdcd13 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071510.757831:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071510.757877:0:7923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692914432 00000100:00100000:1.0:1783071510.757886:0:7923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692914432 00010000:00010000:1.0:1783071510.757941:0:7923:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9c00/0x6b58994c2cbdccd4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99035 expref: 22 pid: 10292 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071510.757997:0:7923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 89 00000100:00100000:1.0:1783071510.758010:0:7923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab8a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf7532e4-6153-424a-9f4e-84941256b41f+22:2406:x1869685692914432:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783071510.758044:0:7923:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071510.758053:0:7923:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9c00/0x6b58994c2cbdccd4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99035 expref: 22 pid: 10292 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071510.758070:0:7923:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9c00/0x6b58994c2cbdccd4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99035 expref: 22 pid: 10292 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071510.758100:0:7923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9c00/0x6b58994c2cbdccd4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99035 expref: 22 pid: 10292 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071510.758122:0:7923:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f8b11ce3c00) 00010000:00010000:1.0:1783071510.758128:0:7923:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdcd13 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071510.758141:0:7923:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdcd13 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071510.758150:0:7923:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdcd13 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071510.758188:0:7923:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783071510.758228:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdcd13 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.758246:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdcd13 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071510.758265:0:7923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab8a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf7532e4-6153-424a-9f4e-84941256b41f+21:2406:x1869685692914432:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 255us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071510.758275:0:7923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 89 00010000:00010000:0.0:1783071510.758292:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdcd13 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.758304:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdcd13 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.758314:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdcd13 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.758320:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01749c00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:0.0:1783071510.758688:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdcd13 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.758700:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdcd13 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.758719:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f8b11ce3c00) 00010000:00010000:0.0:1783071510.758722:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1783071510.758736:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdcd13 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.758743:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdcd13 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071510.758984:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+20:12378:x1869685692914304:12345-192.168.204.38@tcp:55:lhsmtool_posix.0 Request processed in 6664us (6986us total) trans 0 rc -22/-22 00000100:00100000:0.0:1783071510.758997:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 200 00000100:00100000:3.0:1783071510.764321:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071510.764471:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692914560 00000100:00100000:2.0:1783071510.764485:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692914560 00000100:00100000:2.0:1783071510.764577:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 65 00000100:00100000:2.0:1783071510.764593:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03bd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf7532e4-6153-424a-9f4e-84941256b41f+8:2406:x1869685692914560:12345-192.168.204.38@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1783071510.764663:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001efe5f67/0x6b58994c2cbdcd1a lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.764806:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ef65c43c/0x6b58994c2cbdccfe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99051 expref: 8 pid: 8910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.764817:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783071510.764821:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783071510.764826:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001efe5f67/0x6b58994c2cbdcd1a lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.764878:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ef65c43c/0x6b58994c2cbdccfe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99051 expref: 8 pid: 8910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.764911:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ef65c43c/0x6b58994c2cbdccfe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99051 expref: 8 pid: 8910 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071510.764933:0:8429:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03ad5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8429:1869685707648896:192.168.204.38@tcp:104: 00000100:00100000:2.0:1783071510.765061:0:8429:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a038bccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783071510.770720:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071510.770815:0:8429:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03ad5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8429:1869685707648896:192.168.204.38@tcp:104: 00000100:00100000:3.0:1783071510.770816:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692914688 00000100:00100000:3.0:1783071510.770833:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692914688 00010000:00010000:2.0:1783071510.770857:0:8429:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001efe5f67/0x6b58994c2cbdcd1a lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071510.770897:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ef65c43c/0x6b58994c2cbdccfe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99051 expref: 9 pid: 8910 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071510.770966:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 90 00000100:00100000:3.0:1783071510.770980:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf7532e4-6153-424a-9f4e-84941256b41f+9:2405:x1869685692914688:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783071510.771000:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071510.771031:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ef65c43c/0x6b58994c2cbdccfe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99051 expref: 9 pid: 8910 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071510.771049:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ef65c43c/0x6b58994c2cbdccfe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99051 expref: 9 pid: 8910 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071510.771083:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef65c43c/0x6b58994c2cbdccfe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99051 expref: 9 pid: 8910 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071510.771109:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783071510.771131:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783071510.771139:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001efe5f67/0x6b58994c2cbdcd1a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071510.771152:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001efe5f67/0x6b58994c2cbdcd1a lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071510.771190:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783071510.771216:0:8429:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001efe5f67/0x6b58994c2cbdcd1a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.771229:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001efe5f67/0x6b58994c2cbdcd1a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.771265:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001efe5f67/0x6b58994c2cbdcd1a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.771276:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001efe5f67/0x6b58994c2cbdcd1a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071510.771290:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf7532e4-6153-424a-9f4e-84941256b41f+8:2405:x1869685692914688:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 311us (574us total) trans 0 rc 0/0 00010000:00010000:2.0:1783071510.771322:0:8429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001efe5f67/0x6b58994c2cbdcd1a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071510.771326:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 90 00010000:00010000:2.0:1783071510.771401:0:8429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd66600 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:2.0:1783071510.771407:0:8429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001efe5f67/0x6b58994c2cbdcd1a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.771417:0:8429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001efe5f67/0x6b58994c2cbdcd1a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.771439:0:8429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001efe5f67/0x6b58994c2cbdcd1a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.771447:0:8429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001efe5f67/0x6b58994c2cbdcd1a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071510.771580:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03bd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf7532e4-6153-424a-9f4e-84941256b41f+7:2406:x1869685692914560:12345-192.168.204.38@tcp:1:lhsmtool_posix.0 Request processed in 6981us (7266us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071510.771591:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 65 00000100:00100000:3.0:1783071510.775355:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071510.775435:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692914944 00000100:00100000:0.0:1783071510.775449:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692914944 00000100:00100000:0.0:1783071510.775521:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 201 00000100:00100000:0.0:1783071510.775530:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+20:12378:x1869685692914944:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1783071510.775637:0:10292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdcd21 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.775655:0:10292:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9600/0x6b58994c2cbdcb68 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98fda expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.775666:0:10292:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdcd21 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.775702:0:10292:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9600/0x6b58994c2cbdcb68 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98fda expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.775717:0:10292:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9600/0x6b58994c2cbdcb68 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98fda expref: 20 pid: 6516 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071510.775731:0:10292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03b86680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10292:1869685707649024:192.168.204.38@tcp:104: 00000100:00100000:0.0:1783071510.775836:0:10292:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a038a8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783071510.779512:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071510.779657:0:10292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03b86680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10292:1869685707649024:192.168.204.38@tcp:104: 00010000:00010000:0.0:1783071510.779692:0:10292:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdcd21 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071510.779870:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692915072 00000100:00100000:2.0:1783071510.779877:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692915072 00010000:00010000:2.0:1783071510.779918:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9600/0x6b58994c2cbdcb68 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98fda expref: 21 pid: 6516 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071510.779967:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 91 00000100:00100000:2.0:1783071510.779977:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03bd1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf7532e4-6153-424a-9f4e-84941256b41f+21:2405:x1869685692915072:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783071510.779993:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071510.780016:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9600/0x6b58994c2cbdcb68 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98fda expref: 21 pid: 6516 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.780031:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9600/0x6b58994c2cbdcb68 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98fda expref: 21 pid: 6516 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.780056:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9600/0x6b58994c2cbdcb68 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98fda expref: 21 pid: 6516 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.780073:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f8b10db4800) 00010000:00010000:2.0:1783071510.780078:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdcd21 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.780088:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdcd21 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.780096:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdcd21 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.780128:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071510.780189:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03bd1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf7532e4-6153-424a-9f4e-84941256b41f+20:2405:x1869685692915072:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 213us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071510.780197:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 91 00010000:00010000:0.0:1783071510.780532:0:10292:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdcd21 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.780551:0:10292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdcd21 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.780750:0:10292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdcd28 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.780765:0:10292:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdcce2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9903c expref: 20 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.780774:0:10292:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdcd28 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.780807:0:10292:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdcce2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9903c expref: 20 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.780822:0:10292:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdcce2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9903c expref: 20 pid: 6518 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071510.780835:0:10292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03b86680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10292:1869685707649152:192.168.204.38@tcp:104: 00000100:00100000:0.0:1783071510.780905:0:10292:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a038a8600 going to sleep for 11 seconds 00000100:00100000:0.0:1783071510.784637:0:10292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03b86680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10292:1869685707649152:192.168.204.38@tcp:104: 00010000:00010000:0.0:1783071510.784681:0:10292:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdcd28 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071510.785330:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071510.786802:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692915200 00000100:00100000:2.0:1783071510.786821:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692915200 00010000:00010000:2.0:1783071510.786870:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdcce2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9903c expref: 21 pid: 6518 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071510.786924:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 92 00000100:00100000:2.0:1783071510.786936:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03bd2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf7532e4-6153-424a-9f4e-84941256b41f+21:2405:x1869685692915200:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783071510.786960:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071510.786968:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdcce2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9903c expref: 21 pid: 6518 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.786983:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdcce2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9903c expref: 21 pid: 6518 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.787007:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdcce2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9903c expref: 21 pid: 6518 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.787021:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f8b11ce3c00) 00010000:00010000:2.0:1783071510.787026:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdcd28 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.787038:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdcd28 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.787045:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdcd28 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.787080:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783071510.787121:0:10292:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdcd28 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071510.787141:0:10292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdcd28 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071510.787153:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03bd2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf7532e4-6153-424a-9f4e-84941256b41f+20:2405:x1869685692915200:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 214us (1827us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071510.787165:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 92 00010000:00010000:2.0:1783071510.787231:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1783071510.787315:0:10292:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:3.0:1783071510.787534:0:10292:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:3.0:1783071510.787599:0:10292:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:3.0:1783071510.789402:0:10292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03bd3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10292:1869685707649280:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1783071510.789508:0:10292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071510.789558:0:10292:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a03022240 going to sleep for 11 seconds 00000100:00100000:1.0:1783071510.789583:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707649280 00000100:00100000:1.0:1783071510.789594:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707649280 00000100:00100000:1.0:1783071510.789670:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1783071510.789682:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03bd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10292:x1869685707649280:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1783071510.789823:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03bd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10292:x1869685707649280:12345-0@lo:1000:mdt00_003.0 Request processed in 142us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071510.789831:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1783071510.790086:0:10292:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:3.0:1783071510.790096:0:10292:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f8a03ad7480, transno 4294967316 00000100:00100000:3.0:1783071510.790122:0:10292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03bd3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10292:1869685707649280:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1783071510.792339:0:10292:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:3.0:1783071510.792498:0:10292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03bd3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10292:1869685707649408:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1783071510.792636:0:10292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071510.794027:0:10292:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a030220c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783071510.795097:0:9413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707649408 00000100:00100000:1.0:1783071510.795114:0:9413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707649408 00000100:00100000:1.0:1783071510.795600:0:9413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1783071510.795615:0:9413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0411f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:10292:x1869685707649408:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1783071510.797445:0:9413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0411f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:10292:x1869685707649408:12345-0@lo:1000:mdt00_003.0 Request processed in 1826us (4801us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1783071510.797460:0:9413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1783071510.797806:0:10292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03bd3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10292:1869685707649408:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1783071510.797885:0:10292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdcd28 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071510.797899:0:10292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdcd28 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071510.797909:0:10292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdcd28 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071510.797917:0:10292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03865600 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071510.797924:0:10292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdcd28 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071510.797933:0:10292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdcd28 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071510.798032:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f8b11ce3c00) 00010000:00010000:3.0:1783071510.798037:0:10292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783071510.798045:0:10292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdcd28 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071510.798053:0:10292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdcd28 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071510.798089:0:10292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdcc5d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071510.798114:0:10292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdcc5d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071510.798120:0:10292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdcc5d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071510.798126:0:10292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01749400 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071510.798129:0:10292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdcc5d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071510.798137:0:10292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdcc5d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071510.798149:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f8b10db4800) 00010000:00010000:3.0:1783071510.798152:0:10292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783071510.798156:0:10292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdcc5d lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071510.798163:0:10292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdcc5d lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071510.798211:0:10292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdcd2f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071510.798231:0:10292:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdcc79 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99020 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071510.798243:0:10292:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdcd2f lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071510.798300:0:10292:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdcc79 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99020 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071510.798332:0:10292:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdcc79 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99020 expref: 23 pid: 6518 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071510.798354:0:10292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0411ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10292:1869685707649536:192.168.204.38@tcp:104: 00000100:00100000:3.0:1783071510.798521:0:10292:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a030220c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783071510.802660:0:10292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0411ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10292:1869685707649536:192.168.204.38@tcp:104: 00010000:00010000:1.0:1783071510.802699:0:10292:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdcd2f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071510.804643:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071510.804715:0:7923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692915328 00000100:00100000:1.0:1783071510.804730:0:7923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692915328 00010000:00010000:1.0:1783071510.804777:0:7923:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdcc79 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99020 expref: 24 pid: 6518 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071510.804828:0:7923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 93 00000100:00100000:1.0:1783071510.804839:0:7923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0411f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf7532e4-6153-424a-9f4e-84941256b41f+24:2405:x1869685692915328:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783071510.804854:0:7923:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071510.804859:0:7923:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdcc79 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99020 expref: 24 pid: 6518 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071510.804873:0:7923:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdcc79 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99020 expref: 24 pid: 6518 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071510.804906:0:7923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdcc79 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99020 expref: 24 pid: 6518 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071510.804920:0:7923:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f8b10db4800) 00010000:00010000:1.0:1783071510.804926:0:7923:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdcd2f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071510.804936:0:7923:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdcd2f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071510.804943:0:7923:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdcd2f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071510.804972:0:7923:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071510.805039:0:7923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0411f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf7532e4-6153-424a-9f4e-84941256b41f+23:2405:x1869685692915328:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 201us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071510.805047:0:7923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 93 00010000:00010000:3.0:1783071510.805131:0:10292:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdcd2f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071510.805145:0:10292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdcd2f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071510.805172:0:10292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdcd2f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071510.805181:0:10292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdcd2f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071510.805190:0:10292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdcd2f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071510.805196:0:10292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01749c00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071510.805202:0:10292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdcd2f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071510.805210:0:10292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdcd2f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071510.805226:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f8b10db4800) 00010000:00010000:3.0:1783071510.805240:0:10292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071510.805246:0:10292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdcd2f lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071510.805254:0:10292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdcd2f lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071510.805269:0:10292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdcd21 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071510.805274:0:10292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdcd21 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071510.805280:0:10292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdcd21 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071510.805284:0:10292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03865c00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071510.805288:0:10292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdcd21 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071510.805294:0:10292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdcd21 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071510.805302:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f8b10db4800) 00010000:00010000:3.0:1783071510.805305:0:10292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783071510.805308:0:10292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdcd21 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071510.805313:0:10292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdcd21 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071510.805633:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+22:12378:x1869685692914944:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 Request processed in 30100us (30289us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1783071510.805659:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 201 00000020:00080000:3.0:1783071510.805674:0:10292:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1783071510.805853:0:13796:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783071510.805861:0:13796:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783071510.806321:0:13796:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 5 00000040:00080000:0.0:1783071510.806342:0:13796:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783071510.810465:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071510.810551:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692915584 00000100:00100000:1.0:1783071510.810575:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692915584 00000100:00100000:1.0:1783071510.810725:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 50 00000100:00100000:1.0:1783071510.810737:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0699ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+22:12378:x1869685692915584:12345-192.168.204.38@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1783071510.811164:0:6520:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1783071510.811209:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:1.0:1783071510.811255:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9c00/0x6b58994c2cbdcd36 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071510.811276:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9c00/0x6b58994c2cbdcd36 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071510.811311:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9c00/0x6b58994c2cbdcd36 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071510.811321:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9c00/0x6b58994c2cbdcd36 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071510.811328:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9c00/0x6b58994c2cbdcd36 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071510.811334:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9c00/0x6b58994c2cbdcd36 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071510.811357:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783071510.811439:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783071510.811457:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9c00/0x6b58994c2cbdcd36 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.811470:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b421d9c00 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:0.0:1783071510.811475:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9c00/0x6b58994c2cbdcd36 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.811487:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9c00/0x6b58994c2cbdcd36 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.811509:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f8b11ce3c00) 00010000:00010000:0.0:1783071510.811512:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783071510.811517:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9c00/0x6b58994c2cbdcd36 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.811523:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9c00/0x6b58994c2cbdcd36 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.811540:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071510.811545:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071510.811548:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0699ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+24:12378:x1869685692915584:12345-192.168.204.38@tcp:35:lhsmtool_posix.0 Request processed in 807us (1090us total) trans 4294967470 rc 0/0 00010000:00010000:0.0:1783071510.811549:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071510.811563:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 50 00000020:00080000:1.0:1783071510.811580:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1783071510.850846:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03b81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707649792:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783071510.850919:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071510.850999:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783071510.851006:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03ad7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707649664:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783071510.851032:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071510.851059:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783071510.851066:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03b86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707649920:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783071510.851090:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071510.851117:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707649792 00000100:00100000:0.0:1783071510.851125:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707649792 00000100:00100000:0.0:1783071510.851164:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707649664 00000100:00100000:0.0:1783071510.851166:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707649664 00000100:00100000:0.0:1783071510.851178:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707649920 00000100:00100000:0.0:1783071510.851180:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707649920 00000100:00100000:0.0:1783071510.851194:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1783071510.851202:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1869685707649792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783071510.851242:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:0.0:1783071510.851308:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1869685707649792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071510.851317:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1783071510.851335:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1783071510.851341:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707649664:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783071510.851350:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3691974656 00000100:00100000:0.0:1783071510.851413:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707649664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071510.851419:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1783071510.851433:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1783071510.851439:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1869685707649920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783071510.851448:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3691974656 00000100:00100000:0.0:1783071510.851488:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1869685707649920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071510.851495:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1783071510.851520:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03ad5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707650048:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783071510.851542:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071510.851597:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03b86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707649920:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783071510.851610:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707650048 00000100:00100000:2.0:1783071510.851616:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707650048 00000100:00100000:0.0:1783071510.851639:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03ad7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707649664:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783071510.851653:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03b81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707649792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783071510.851667:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1783071510.851677:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707650048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783071510.851696:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:2.0:1783071510.851740:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707650048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071510.851747:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1783071510.851978:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03ad5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707650048:0@lo:13:osp-pre-1-1.0 00000040:00080000:3.0:1783071511.052136:0:14601:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783071511.052147:0:14601:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783071511.052181:0:14601:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1783071511.052187:0:14601:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783071511.216297:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071511.216339:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692915840 00000100:00100000:3.0:1783071511.216348:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692915840 00000100:00100000:3.0:1783071511.216455:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 202 00000100:00100000:3.0:1783071511.216465:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0411e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+24:12388:x1869685692915840:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1783071511.216491:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071511.216513:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdcd3d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d99058 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.216665:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdcd44 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.216685:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdcd44 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.216701:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdcd44 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783071511.216714:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1783071511.216850:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdcd3d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99058 expref: 27 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.216892:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdcd44 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99058 expref: 26 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.216903:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f8a021bdc00) 00010000:00010000:3.0:1783071511.216906:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783071511.216910:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a01749400, rc 0) 00000100:00100000:3.0:1783071511.216986:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0411e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+26:12388:x1869685692915840:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 522us (703us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1783071511.216994:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 202 00000100:00080000:3.0:1783071511.217105:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783071511.220684:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071511.220765:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692915968 00000100:00100000:3.0:1783071511.220776:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692915968 00000100:00100000:3.0:1783071511.220840:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 203 00000100:00100000:3.0:1783071511.220851:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03ad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+26:12388:x1869685692915968:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:3.0:1783071511.220954:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdcd52 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.220974:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdcd52 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.220986:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdcd52 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.221001:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdcd59 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.221009:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdcd59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.221049:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdcd59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.221139:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdcd60 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.221147:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdcd60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.221154:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdcd60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783071511.221210:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdcd60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.221225:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdcd52 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.221232:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdcd52 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.221239:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdcd52 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.221245:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01749a00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071511.221250:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdcd52 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.221258:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdcd52 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.221271:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f8a021bdc00) 00010000:00010000:3.0:1783071511.221279:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071511.221286:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdcd52 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.221293:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdcd52 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.221307:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdcd59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.221314:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdcd59 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.221319:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdcd59 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.221325:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01749000 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071511.221328:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdcd59 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.221334:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdcd59 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.221342:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f8a0179f900) 00010000:00010000:3.0:1783071511.221345:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071511.221348:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdcd59 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.221354:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdcd59 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.221404:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdcd60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.221418:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdcd60 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.221423:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdcd60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.221429:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01749e00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071511.221432:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdcd60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.221439:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdcd60 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.221447:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f8a0179f200) 00010000:00010000:3.0:1783071511.221450:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071511.221453:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdcd60 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.221458:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdcd60 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071511.221539:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03ad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+26:12388:x1869685692915968:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 688us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071511.221548:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 203 00000100:00100000:0.0:1783071511.282977:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071511.283089:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692916224 00000100:00100000:3.0:1783071511.283101:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692916224 00000100:00100000:3.0:1783071511.283209:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 204 00000100:00100000:3.0:1783071511.283222:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+26:12391:x1869685692916224:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1783071511.283247:0:10292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071511.283283:0:10292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdcd67 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d9905f expref: -99 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.283408:0:10292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdcd6e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.283426:0:10292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdcd6e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.283438:0:10292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdcd6e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.283454:0:10292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdcd75 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.283461:0:10292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdcd75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.283469:0:10292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdcd75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.283606:0:10292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdcd7c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.283615:0:10292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdcd7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.283622:0:10292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdcd7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783071511.283631:0:10292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1783071511.283715:0:10292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdcd6e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.283732:0:10292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdcd6e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.283739:0:10292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdcd6e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.283745:0:10292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01749e00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071511.283750:0:10292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdcd6e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.283757:0:10292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdcd6e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.283770:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f8a021bdc00) 00010000:00010000:3.0:1783071511.283773:0:10292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071511.283778:0:10292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdcd6e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.283783:0:10292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdcd6e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.283797:0:10292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdcd75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.283802:0:10292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdcd75 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.283808:0:10292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdcd75 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.283812:0:10292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01749000 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071511.283821:0:10292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdcd75 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.283827:0:10292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdcd75 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.283835:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f8a0179f200) 00010000:00010000:3.0:1783071511.283837:0:10292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071511.283840:0:10292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdcd75 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.283846:0:10292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdcd75 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.283891:0:10292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdcd67 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9905f expref: 29 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.283904:0:10292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdcd7c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9905f expref: 28 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.283910:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f8a0179f900) 00010000:00010000:3.0:1783071511.283912:0:10292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783071511.283915:0:10292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a01749a00, rc 0) 00000100:00100000:3.0:1783071511.283982:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+28:12391:x1869685692916224:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 763us (1016us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1783071511.283991:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 204 00000100:00100000:3.0:1783071511.290454:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071511.290589:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692916352 00000100:00100000:1.0:1783071511.290600:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692916352 00000100:00100000:1.0:1783071511.290664:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 205 00000100:00100000:1.0:1783071511.290676:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0411f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+28:12391:x1869685692916352:12345-192.168.204.38@tcp:54:lfs.0 00010000:00010000:1.0:1783071511.290771:0:13815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9000/0x6b58994c2cbdcd8a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071511.290794:0:13815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9000/0x6b58994c2cbdcd8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071511.290806:0:13815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9000/0x6b58994c2cbdcd8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071511.290866:0:13815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9000/0x6b58994c2cbdcd8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071511.290874:0:13815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9000/0x6b58994c2cbdcd8a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071511.290881:0:13815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9000/0x6b58994c2cbdcd8a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071511.290888:0:13815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b421d9000 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:1.0:1783071511.290893:0:13815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9000/0x6b58994c2cbdcd8a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071511.290901:0:13815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9000/0x6b58994c2cbdcd8a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071511.290914:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f8a0179f900) 00010000:00010000:1.0:1783071511.290918:0:13815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783071511.290923:0:13815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9000/0x6b58994c2cbdcd8a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071511.290928:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9000/0x6b58994c2cbdcd8a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071511.291013:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0411f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+28:12391:x1869685692916352:12345-192.168.204.38@tcp:54:lfs.0 Request processed in 338us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071511.291020:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 205 00000100:00100000:1.0:1783071511.295289:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071511.295401:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692916608 00000100:00100000:0.0:1783071511.295411:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692916608 00000100:00100000:0.0:1783071511.295470:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 51 00000100:00100000:0.0:1783071511.295480:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+28:12391:x1869685692916608:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1783071511.295780:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+29:12391:x1869685692916608:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 300us (501us total) trans 4294967473 rc 0/0 00000100:00100000:0.0:1783071511.295789:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 51 00000100:00100000:0.0:1783071511.365213:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071511.367068:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692916864 00000100:00100000:3.0:1783071511.367083:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692916864 00000100:00100000:3.0:1783071511.367166:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 206 00000100:00100000:3.0:1783071511.367197:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+29:11923:x1869685692916864:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:3.0:1783071511.367227:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071511.367254:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdcd91 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d99066 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.368052:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdcd98 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.368072:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdcd7c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9905f expref: 30 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.368082:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdcd98 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.368119:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdcd7c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9905f expref: 30 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.368134:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdcd7c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9905f expref: 30 pid: 10292 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071511.368148:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0411c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6518:1869685707650176:192.168.204.38@tcp:104: 00000100:00100000:3.0:1783071511.368535:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b2fc82f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783071511.378615:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071511.378789:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0411c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6518:1869685707650176:192.168.204.38@tcp:104: 00010000:00010000:2.0:1783071511.378822:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdcd98 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071511.379772:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692916992 00000100:00100000:3.0:1783071511.379784:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692916992 00010000:00010000:3.0:1783071511.379839:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdcd7c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9905f expref: 31 pid: 10292 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071511.379938:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 94 00000100:00100000:3.0:1783071511.379950:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf7532e4-6153-424a-9f4e-84941256b41f+31:2405:x1869685692916992:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783071511.379991:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071511.379999:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdcd7c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9905f expref: 31 pid: 10292 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.380013:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdcd7c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9905f expref: 31 pid: 10292 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.380042:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdcd7c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9905f expref: 31 pid: 10292 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.380058:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f8a0179f900) 00010000:00010000:3.0:1783071511.380063:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdcd98 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.380073:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdcd98 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.380081:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdcd98 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.380120:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783071511.380192:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf7532e4-6153-424a-9f4e-84941256b41f+30:2405:x1869685692916992:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 244us (1590us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071511.380200:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 94 00010000:00010000:0.0:1783071511.383773:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdcd98 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071511.383789:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdcd98 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783071511.383815:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:0.0:1783071511.383991:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdcd91 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99066 expref: 31 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071511.384014:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdcd98 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99066 expref: 30 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071511.384024:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f8a0179f900) 00010000:00010000:0.0:1783071511.384027:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783071511.384031:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a01749000, rc 0) 00000100:00100000:0.0:1783071511.384123:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+30:11923:x1869685692916864:12345-192.168.204.38@tcp:101:bash.0 Request processed in 16930us (18921us total) trans 4294967474 rc 0/0 00000100:00100000:0.0:1783071511.384134:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 206 00000100:00100000:0.0:1783071511.390039:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071511.390315:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692917120 00000100:00100000:3.0:1783071511.390327:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692917120 00000100:00100000:3.0:1783071511.390429:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 207 00000100:00100000:3.0:1783071511.390440:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c688000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+30:11923:x1869685692917120:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:3.0:1783071511.390490:0:10292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071511.390512:0:10292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdcda6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d9906d expref: -99 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.390547:0:10292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdcdad lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.390572:0:10292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdcdad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.390585:0:10292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdcdad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.390976:0:10292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdcda6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9906d expref: 32 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.391005:0:10292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdcdad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9906d expref: 31 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.391017:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f8a0179f900) 00010000:00010000:2.0:1783071511.391020:0:10292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783071511.391024:0:10292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a01749c00, rc 0) 00000100:00100000:2.0:1783071511.391100:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c688000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+31:11923:x1869685692917120:12345-192.168.204.38@tcp:101:bash.0 Request processed in 662us (1073us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071511.391107:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 207 00000100:00100000:1.0:1783071511.401010:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071511.401100:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692917376 00000100:00100000:3.0:1783071511.401111:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692917376 00000100:00100000:3.0:1783071511.401175:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 208 00000100:00100000:3.0:1783071511.401185:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+31:11923:x1869685692917376:12345-192.168.204.38@tcp:36:bash.0 00010000:00010000:3.0:1783071511.401471:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdcdb4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.401491:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdcdb4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.401503:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdcdb4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783071511.401548:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:3.0:1783071511.401585:0:6517:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c0b440b7 reply state 000000005cca765b transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdcdb4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.401599:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdcdb4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.401620:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f8a0179f900) 00010000:00010000:3.0:1783071511.401624:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783071511.401627:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1783071511.401680:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:3.0:1783071511.401769:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+35:11923:x1869685692917376:12345-192.168.204.38@tcp:36:bash.0 Request processed in 585us (769us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1783071511.401776:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 208 00000020:00080000:3.0:1783071511.401781:0:6517:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1783071511.416865:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071511.417037:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692917504 00000100:00100000:0.0:1783071511.417047:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692917504 00000100:00100000:0.0:1783071511.417109:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 209 00000100:00100000:0.0:1783071511.417119:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+35:11923:x1869685692917504:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:0.0:1783071511.417144:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071511.417163:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdcdbb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d99074 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071511.417225:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdcdbb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99074 expref: 36 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071511.417241:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdcdbb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99074 expref: 36 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071511.417259:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f8a0179f900) 00010000:00010000:0.0:1783071511.417268:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783071511.417273:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a03865e00, rc 0) 00000100:00100000:0.0:1783071511.417337:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+36:11923:x1869685692917504:12345-192.168.204.38@tcp:101:bash.0 Request processed in 218us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071511.417344:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 209 00000100:00100000:0.0:1783071511.430957:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071511.431068:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692917632 00000100:00100000:2.0:1783071511.431079:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692917632 00000100:00100000:2.0:1783071511.431144:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 66 00000100:00100000:2.0:1783071511.431155:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c683b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf7532e4-6153-424a-9f4e-84941256b41f+7:11923:x1869685692917632:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:2.0:1783071511.431178:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071511.431213:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd4b890e/0x6b58994c2cbdcdc2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d9907b expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783071511.431238:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a478316, atime: 0x6a478315, ctime: 0x6a478316, blocks: 0x8 00010000:00010000:2.0:1783071511.431259:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=413s v=(0 0) 00010000:00010000:2.0:1783071511.431264:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783071511.431274:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd4b890e/0x6b58994c2cbdcdc2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9907b expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.431292:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bd4b890e/0x6b58994c2cbdcdc2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9907b expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.431306:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b2fd66a00, rc 0) 00000100:00100000:2.0:1783071511.431409:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c683b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf7532e4-6153-424a-9f4e-84941256b41f+8:11923:x1869685692917632:12345-192.168.204.38@tcp:101:bash.0 Request processed in 256us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071511.431416:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 66 00000100:00100000:3.0:1783071511.444989:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071511.445101:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692917760 00000100:00100000:1.0:1783071511.445112:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692917760 00002000:00010000:1.0:1783071511.445159:0:8437:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:1.0:1783071511.445166:0:8437:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8f8a0411ca80 with x1869685692917760 ext(0->18446744073709551615) 00002000:00010000:1.0:1783071511.445179:0:8437:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f8a0411ca80. 00000100:00100000:1.0:1783071511.445217:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 5 00000100:00100000:1.0:1783071511.445227:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0411ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bf7532e4-6153-424a-9f4e-84941256b41f+8:2406:x1869685692917760:12345-192.168.204.38@tcp:10:bash.0 00002000:00010000:1.0:1783071511.445594:0:8437:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1783071511.445598:0:8437:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1783071510 -> 1783071512 00002000:00010000:1.0:1783071511.445601:0:8437:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1783071509 -> 1783071509 00002000:00010000:1.0:1783071511.445604:0:8437:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1783071510 -> 1783071512 00002000:00010000:1.0:1783071511.445607:0:8437:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:1.0:1783071511.445964:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0411ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bf7532e4-6153-424a-9f4e-84941256b41f+9:2406:x1869685692917760:12345-192.168.204.38@tcp:10:bash.0 Request processed in 735us (983us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1783071511.445975:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 5 00002000:00010000:1.0:1783071511.445979:0:8437:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:1.0:1783071511.445983:0:8437:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8f8a0411ca80 with x1869685692917760 ext(0->18446744073709551615) 00002000:00010000:1.0:1783071511.445989:0:8437:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f8a0411ca80. 00000100:00100000:3.0:1783071511.507329:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071511.507644:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692917888 00000100:00100000:2.0:1783071511.507656:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692917888 00000100:00100000:2.0:1783071511.507731:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 210 00000100:00100000:2.0:1783071511.507742:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0411d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+36:12405:x1869685692917888:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:2.0:1783071511.507825:0:10292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdcdc9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.507844:0:10292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdcdc9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.507856:0:10292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdcdc9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.507894:0:10292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdcdd0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.507902:0:10292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdcdd0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.507910:0:10292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdcdd0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.508009:0:10292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66400/0x6b58994c2cbdcdd7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.508019:0:10292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66400/0x6b58994c2cbdcdd7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.508026:0:10292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66400/0x6b58994c2cbdcdd7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783071511.508075:0:10292:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66400/0x6b58994c2cbdcdd7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.508087:0:10292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdcdc9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.508094:0:10292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdcdc9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.508101:0:10292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdcdc9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.508107:0:10292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd67c00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:2.0:1783071511.508111:0:10292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdcdc9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.508127:0:10292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdcdc9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.508140:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f8a021bdc00) 00010000:00010000:2.0:1783071511.508142:0:10292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071511.508147:0:10292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdcdc9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.508153:0:10292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdcdc9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.508167:0:10292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdcdd0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.508174:0:10292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdcdd0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.508180:0:10292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdcdd0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.508185:0:10292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd66200 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:2.0:1783071511.508188:0:10292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdcdd0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.508193:0:10292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdcdd0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.508200:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f8a020caf00) 00010000:00010000:2.0:1783071511.508202:0:10292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071511.508205:0:10292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdcdd0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.508220:0:10292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdcdd0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.508237:0:10292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66400/0x6b58994c2cbdcdd7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.508243:0:10292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66400/0x6b58994c2cbdcdd7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.508248:0:10292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66400/0x6b58994c2cbdcdd7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.508253:0:10292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd66400 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:2.0:1783071511.508256:0:10292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66400/0x6b58994c2cbdcdd7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.508261:0:10292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66400/0x6b58994c2cbdcdd7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.508268:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f8a0179f900) 00010000:00010000:2.0:1783071511.508270:0:10292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071511.508273:0:10292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66400/0x6b58994c2cbdcdd7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.508277:0:10292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66400/0x6b58994c2cbdcdd7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071511.508414:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0411d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+36:12405:x1869685692917888:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 674us (1096us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071511.508424:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 210 00000100:00100000:0.0:1783071511.556028:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071511.556132:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692918144 00000100:00100000:2.0:1783071511.556144:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692918144 00000100:00100000:2.0:1783071511.556214:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 211 00000100:00100000:2.0:1783071511.556226:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+36:12408:x1869685692918144:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1783071511.556253:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071511.556277:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66400/0x6b58994c2cbdcdde lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d99082 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.556390:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdcde5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.556407:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdcde5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.556419:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdcde5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.556435:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdcdec lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.556442:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdcdec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.556448:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdcdec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.556601:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66e00/0x6b58994c2cbdcdf3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.556611:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66e00/0x6b58994c2cbdcdf3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.556640:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66e00/0x6b58994c2cbdcdf3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071511.556652:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1783071511.556740:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdcde5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.556748:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdcde5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.556753:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdcde5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.556759:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd66200 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:2.0:1783071511.556763:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdcde5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.556770:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdcde5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.556782:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f8a021bdc00) 00010000:00010000:2.0:1783071511.556786:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071511.556790:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdcde5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.556796:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdcde5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.556810:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdcdec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.556815:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdcdec lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.556828:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdcdec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.556833:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd67c00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:2.0:1783071511.556837:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdcdec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.556842:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdcdec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.556851:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f8a020caf00) 00010000:00010000:2.0:1783071511.556854:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071511.556856:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdcdec lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.556861:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdcdec lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.556909:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66400/0x6b58994c2cbdcdde lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99082 expref: 39 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.556923:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66e00/0x6b58994c2cbdcdf3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99082 expref: 38 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.556929:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f8a0179f900) 00010000:00010000:2.0:1783071511.556931:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1783071511.556934:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b2fd66e00, rc 0) 00000100:00100000:2.0:1783071511.557016:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+38:12408:x1869685692918144:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 792us (1084us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1783071511.557034:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 211 00000100:00100000:1.0:1783071511.566580:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071511.567046:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692918272 00000100:00100000:3.0:1783071511.567057:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692918272 00000100:00100000:3.0:1783071511.567138:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 212 00000100:00100000:3.0:1783071511.567150:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03bd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+38:12408:x1869685692918272:12345-192.168.204.38@tcp:54:lfs.0 00010000:00010000:3.0:1783071511.567231:0:13815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdce01 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.567249:0:13815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdcd98 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99066 expref: 38 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.567260:0:13815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdce01 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.567295:0:13815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdcd98 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99066 expref: 38 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.567310:0:13815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdcd98 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99066 expref: 38 pid: 6518 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071511.567349:0:13815:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0411e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13815:1869685707650304:192.168.204.38@tcp:104: 00000100:00100000:3.0:1783071511.567487:0:13815:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b2fc82300 going to sleep for 11 seconds 00000100:00100000:3.0:1783071511.571716:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071511.571980:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692918528 00000100:00100000:0.0:1783071511.571992:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692918528 00000100:00100000:0.0:1783071511.572090:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 52 00000100:00100000:0.0:1783071511.572102:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0411fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+39:6169:x1869685692918528:12345-192.168.204.38@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1783071511.572481:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0411fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+40:6169:x1869685692918528:12345-192.168.204.38@tcp:35:ldlm_bl.0 Request processed in 380us (775us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1783071511.572490:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 52 00000100:00100000:1.0:1783071511.575292:0:13815:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0411e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13815:1869685707650304:192.168.204.38@tcp:104: 00010000:00010000:1.0:1783071511.575332:0:13815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdce01 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071511.577466:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071511.577995:0:7923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692918656 00000100:00100000:1.0:1783071511.578005:0:7923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692918656 00010000:00010000:1.0:1783071511.578044:0:7923:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdcd98 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99066 expref: 40 pid: 6518 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071511.578105:0:7923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 95 00000100:00100000:1.0:1783071511.578115:0:7923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b99f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf7532e4-6153-424a-9f4e-84941256b41f+40:2405:x1869685692918656:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783071511.578135:0:7923:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071511.578141:0:7923:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdcd98 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99066 expref: 40 pid: 6518 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071511.578155:0:7923:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdcd98 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99066 expref: 40 pid: 6518 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071511.578178:0:7923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdcd98 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99066 expref: 40 pid: 6518 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071511.578194:0:7923:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f8a0179f900) 00010000:00010000:1.0:1783071511.578199:0:7923:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdce01 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071511.578209:0:7923:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdce01 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071511.578216:0:7923:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdce01 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071511.578250:0:7923:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071511.578315:0:7923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b99f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf7532e4-6153-424a-9f4e-84941256b41f+39:2405:x1869685692918656:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 200us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071511.578323:0:7923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 95 00010000:00010000:3.0:1783071511.578898:0:13815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdce01 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.578908:0:13815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdce01 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.578951:0:13815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdce01 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.578960:0:13815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdce01 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.578967:0:13815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdce01 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.578973:0:13815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01749e00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071511.578977:0:13815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdce01 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.578985:0:13815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdce01 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.578996:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f8a0179f900) 00010000:00010000:3.0:1783071511.579000:0:13815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783071511.579004:0:13815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdce01 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.579024:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdce01 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071511.579098:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03bd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+38:12408:x1869685692918272:12345-192.168.204.38@tcp:54:lfs.0 Request processed in 11950us (12527us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071511.579108:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 212 00000100:00100000:0.0:1783071511.584169:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071511.584571:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692918912 00000100:00100000:2.0:1783071511.584583:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692918912 00000100:00100000:2.0:1783071511.584691:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 53 00000100:00100000:2.0:1783071511.584703:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+38:12408:x1869685692918912:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1783071511.585000:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+39:12408:x1869685692918912:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 298us (941us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1783071511.585009:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 53 00000100:00100000:2.0:1783071511.676730:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071511.676860:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692919168 00000100:00100000:3.0:1783071511.676871:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692919168 00000100:00100000:3.0:1783071511.676943:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 213 00000100:00100000:3.0:1783071511.676956:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03ad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+39:12419:x1869685692919168:12345-192.168.204.38@tcp:101:cat.0 00010000:00010000:3.0:1783071511.676982:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071511.677003:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdce08 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d99089 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.677091:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdce0f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.677109:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdce0f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.677121:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdce0f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.677136:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdce16 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.677143:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdce16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.677169:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdce16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.677293:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdce1d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.677303:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdce1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.677309:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdce1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783071511.677321:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:3.0:1783071511.677458:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdce0f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.677466:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdce0f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.677473:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdce0f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.677479:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01748000 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071511.677483:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdce0f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.677491:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdce0f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.677503:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f8a021bdc00) 00010000:00010000:3.0:1783071511.677506:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071511.677517:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdce0f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.677524:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdce0f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.677539:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdce16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.677792:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdce16 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.677802:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdce16 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.677808:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01749600 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071511.677811:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdce16 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.677818:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdce16 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.677829:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f8a0179f200) 00010000:00010000:3.0:1783071511.677831:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071511.677834:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdce16 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.677841:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdce16 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.677892:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdce08 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99089 expref: 42 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.677921:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdce1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99089 expref: 41 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.677928:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f8a0179f900) 00010000:00010000:3.0:1783071511.677930:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783071511.677933:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a01749000, rc 0) 00000100:00100000:3.0:1783071511.678022:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03ad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+41:12419:x1869685692919168:12345-192.168.204.38@tcp:101:cat.0 Request processed in 1068us (1303us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1783071511.678029:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 213 00000100:00100000:0.0:1783071511.689300:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071511.689400:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692919424 00000100:00100000:3.0:1783071511.689411:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692919424 00000100:00100000:3.0:1783071511.689491:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 54 00000100:00100000:3.0:1783071511.689504:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+41:12419:x1869685692919424:12345-192.168.204.38@tcp:35:cat.0 00000100:00100000:3.0:1783071511.689911:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+42:12419:x1869685692919424:12345-192.168.204.38@tcp:35:cat.0 Request processed in 408us (621us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1783071511.689919:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 54 00000100:00100000:0.0:1783071511.715153:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071511.715263:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692919680 00000100:00100000:2.0:1783071511.715274:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692919680 00000100:00100000:2.0:1783071511.715344:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 214 00000100:00100000:2.0:1783071511.715354:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+42:12420:x1869685692919680:12345-192.168.204.38@tcp:36:rm.0 00010000:00010000:2.0:1783071511.715481:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1783071511.715517:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdcdbb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99074 expref: 42 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.715540:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdce1d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99089 expref: 41 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.715569:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66e00/0x6b58994c2cbdcdf3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99082 expref: 40 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.715581:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdcdad lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9906d expref: 39 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.715611:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f8a0179f900) 00010000:00010000:2.0:1783071511.715616:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783071511.716074:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdce2b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.716089:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdce2b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.716099:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdce2b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.716114:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdce32 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.716121:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdce32 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.716128:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdce32 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.716210:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdce39 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.716219:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdce39 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.716226:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdce39 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783071511.716931:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:2.0:1783071511.716945:0:6518:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 413505580401ns, next at 414505577036ns, rc = 0 00010000:00010000:2.0:1783071511.717025:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdce40 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.717040:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdce40 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.717050:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdce40 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.717059:0:6518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdce40 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.717066:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdce40 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.717072:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdce40 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.717138:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783071511.717161:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdce39 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.717168:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdce39 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.717175:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdce39 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.717181:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd66600 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:2.0:1783071511.717187:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdce39 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.717193:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdce39 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.717215:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f8a0179f900) 00010000:00010000:2.0:1783071511.717218:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1783071511.717223:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdce39 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.717229:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdce39 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.717246:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdce2b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.717253:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdce2b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.717259:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdce2b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.717264:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd66c00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:2.0:1783071511.717268:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdce2b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.717273:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdce2b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.717281:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f8a021bdc00) 00010000:00010000:2.0:1783071511.717283:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071511.717286:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdce2b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.717292:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdce2b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783071511.717314:0:6518:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b75324a0 reply state 0000000012214667 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdce32 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.717326:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdce32 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.717332:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f8a020caf00) 00010000:00010000:2.0:1783071511.717334:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783071511.717337:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783071511.717487:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+40:12420:x1869685692919680:12345-192.168.204.38@tcp:36:rm.0 Request processed in 2131us (2341us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1783071511.717505:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 214 00010000:00010000:0.0:1783071511.718947:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783071511.718963:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdce40 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071511.718976:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd67200 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:0.0:1783071511.718980:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdce40 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071511.718989:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdce40 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071511.719037:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f8a0179f900) 00010000:00010000:0.0:1783071511.719040:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783071511.719045:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdce40 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071511.719051:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdce40 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071511.719071:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071511.719073:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071511.719075:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071511.787666:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071511.790455:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692919936 00000100:00100000:3.0:1783071511.790472:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692919936 00000100:00100000:3.0:1783071511.790581:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 215 00000100:00100000:3.0:1783071511.790593:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+40:12426:x1869685692919936:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:3.0:1783071511.790634:0:13815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071511.790660:0:13815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdce47 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d99090 expref: -99 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.790794:0:13815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdce4e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.790818:0:13815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdce4e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.790830:0:13815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdce4e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.790841:0:13815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdce55 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.790848:0:13815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdce55 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.790854:0:13815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdce55 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783071511.791216:0:13815:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:3.0:1783071511.791411:0:13815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdce5c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.791422:0:13815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdce5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.791429:0:13815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdce5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.791464:0:13815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdce4e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.791471:0:13815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdce4e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.791477:0:13815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdce4e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.791490:0:13815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01749600 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071511.791494:0:13815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdce4e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.791501:0:13815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdce4e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.791513:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f8a021bdc00) 00010000:00010000:3.0:1783071511.791516:0:13815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071511.791520:0:13815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdce4e lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.791527:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdce4e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783071511.791539:0:13815:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000212330e7 reply state 000000000eabce02 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdce55 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.791563:0:13815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdce55 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.791570:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f8a020caf00) 00010000:00010000:3.0:1783071511.791572:0:13815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783071511.791575:0:13815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783071511.791602:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdce47 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99090 expref: 43 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.791615:0:13815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdce5c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99090 expref: 42 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071511.791632:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f8a0179f200) 00010000:00010000:3.0:1783071511.791634:0:13815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783071511.791636:0:13815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a01749c00, rc 0) 00000100:00100000:3.0:1783071511.791704:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+43:12426:x1869685692919936:12345-192.168.204.38@tcp:101:bash.0 Request processed in 1113us (4047us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1783071511.791712:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 215 00000100:00100000:2.0:1783071511.799620:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071511.802225:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692920064 00000100:00100000:0.0:1783071511.802241:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692920064 00000100:00100000:0.0:1783071511.802412:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 67 00000100:00100000:0.0:1783071511.802423:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b2fcb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf7532e4-6153-424a-9f4e-84941256b41f+7:2405:x1869685692920064:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:0.0:1783071511.802441:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071511.802459:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000436842a5/0x6b58994c2cbdce6a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d99097 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783071511.802480:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783071511.802693:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=413s v=(0 0) 00010000:00010000:0.0:1783071511.802699:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071511.802711:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000436842a5/0x6b58994c2cbdce6a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99097 expref: 8 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071511.802733:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000436842a5/0x6b58994c2cbdce6a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99097 expref: 8 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071511.802781:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a03865c00, rc 0) 00000100:00100000:0.0:1783071511.802863:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b2fcb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf7532e4-6153-424a-9f4e-84941256b41f+8:2405:x1869685692920064:12345-192.168.204.38@tcp:101:bash.0 Request processed in 441us (3251us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071511.802872:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 67 00000100:00080000:3.0:1783071511.803965:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:0.0:1783071511.810643:0:13796:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783071511.810835:0:13796:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783071511.810948:0:13796:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1783071511.810957:0:13796:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1783071511.811044:0:13798:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1783071511.811570:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:0.0:1783071511.811743:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071511.812751:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692920192 00000100:00100000:2.0:1783071511.812763:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692920192 00000100:00100000:2.0:1783071511.812832:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 68 00000100:00100000:2.0:1783071511.812842:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0411d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf7532e4-6153-424a-9f4e-84941256b41f+8:12426:x1869685692920192:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:2.0:1783071511.812860:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071511.812876:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000038eddc02/0x6b58994c2cbdce71 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d9909e expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.812921:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000436842a5/0x6b58994c2cbdce6a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99097 expref: 9 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.812930:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783071511.812934:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783071511.812939:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038eddc02/0x6b58994c2cbdce71 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9909e expref: 9 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.812991:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000436842a5/0x6b58994c2cbdce6a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99097 expref: 9 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.813006:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000436842a5/0x6b58994c2cbdce6a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99097 expref: 9 pid: 8432 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071511.813021:0:8431:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0397d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8431:1869685707650432:192.168.204.38@tcp:104: 00000100:00100000:2.0:1783071511.813134:0:8431:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a038bc600 going to sleep for 11 seconds 00000100:00100000:2.0:1783071511.816119:0:8431:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0397d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8431:1869685707650432:192.168.204.38@tcp:104: 00010000:00010000:2.0:1783071511.816154:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000038eddc02/0x6b58994c2cbdce71 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9909e expref: 9 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.816174:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b2fd66c00, rc 0) 00000100:00100000:2.0:1783071511.816234:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0411d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf7532e4-6153-424a-9f4e-84941256b41f+9:12426:x1869685692920192:12345-192.168.204.38@tcp:101:bash.0 Request processed in 3392us (4668us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071511.816244:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 68 00000100:00100000:0.0:1783071511.817395:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071511.817501:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692920320 00000100:00100000:2.0:1783071511.817510:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692920320 00010000:00010000:2.0:1783071511.817566:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000436842a5/0x6b58994c2cbdce6a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99097 expref: 9 pid: 8432 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071511.817612:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 96 00000100:00100000:2.0:1783071511.817624:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab89050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf7532e4-6153-424a-9f4e-84941256b41f+9:2403:x1869685692920320:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783071511.817818:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071511.817843:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000436842a5/0x6b58994c2cbdce6a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99097 expref: 9 pid: 8432 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.817858:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000436842a5/0x6b58994c2cbdce6a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99097 expref: 9 pid: 8432 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.817898:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000436842a5/0x6b58994c2cbdce6a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99097 expref: 9 pid: 8432 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.817915:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783071511.817920:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783071511.817929:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000038eddc02/0x6b58994c2cbdce71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9909e expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.818090:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038eddc02/0x6b58994c2cbdce71 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9909e expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071511.818129:0:6501:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000038eddc02/0x6b58994c2cbdce71 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9909e expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071511.818143:0:6501:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0397d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6501:1869685707650560:192.168.204.38@tcp:105: 00000100:00100000:2.0:1783071511.818232:0:6501:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a038bc600 going to sleep for 11 seconds 00000100:00100000:3.0:1783071511.827838:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071511.827954:0:6501:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0397d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6501:1869685707650560:192.168.204.38@tcp:105: 00010000:00010000:2.0:1783071511.827977:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071511.828067:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab89050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf7532e4-6153-424a-9f4e-84941256b41f+8:2403:x1869685692920320:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 10444us (10677us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071511.828078:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 96 00000100:00100000:1.0:1783071511.828399:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692920576 00000100:00100000:1.0:1783071511.828406:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692920576 00000100:00100000:1.0:1783071511.828451:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 55 00000100:00100000:1.0:1783071511.828460:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0411ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+43:12426:x1869685692920576:12345-192.168.204.38@tcp:35:bash.0 00000100:00100000:1.0:1783071511.828997:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0411ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+44:12426:x1869685692920576:12345-192.168.204.38@tcp:35:bash.0 Request processed in 537us (1169us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1783071511.829007:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 55 00000100:00100000:1.0:1783071511.874739:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783071511.874764:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03b9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707650688:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783071511.874844:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071511.875001:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707650688 00000100:00100000:0.0:1783071511.875010:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707650688 00000100:00100000:0.0:1783071511.875066:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1783071511.875075:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707650688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783071511.875111:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783071511.875166:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707650688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071511.875173:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1783071511.875292:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03b9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707650688:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783071512.017960:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071512.018109:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692920704 00000100:00100000:2.0:1783071512.018120:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692920704 00000100:00100000:2.0:1783071512.018198:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 216 00000100:00100000:2.0:1783071512.018209:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0411c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+44:12442:x1869685692920704:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1783071512.018233:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071512.018255:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdce78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d990a5 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.018321:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66e00/0x6b58994c2cbdce7f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.018336:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66e00/0x6b58994c2cbdce7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.018347:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66e00/0x6b58994c2cbdce7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071512.018419:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1783071512.018424:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783071512.018443:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66e00/0x6b58994c2cbdce7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.018468:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdce78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990a5 expref: 46 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.018485:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66e00/0x6b58994c2cbdce7f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990a5 expref: 45 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.018507:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f8a021bdc00) 00010000:00010000:2.0:1783071512.018510:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783071512.018513:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b2fd66e00, rc 0) 00000100:00100000:2.0:1783071512.018593:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0411c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+45:12442:x1869685692920704:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 385us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071512.018600:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 216 00000100:00100000:3.0:1783071512.024186:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071512.024291:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692920960 00000100:00100000:2.0:1783071512.024301:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692920960 00000100:00100000:2.0:1783071512.024419:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 217 00000100:00100000:2.0:1783071512.024431:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0411d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+45:12442:x1869685692920960:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1783071512.024452:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071512.024475:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdce86 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d990ac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.024631:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdce8d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.024648:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdce8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.024661:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdce8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071512.024674:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1783071512.024782:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdce86 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990ac expref: 48 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.024815:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdce8d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990ac expref: 47 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.024824:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f8a0179f200) 00010000:00010000:2.0:1783071512.024828:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783071512.024831:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b2fd66200, rc 0) 00000100:00100000:2.0:1783071512.024898:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0411d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+47:12442:x1869685692920960:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 469us (721us total) trans 4294967486 rc 0/0 00000100:00100000:2.0:1783071512.024906:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 217 00000100:00100000:0.0:1783071512.038524:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071512.038580:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071512.038709:0:7923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692921088 00000100:00100000:1.0:1783071512.038719:0:7923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692921088 00000100:00100000:1.0:1783071512.038785:0:7923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 15 00000100:00100000:1.0:1783071512.038795:0:7923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b99180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf7532e4-6153-424a-9f4e-84941256b41f+47:2406:x1869685692921088:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783071512.038811:0:7923:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071512.038835:0:7923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdce8d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990ac expref: 47 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071512.038854:0:7923:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f8a0179f200) 00010000:00010000:1.0:1783071512.038859:0:7923:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071512.038924:0:7923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b99180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf7532e4-6153-424a-9f4e-84941256b41f+46:2406:x1869685692921088:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 130us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071512.038941:0:7923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 15 00000100:00100000:3.0:1783071512.039142:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692921344 00000100:00100000:3.0:1783071512.039147:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692921344 00000100:00100000:3.0:1783071512.039188:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 218 00000100:00100000:3.0:1783071512.039196:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+46:12442:x1869685692921344:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1783071512.039217:0:13815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071512.039232:0:13815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdce9b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d990b3 expref: -99 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071512.039335:0:13815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdcea2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071512.039349:0:13815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdcea2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071512.039359:0:13815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdcea2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783071512.039440:0:13815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1783071512.039552:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdce9b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990b3 expref: 49 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071512.039567:0:13815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdcea2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990b3 expref: 48 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071512.039575:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f8a0179f200) 00010000:00010000:3.0:1783071512.039577:0:13815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1783071512.039580:0:13815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a01749600, rc 0) 00000100:00100000:3.0:1783071512.039626:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+48:12442:x1869685692921344:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 426us (1041us total) trans 4294967487 rc 0/0 00000100:00100000:3.0:1783071512.039633:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 218 00000100:00100000:0.0:1783071512.053934:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071512.054042:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692921472 00000100:00100000:2.0:1783071512.054052:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692921472 00000100:00100000:2.0:1783071512.054131:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 69 00000100:00100000:2.0:1783071512.054144:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf7532e4-6153-424a-9f4e-84941256b41f+8:2405:x1869685692921472:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:2.0:1783071512.054195:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b3749a1/0x6b58994c2cbdceb0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.054217:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000038eddc02/0x6b58994c2cbdce71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9909e expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.054225:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783071512.054229:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783071512.054234:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b3749a1/0x6b58994c2cbdceb0 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.054269:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000038eddc02/0x6b58994c2cbdce71 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9909e expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.054300:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000038eddc02/0x6b58994c2cbdce71 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9909e expref: 8 pid: 8431 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071512.054315:0:8429:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0397d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8429:1869685707650816:192.168.204.38@tcp:104: 00000100:00100000:2.0:1783071512.054465:0:8429:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a038bc480 going to sleep for 11 seconds 00000100:00100000:0.0:1783071512.057875:0:8429:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0397d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8429:1869685707650816:192.168.204.38@tcp:104: 00010000:00010000:0.0:1783071512.057907:0:8429:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004b3749a1/0x6b58994c2cbdceb0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071512.058276:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071512.058497:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692921600 00000100:00100000:2.0:1783071512.058505:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692921600 00002000:00100000:2.0:1783071512.058563:0:8436:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8f8a03b9a300 x1869685692921600/t0(0) o4->bf7532e4-6153-424a-9f4e-84941256b41f@192.168.204.38@tcp:103/0 lens 504/0 e 0 to 0 dl 1783071523 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783071512.058573:0:8436:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8f8a03b9a300 with x1869685692921600 ext(0->8) 00010000:00010000:2.0:1783071512.058581:0:8436:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000038eddc02/0x6b58994c2cbdce71 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9909e expref: 9 pid: 8431 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.058595:0:8436:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000038eddc02/0x6b58994c2cbdce71 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9909e expref: 9 pid: 8431 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783071512.058602:0:8436:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8f8a03b9a300 00000100:00100000:2.0:1783071512.058640:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3 00000100:00100000:2.0:1783071512.058650:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bf7532e4-6153-424a-9f4e-84941256b41f+9:2405:x1869685692921600:12345-192.168.204.38@tcp:4:lfs.0 00000100:00100000:2.0:1783071512.061077:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bf7532e4-6153-424a-9f4e-84941256b41f+11:2405:x1869685692921600:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 2415us (2789us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1783071512.061093:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3 00002000:00100000:2.0:1783071512.061105:0:8436:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8f8a03b9a300 x1869685692921600/t4294967309(0) o4->bf7532e4-6153-424a-9f4e-84941256b41f@192.168.204.38@tcp:103/0 lens 504/448 e 0 to 0 dl 1783071523 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783071512.061137:0:8436:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8f8a03b9a300 with x1869685692921600 ext(0->8) 00010000:00010000:2.0:1783071512.061149:0:8436:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000038eddc02/0x6b58994c2cbdce71 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9909e expref: 11 pid: 8431 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.061169:0:8436:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000038eddc02/0x6b58994c2cbdce71 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9909e expref: 11 pid: 8431 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783071512.061178:0:8436:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8f8a03b9a300 00000100:00100000:2.0:1783071512.074689:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071512.075286:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692921728 00000100:00100000:3.0:1783071512.075296:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692921728 00010000:00010000:3.0:1783071512.075340:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000038eddc02/0x6b58994c2cbdce71 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9909e expref: 11 pid: 8431 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071512.075455:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 97 00000100:00100000:3.0:1783071512.075467:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0397d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf7532e4-6153-424a-9f4e-84941256b41f+11:2406:x1869685692921728:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783071512.075484:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1783071512.075504:0:6503:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1783071512.075507:0:6503:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1783071512 00002000:00010000:3.0:1783071512.075509:0:6503:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1783071512 00002000:00010000:3.0:1783071512.075512:0:6503:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1783071512 00002000:00010000:3.0:1783071512.075514:0:6503:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1783071512.075535:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000038eddc02/0x6b58994c2cbdce71 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9909e expref: 11 pid: 8431 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071512.075562:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000038eddc02/0x6b58994c2cbdce71 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9909e expref: 11 pid: 8431 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071512.075587:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038eddc02/0x6b58994c2cbdce71 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9909e expref: 11 pid: 8431 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071512.075607:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783071512.075611:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783071512.075628:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004b3749a1/0x6b58994c2cbdceb0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071512.075639:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b3749a1/0x6b58994c2cbdceb0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071512.075666:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783071512.075733:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0397d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf7532e4-6153-424a-9f4e-84941256b41f+10:2406:x1869685692921728:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 267us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071512.075742:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 97 00010000:00010000:0.0:1783071512.076316:0:8429:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004b3749a1/0x6b58994c2cbdceb0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.076329:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b3749a1/0x6b58994c2cbdceb0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.076353:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b3749a1/0x6b58994c2cbdceb0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.076398:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b3749a1/0x6b58994c2cbdceb0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.076407:0:8429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b3749a1/0x6b58994c2cbdceb0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.076414:0:8429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd67c00 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:0.0:1783071512.076419:0:8429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b3749a1/0x6b58994c2cbdceb0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.076429:0:8429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b3749a1/0x6b58994c2cbdceb0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.076443:0:8429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b3749a1/0x6b58994c2cbdceb0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.076464:0:8429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b3749a1/0x6b58994c2cbdceb0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071512.076560:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf7532e4-6153-424a-9f4e-84941256b41f+9:2405:x1869685692921472:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 22418us (22639us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071512.076570:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 69 00000100:00100000:2.0:1783071512.083565:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071512.083701:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692921984 00000100:00100000:0.0:1783071512.083711:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692921984 00000100:00100000:0.0:1783071512.083950:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 56 00000100:00100000:0.0:1783071512.083960:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0699c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+48:12442:x1869685692921984:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:0.0:1783071512.084021:0:6519:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdcea2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990b3 expref: 48 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783071512.084351:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:0.0:1783071512.084506:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1783071512.084891:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:0.0:1783071512.084923:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdceb7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.084936:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdce5c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99090 expref: 52 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.085138:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdceb7 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.085179:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdce5c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99090 expref: 52 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.085287:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdce5c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99090 expref: 52 pid: 13815 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071512.085307:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03b99f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6519:1869685707650944:192.168.204.38@tcp:104: 00000100:00100000:0.0:1783071512.085536:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a038a8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783071512.091949:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071512.093351:0:7923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692922112 00000100:00100000:3.0:1783071512.093401:0:7923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692922112 00010000:00010000:3.0:1783071512.093447:0:7923:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdce5c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99090 expref: 53 pid: 13815 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071512.093503:0:7923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 98 00000100:00100000:3.0:1783071512.093514:0:7923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a9df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf7532e4-6153-424a-9f4e-84941256b41f+53:2406:x1869685692922112:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783071512.093554:0:7923:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071512.093562:0:7923:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdce5c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99090 expref: 53 pid: 13815 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071512.093577:0:7923:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdce5c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99090 expref: 53 pid: 13815 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071512.093602:0:7923:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f8a0179f200) 00010000:00010000:3.0:1783071512.093607:0:7923:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdceb7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071512.093617:0:7923:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdceb7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071512.093626:0:7923:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdceb7 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071512.093647:0:7923:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783071512.093703:0:7923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a9df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf7532e4-6153-424a-9f4e-84941256b41f+53:2406:x1869685692922112:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 190us (1763us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071512.093711:0:7923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 98 00010000:00010000:0.0:1783071512.094902:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdce5c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99090 expref: 52 pid: 13815 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071512.094922:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03b99f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6519:1869685707650944:192.168.204.38@tcp:104: 00010000:00010000:0.0:1783071512.094953:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdceb7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.094963:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdceb7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.094969:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdceb7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783071512.095088:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:0.0:1783071512.095208:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:0.0:1783071512.095304:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03b99f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6519:1869685707651072:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1783071512.095465:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071512.095500:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a038a8900 going to sleep for 11 seconds 00000100:00100000:1.0:1783071512.095889:0:9413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707651072 00000100:00100000:1.0:1783071512.095897:0:9413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707651072 00000100:00100000:1.0:1783071512.096003:0:9413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1783071512.096020:0:9413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0391e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6519:x1869685707651072:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1783071512.096135:0:9413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0391e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6519:x1869685707651072:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 116us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071512.096142:0:9413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1783071512.096180:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03b99f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6519:1869685707651072:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1783071512.096307:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:3.0:1783071512.096397:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0411df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6519:1869685707651200:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1783071512.096433:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071512.096449:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b3b640000 going to sleep for 11 seconds 00000100:00100000:1.0:1783071512.096567:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707651200 00000100:00100000:1.0:1783071512.096572:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707651200 00000100:00100000:1.0:1783071512.096603:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1783071512.096610:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0411ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6519:x1869685707651200:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1783071512.096726:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0411ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6519:x1869685707651200:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 116us (292us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1783071512.096734:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1783071512.096874:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0411df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6519:1869685707651200:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1783071512.096922:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:3.0:1783071512.097037:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdceb7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071512.097047:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdceb7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071512.097055:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdceb7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071512.097060:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03865a00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071512.097064:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdceb7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071512.097071:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdceb7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071512.097086:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f8a0179f200) 00010000:00010000:3.0:1783071512.097089:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1783071512.097094:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdceb7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071512.097100:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdceb7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783071512.097189:0:6519:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1783071512.097250:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:3.0:1783071512.097262:0:6519:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 413885896629ns, next at 414885894084ns, rc = 0 00000001:00080000:3.0:1783071512.097268:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:3.0:1783071512.097292:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f8a0179f200) 00010000:00010000:3.0:1783071512.097295:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1783071512.097308:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdcea2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990b3 expref: 56 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071512.097650:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0699c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+55:12442:x1869685692921984:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 13689us (14092us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1783071512.097660:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 56 00000020:00080000:0.0:1783071512.097672:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:2.0:1783071512.098385:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783071512.100734:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071512.100830:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692922240 00000100:00100000:2.0:1783071512.100840:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692922240 00000100:00100000:2.0:1783071512.101045:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 219 00000100:00100000:2.0:1783071512.101055:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+55:12442:x1869685692922240:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1783071512.101080:0:10292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071512.101100:0:10292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66400/0x6b58994c2cbdcebe lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d990ba expref: -99 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.101159:0:10292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66400/0x6b58994c2cbdcebe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990ba expref: 56 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.101173:0:10292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66400/0x6b58994c2cbdcebe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990ba expref: 56 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.101191:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f8a020ca100) 00010000:00010000:2.0:1783071512.101207:0:10292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783071512.101211:0:10292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b2fd66400, rc 0) 00000100:00100000:2.0:1783071512.101271:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+56:12442:x1869685692922240:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 217us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071512.101278:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 219 00000100:00100000:1.0:1783071512.106277:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071512.106351:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692922496 00000100:00100000:3.0:1783071512.106361:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692922496 00000100:00100000:3.0:1783071512.106438:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 57 00000100:00100000:3.0:1783071512.106448:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+56:12442:x1869685692922496:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1783071512.106724:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+57:12442:x1869685692922496:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 276us (453us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1783071512.106736:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 57 00000100:00100000:1.0:1783071512.173756:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071512.173990:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692922624 00000100:00100000:0.0:1783071512.174002:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692922624 00000100:00100000:0.0:1783071512.174073:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 220 00000100:00100000:0.0:1783071512.174085:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+57:12452:x1869685692922624:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:0.0:1783071512.174174:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdcec5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.174196:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdcec5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.174209:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdcec5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.174222:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdcecc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.174230:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdcecc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.174236:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdcecc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.174326:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865200/0x6b58994c2cbdced3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.174335:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865200/0x6b58994c2cbdced3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.174343:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865200/0x6b58994c2cbdced3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783071512.174444:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865200/0x6b58994c2cbdced3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.175255:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdcec5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.175264:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdcec5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.175272:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdcec5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.175278:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03864600 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:0.0:1783071512.175283:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdcec5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.175290:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdcec5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.175306:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f8a021bdc00) 00010000:00010000:0.0:1783071512.175310:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071512.175314:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdcec5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.175320:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdcec5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.175337:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdcecc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.175343:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdcecc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.175347:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdcecc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.175360:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03865a00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:0.0:1783071512.175669:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdcecc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.175679:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdcecc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.175688:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f8a020caf00) 00010000:00010000:0.0:1783071512.175690:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071512.175694:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdcecc lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.175699:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdcecc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.175710:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865200/0x6b58994c2cbdced3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.175716:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865200/0x6b58994c2cbdced3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.175722:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865200/0x6b58994c2cbdced3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.175727:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03865200 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:0.0:1783071512.175729:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865200/0x6b58994c2cbdced3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.175735:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865200/0x6b58994c2cbdced3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.175755:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f8a020ca100) 00010000:00010000:0.0:1783071512.175757:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071512.175760:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865200/0x6b58994c2cbdced3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.175765:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865200/0x6b58994c2cbdced3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071512.175862:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+57:12452:x1869685692922624:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 1777us (2113us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071512.175871:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 220 00000100:00100000:1.0:1783071512.216274:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071512.216458:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692922880 00000100:00100000:2.0:1783071512.216479:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692922880 00000100:00100000:2.0:1783071512.216559:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 221 00000100:00100000:2.0:1783071512.216570:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03af3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+57:12455:x1869685692922880:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1783071512.216592:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071512.216614:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdceda lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d990c1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.216692:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdcee1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.216709:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdcee1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.216723:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdcee1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.216733:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdcee8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.216741:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdcee8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.216747:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdcee8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.216897:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdceef lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.216908:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdceef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.216915:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdceef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071512.216926:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1783071512.217014:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdcee1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.217022:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdcee1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.217028:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdcee1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.217034:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd67c00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:2.0:1783071512.217039:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdcee1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.217047:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdcee1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.217060:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f8a021bdc00) 00010000:00010000:2.0:1783071512.217063:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071512.217068:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdcee1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.217083:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdcee1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.217098:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdcee8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.217105:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdcee8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.217110:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdcee8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.217115:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd66200 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:2.0:1783071512.217119:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdcee8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.219824:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdcee8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.219843:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f8a020caf00) 00010000:00010000:2.0:1783071512.219845:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071512.219849:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdcee8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.219857:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdcee8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.220125:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdceda lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990c1 expref: 60 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.220137:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdceef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990c1 expref: 59 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.220157:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f8a020ca100) 00010000:00010000:2.0:1783071512.220159:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783071512.220161:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b2fd66600, rc 0) 00000100:00100000:2.0:1783071512.220284:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03af3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+59:12455:x1869685692922880:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 3715us (4027us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1783071512.220292:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 221 00000100:00100000:1.0:1783071512.228862:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071512.229196:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692923008 00000100:00100000:2.0:1783071512.229206:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692923008 00000100:00100000:2.0:1783071512.229387:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 222 00000100:00100000:2.0:1783071512.229399:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03af1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+59:12455:x1869685692923008:12345-192.168.204.38@tcp:54:lfs.0 00010000:00010000:2.0:1783071512.229469:0:10292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdcefd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.229486:0:10292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdcefd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.229498:0:10292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdcefd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.229533:0:10292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdcefd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.229551:0:10292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdcefd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.229558:0:10292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdcefd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.229564:0:10292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd66c00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:2.0:1783071512.229592:0:10292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdcefd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.229600:0:10292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdcefd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.229674:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f8a020ca100) 00010000:00010000:2.0:1783071512.229678:0:10292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783071512.229684:0:10292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdcefd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.229691:0:10292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdcefd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071512.229810:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03af1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+59:12455:x1869685692923008:12345-192.168.204.38@tcp:54:lfs.0 Request processed in 413us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071512.229818:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 222 00000100:00100000:1.0:1783071512.232236:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071512.232329:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692923264 00000100:00100000:3.0:1783071512.232338:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692923264 00000100:00100000:3.0:1783071512.232552:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 58 00000100:00100000:3.0:1783071512.232564:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03af2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+59:12455:x1869685692923264:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1783071512.232916:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03af2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+60:12455:x1869685692923264:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 354us (689us total) trans 4294967499 rc 0/0 00000100:00100000:3.0:1783071512.232991:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 58 00000100:00100000:1.0:1783071512.293678:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071512.293790:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692923520 00000100:00100000:0.0:1783071512.293800:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692923520 00000100:00100000:0.0:1783071512.293927:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 223 00000100:00100000:0.0:1783071512.293939:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03af0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+60:12465:x1869685692923520:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:0.0:1783071512.293965:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071512.293969:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1783071512.293995:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66e00/0x6b58994c2cbdce7f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990a5 expref: 60 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.294016:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f8a021bdc00) 00010000:00010000:0.0:1783071512.294020:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783071512.294034:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865200/0x6b58994c2cbdcf04 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d990c8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.294140:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdcf0b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.294170:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdceef lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990c1 expref: 60 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.294179:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdcf0b lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.294214:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdceef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990c1 expref: 60 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.294227:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdceef lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990c1 expref: 60 pid: 6516 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071512.294240:0:6517:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0391f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1869685707651328:192.168.204.38@tcp:104: 00000100:00100000:0.0:1783071512.294333:0:6517:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a038a8180 going to sleep for 11 seconds 00000100:00100000:0.0:1783071512.299859:0:6517:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0391f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1869685707651328:192.168.204.38@tcp:104: 00010000:00010000:0.0:1783071512.299901:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdcf0b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071512.300253:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071512.300438:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692923648 00000100:00100000:2.0:1783071512.300445:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692923648 00010000:00010000:2.0:1783071512.300480:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdceef lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990c1 expref: 61 pid: 6516 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071512.300517:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 99 00000100:00100000:2.0:1783071512.300527:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03af1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf7532e4-6153-424a-9f4e-84941256b41f+61:2405:x1869685692923648:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783071512.300552:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071512.300558:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdceef lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990c1 expref: 61 pid: 6516 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.300572:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdceef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990c1 expref: 61 pid: 6516 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.300608:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdceef lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990c1 expref: 61 pid: 6516 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.300624:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f8a020ca100) 00010000:00010000:2.0:1783071512.300629:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdcf0b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.300639:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdcf0b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.300647:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdcf0b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.300711:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071512.300768:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03af1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf7532e4-6153-424a-9f4e-84941256b41f+60:2405:x1869685692923648:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 242us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071512.300777:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 99 00010000:00010000:0.0:1783071512.302124:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdcf0b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.302139:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdcf0b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783071512.302161:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1783071512.302680:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865200/0x6b58994c2cbdcf04 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990c8 expref: 61 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.302716:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdcf0b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990c8 expref: 60 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.302725:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f8a020ca100) 00010000:00010000:0.0:1783071512.302729:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783071512.302732:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a03865a00, rc 0) 00000100:00100000:0.0:1783071512.302844:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03af0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+60:12465:x1869685692923520:12345-192.168.204.38@tcp:101:bash.0 Request processed in 8906us (9175us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1783071512.302853:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 223 00000100:00100000:1.0:1783071512.309753:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071512.309951:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692923776 00000100:00100000:2.0:1783071512.309960:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692923776 00000100:00100000:2.0:1783071512.310064:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 224 00000100:00100000:2.0:1783071512.310075:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03af1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+60:12465:x1869685692923776:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:2.0:1783071512.310102:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071512.310123:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdcf19 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d990cf expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.310155:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdcf20 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.310188:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdcf20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.310199:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdcf20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.310490:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdcf19 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990cf expref: 62 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.310510:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdcf20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990cf expref: 61 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.310518:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f8a020ca100) 00010000:00010000:2.0:1783071512.310521:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783071512.310524:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b2fd66c00, rc 0) 00000100:00100000:2.0:1783071512.310605:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03af1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+61:12465:x1869685692923776:12345-192.168.204.38@tcp:101:bash.0 Request processed in 531us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071512.310612:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 224 00000100:00100000:1.0:1783071512.315197:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071512.315282:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692924032 00000100:00100000:2.0:1783071512.315361:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692924032 00000100:00100000:2.0:1783071512.315444:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 225 00000100:00100000:2.0:1783071512.315453:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03af2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+61:12465:x1869685692924032:12345-192.168.204.38@tcp:36:bash.0 00010000:00010000:2.0:1783071512.315849:0:10292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdcf27 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.315868:0:10292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdcf27 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.315898:0:10292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdcf27 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783071512.315941:0:10292:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:2.0:1783071512.315964:0:10292:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009508389e reply state 00000000c825a7f8 transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdcf27 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.315977:0:10292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdcf27 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.315984:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f8a020ca100) 00010000:00010000:2.0:1783071512.315987:0:10292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783071512.315990:0:10292:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783071512.316826:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03af2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+64:12465:x1869685692924032:12345-192.168.204.38@tcp:36:bash.0 Request processed in 1368us (1633us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1783071512.316837:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 225 00000020:00080000:2.0:1783071512.316842:0:10292:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1783071512.323209:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071512.323675:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692924160 00000100:00100000:0.0:1783071512.323686:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692924160 00000100:00100000:0.0:1783071512.323752:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 226 00000100:00100000:0.0:1783071512.323764:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03af1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+64:12465:x1869685692924160:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:0.0:1783071512.323790:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071512.323812:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865200/0x6b58994c2cbdcf2e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d990d6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.323914:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdcf35 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.323929:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdcf0b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990c8 expref: 65 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.323938:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdcf35 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.323973:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdcf0b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990c8 expref: 65 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.324003:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdcf0b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990c8 expref: 65 pid: 6517 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071512.324017:0:6517:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0391f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1869685707651456:192.168.204.38@tcp:104: 00000100:00100000:0.0:1783071512.324759:0:6517:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a038a8180 going to sleep for 11 seconds 00000100:00100000:1.0:1783071512.328866:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071512.329061:0:7923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692924288 00000100:00100000:3.0:1783071512.329072:0:7923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692924288 00010000:00010000:3.0:1783071512.329128:0:7923:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdcf0b lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990c8 expref: 66 pid: 6517 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071512.329179:0:7923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 100 00000100:00100000:3.0:1783071512.329189:0:7923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03af0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf7532e4-6153-424a-9f4e-84941256b41f+66:2405:x1869685692924288:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783071512.329205:0:7923:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071512.329211:0:7923:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdcf0b lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990c8 expref: 66 pid: 6517 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071512.329238:0:7923:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdcf0b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990c8 expref: 66 pid: 6517 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071512.329262:0:7923:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f8a020ca100) 00010000:00010000:3.0:1783071512.329267:0:7923:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdcf35 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071512.329278:0:7923:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdcf35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071512.329286:0:7923:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdcf35 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071512.329307:0:7923:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783071512.329396:0:7923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03af0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf7532e4-6153-424a-9f4e-84941256b41f+66:2405:x1869685692924288:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 208us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071512.329405:0:7923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 100 00010000:00010000:0.0:1783071512.329998:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdcf0b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990c8 expref: 65 pid: 6517 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071512.330017:0:6517:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0391f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1869685707651456:192.168.204.38@tcp:104: 00010000:00010000:0.0:1783071512.330049:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdcf35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.330059:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdcf35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.330065:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdcf35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783071512.330120:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1783071512.330125:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783071512.330147:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdcf35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.330180:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865200/0x6b58994c2cbdcf2e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990d6 expref: 65 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.330194:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdcf35 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990d6 expref: 64 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.330213:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f8a020ca100) 00010000:00010000:0.0:1783071512.330216:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783071512.330220:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a03864600, rc 0) 00000100:00100000:0.0:1783071512.331982:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03af1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+64:12465:x1869685692924160:12345-192.168.204.38@tcp:101:bash.0 Request processed in 8205us (8769us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071512.331995:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 226 00000100:00100000:1.0:1783071512.335799:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071512.336082:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692924544 00000100:00100000:0.0:1783071512.336095:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692924544 00000100:00100000:0.0:1783071512.336221:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 59 00000100:00100000:0.0:1783071512.336232:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03af3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+64:12465:x1869685692924544:12345-192.168.204.38@tcp:35:bash.0 00000100:00100000:0.0:1783071512.336652:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03af3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+65:12465:x1869685692924544:12345-192.168.204.38@tcp:35:bash.0 Request processed in 420us (975us total) trans 4294967503 rc 0/0 00000100:00100000:0.0:1783071512.336660:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 59 00000100:00100000:1.0:1783071512.412757:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071512.413055:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692924672 00000100:00100000:2.0:1783071512.413066:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692924672 00000100:00100000:2.0:1783071512.413186:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 227 00000100:00100000:2.0:1783071512.413197:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03af0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+65:12471:x1869685692924672:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1783071512.413224:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071512.413244:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdcf3c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d990dd expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.413312:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdcf43 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.413328:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdcf43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.413354:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdcf43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071512.413424:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1783071512.413429:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783071512.413447:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdcf43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.413470:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdcf3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990dd expref: 67 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.413488:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdcf43 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990dd expref: 66 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.413497:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f8a021bdc00) 00010000:00010000:2.0:1783071512.413500:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783071512.413504:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b2fd67c00, rc 0) 00000100:00100000:2.0:1783071512.413580:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03af0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+66:12471:x1869685692924672:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 385us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071512.413587:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 227 00000100:00100000:1.0:1783071512.417079:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071512.423080:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692924800 00000100:00100000:0.0:1783071512.423095:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692924800 00000100:00100000:0.0:1783071512.423263:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 228 00000100:00100000:0.0:1783071512.423274:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03af3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+66:12471:x1869685692924800:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1783071512.423312:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071512.423375:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865200/0x6b58994c2cbdcf4a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d990e4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.423437:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdcf51 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.423451:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdcf51 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.423475:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdcf51 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.423486:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdcf58 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.423494:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdcf58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.423501:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdcf58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.423588:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdcf5f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.423596:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdcf5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.423603:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdcf5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783071512.423649:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1783071512.423653:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783071512.423671:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdcf5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.423684:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdcf5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.423692:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdcf51 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.423708:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdcf51 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.423714:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdcf51 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.423720:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03865a00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:0.0:1783071512.423725:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdcf51 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.423733:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdcf51 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.423746:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f8a021bdc00) 00010000:00010000:0.0:1783071512.423749:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071512.423754:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdcf51 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.423759:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdcf51 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.423772:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdcf58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.423779:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdcf58 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.423784:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdcf58 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.423793:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03865c00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:0.0:1783071512.423806:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdcf58 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.423812:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdcf58 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.423823:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f8a020caf00) 00010000:00010000:0.0:1783071512.423829:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071512.423832:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdcf58 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.423838:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdcf58 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.423861:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865200/0x6b58994c2cbdcf4a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990e4 expref: 68 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.423873:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdcf5f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990e4 expref: 67 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.423880:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f8a020ca100) 00010000:00010000:0.0:1783071512.423883:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783071512.423885:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a03864e00, rc 0) 00000100:00100000:0.0:1783071512.423963:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03af3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+67:12471:x1869685692924800:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 691us (6893us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071512.423971:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 228 00000100:00100000:1.0:1783071512.433938:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071512.434034:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692925056 00000100:00100000:0.0:1783071512.434044:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692925056 00000100:00100000:0.0:1783071512.434104:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 229 00000100:00100000:0.0:1783071512.434114:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03af2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+67:12471:x1869685692925056:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1783071512.434142:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071512.434163:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864000/0x6b58994c2cbdcf66 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d990eb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.434285:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdcf6d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.434302:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdcf35 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990d6 expref: 68 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.434311:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdcf5f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990e4 expref: 68 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.434319:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdcf6d lrc: 5/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.434354:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdcf5f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990e4 expref: 68 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.434401:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdcf5f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990e4 expref: 68 pid: 6518 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071512.434415:0:6517:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0391f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1869685707651584:192.168.204.38@tcp:104: 00010000:00010000:0.0:1783071512.434515:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdcf35 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990d6 expref: 68 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.434524:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdcf35 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990d6 expref: 68 pid: 6517 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071512.434558:0:6517:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0391c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1869685707651712:192.168.204.38@tcp:104: 00000100:00100000:0.0:1783071512.434588:0:6517:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a038a8540 going to sleep for 11 seconds 00000100:00100000:1.0:1783071512.443996:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071512.444165:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692925184 00000100:00100000:2.0:1783071512.444175:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692925184 00010000:00010000:2.0:1783071512.444217:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdcf5f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990e4 expref: 69 pid: 6518 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071512.444258:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 101 00000100:00100000:2.0:1783071512.444268:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03af3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf7532e4-6153-424a-9f4e-84941256b41f+69:2406:x1869685692925184:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783071512.444305:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071512.444313:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdcf5f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990e4 expref: 69 pid: 6518 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.444326:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdcf5f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990e4 expref: 69 pid: 6518 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.444349:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f8a020ca100) 00010000:00010000:2.0:1783071512.444355:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdcf6d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.444404:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdcf6d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.444412:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071512.444472:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03af3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf7532e4-6153-424a-9f4e-84941256b41f+69:2406:x1869685692925184:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 204us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071512.444480:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 101 00000100:00100000:3.0:1783071512.456967:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071512.457147:0:7923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692925312 00000100:00100000:1.0:1783071512.457156:0:7923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692925312 00010000:00010000:1.0:1783071512.457199:0:7923:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdcf35 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990d6 expref: 69 pid: 6517 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071512.457245:0:7923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 102 00000100:00100000:1.0:1783071512.457254:0:7923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf7532e4-6153-424a-9f4e-84941256b41f+69:2405:x1869685692925312:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783071512.457268:0:7923:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071512.457274:0:7923:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdcf35 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990d6 expref: 69 pid: 6517 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071512.457288:0:7923:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdcf35 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990d6 expref: 69 pid: 6517 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071512.457311:0:7923:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f8a020ca100) 00010000:00010000:1.0:1783071512.457316:0:7923:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdcf6d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071512.457326:0:7923:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdcf6d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071512.457335:0:7923:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdcf6d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071512.457356:0:7923:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071512.457430:0:7923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf7532e4-6153-424a-9f4e-84941256b41f+69:2405:x1869685692925312:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 177us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071512.457438:0:7923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 102 00010000:00010000:0.0:1783071512.460329:0:6517:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.38@tcp) returned -22 from blocking AST (req@00000000a1fb8504 x1869685707651584) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdcf5f lrc: 1/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990e4 expref: 68 pid: 6518 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.460357:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdcf5f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990e4 expref: 68 pid: 6518 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071512.460394:0:6517:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0391f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1869685707651584:192.168.204.38@tcp:104: 00010000:00010000:1.0:1783071512.464728:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864600/0x6b58994c2cbdcf35 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990d6 expref: 67 pid: 6517 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071512.464763:0:6517:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0391c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1869685707651712:192.168.204.38@tcp:104: 00010000:00010000:1.0:1783071512.464799:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f8a020ca100) 00010000:00010000:1.0:1783071512.464992:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdcf6d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071512.465004:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdcf6d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071512.465010:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdcf6d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783071512.465038:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1783071512.465213:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864000/0x6b58994c2cbdcf66 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990eb expref: 68 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071512.465230:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdcf6d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990eb expref: 67 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071512.465238:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f8a020ca100) 00010000:00010000:1.0:1783071512.465241:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783071512.465244:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a03865e00, rc 0) 00000100:00100000:1.0:1783071512.465574:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03af2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+67:12471:x1869685692925056:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 31460us (31646us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1783071512.465586:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 229 00000100:00100000:3.0:1783071512.492289:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071512.492433:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692925568 00000100:00100000:2.0:1783071512.492444:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692925568 00000100:00100000:2.0:1783071512.492519:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 16 00000100:00100000:2.0:1783071512.492530:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0411dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf7532e4-6153-424a-9f4e-84941256b41f+67:12471:x1869685692925568:12345-192.168.204.38@tcp:103:lfs.0 00010000:00010000:2.0:1783071512.492561:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071512.492590:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66400/0x6b58994c2cbdcebe lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990ba expref: 67 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.492609:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f8a020ca100) 00010000:00010000:2.0:1783071512.492637:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071512.492754:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0411dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf7532e4-6153-424a-9f4e-84941256b41f+66:12471:x1869685692925568:12345-192.168.204.38@tcp:103:lfs.0 Request processed in 225us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071512.492763:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 16 00000100:00100000:3.0:1783071512.514571:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071512.516063:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692925696 00000100:00100000:2.0:1783071512.516078:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692925696 00000100:00100000:2.0:1783071512.516217:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 230 00000100:00100000:2.0:1783071512.516228:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0411c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+66:12471:x1869685692925696:12345-192.168.204.38@tcp:58:lfs.0 00010000:00010000:2.0:1783071512.516344:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66400/0x6b58994c2cbdcf7b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.518014:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66400/0x6b58994c2cbdcf7b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.518039:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66400/0x6b58994c2cbdcf7b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783071512.518155:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1783071512.518267:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0411c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+66:12471:x1869685692925696:12345-192.168.204.38@tcp:58:lfs.0 Request processed in 2036us (3704us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071512.518277:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 230 00000100:00100000:1.0:1783071512.523279:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071512.523388:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692925824 00000100:00100000:0.0:1783071512.523400:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692925824 00000100:00100000:0.0:1783071512.523475:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 231 00000100:00100000:0.0:1783071512.523486:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03af1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+66:12471:x1869685692925824:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1783071512.523508:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071512.523532:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdcf82 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d990f2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.523604:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66400/0x6b58994c2cbdcf7b lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.523627:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdcf82 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990f2 expref: 67 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.523647:0:6518:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66400/0x6b58994c2cbdcf7b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.523676:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdcf82 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990f2 expref: 67 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.523690:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f8a020ca100) 00010000:00010000:0.0:1783071512.523693:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783071512.523697:0:6518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdcf82 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990f2 expref: 67 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.523705:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a03864e00, rc 0) 00000100:00100000:0.0:1783071512.523768:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03af1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+67:12471:x1869685692925824:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 284us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071512.523775:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 231 00010000:00010000:0.0:1783071512.834808:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783071512.834971:0:13796:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783071512.834978:0:13796:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783071512.835001:0:13796:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1783071512.835012:0:13796:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783071512.835169:0:13796:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0397d880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13796:1869685707651840:192.168.204.38@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783071512.835280:0:13796:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a038bccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783071512.838273:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071512.838623:0:13796:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0397d880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13796:1869685707651840:192.168.204.38@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783071512.838704:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692925952 00000100:00100000:3.0:1783071512.838712:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692925952 00000100:00100000:3.0:1783071512.838776:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 232 00000100:00100000:3.0:1783071512.838786:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03af0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+67:12472:x1869685692925952:12345-192.168.204.38@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783071512.838822:0:6517:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783071512.839150:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03af0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+67:12472:x1869685692925952:12345-192.168.204.38@tcp:53:lhsmtool_posix.0 Request processed in 364us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071512.839168:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 232 00000100:00100000:1.0:1783071512.846956:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071512.847073:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692926080 00000100:00100000:0.0:1783071512.847083:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692926080 00000100:00100000:0.0:1783071512.847144:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 233 00000100:00100000:0.0:1783071512.847154:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03af3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+67:12472:x1869685692926080:12345-192.168.204.38@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1783071512.847233:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865200/0x6b58994c2cbdcf89 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.847251:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865200/0x6b58994c2cbdcf89 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.847262:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865200/0x6b58994c2cbdcf89 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.847277:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdcf90 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.847298:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdcf90 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.847306:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdcf90 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.847330:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdcf97 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.847338:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdcf97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.847343:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdcf97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783071512.847423:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1783071512.847429:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783071512.847446:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdcf97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.847456:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865200/0x6b58994c2cbdcf89 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.847461:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865200/0x6b58994c2cbdcf89 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.847468:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865200/0x6b58994c2cbdcf89 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.847473:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03865200 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:0.0:1783071512.847477:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865200/0x6b58994c2cbdcf89 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.847490:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865200/0x6b58994c2cbdcf89 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.847502:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f8b0d17fa00) 00010000:00010000:0.0:1783071512.847506:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071512.847512:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865200/0x6b58994c2cbdcf89 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.847518:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865200/0x6b58994c2cbdcf89 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.847540:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdcf90 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.847547:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdcf90 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.847553:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdcf90 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.847558:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03865c00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:0.0:1783071512.847561:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdcf90 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.847567:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdcf90 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.847575:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff8f8b10db4b00) 00010000:00010000:0.0:1783071512.847577:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071512.847580:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdcf90 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.847596:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865c00/0x6b58994c2cbdcf90 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.847622:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdcf97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.847628:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdcf97 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.847633:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdcf97 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.847639:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03865a00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:0.0:1783071512.847642:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdcf97 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.847648:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdcf97 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.847655:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f8a020ca100) 00010000:00010000:0.0:1783071512.847658:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071512.847661:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdcf97 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.847666:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865a00/0x6b58994c2cbdcf97 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071512.847750:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03af3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+67:12472:x1869685692926080:12345-192.168.204.38@tcp:34:lhsmtool_posix.0 Request processed in 595us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071512.847759:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 233 00000100:00100000:1.0:1783071512.859794:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071512.859906:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692926336 00000100:00100000:2.0:1783071512.859920:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692926336 00000100:00100000:2.0:1783071512.860004:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 234 00000100:00100000:2.0:1783071512.860017:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03af0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+67:12472:x1869685692926336:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783071512.860043:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071512.860068:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdcf9e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d990f9 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.860202:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdcfa5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.860221:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdcfa5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.860234:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdcfa5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071512.860246:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1783071512.860336:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdcfa5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.860344:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdcfa5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.860382:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdcfa5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.860390:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd66600 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:2.0:1783071512.860394:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdcfa5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.860426:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdcfa5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.860686:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f8a020ca100) 00010000:00010000:2.0:1783071512.860690:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1783071512.860696:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdcfa5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.860703:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdcfa5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.860752:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdcf9e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990f9 expref: 69 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.860762:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f8b0d17fa00) 00010000:00010000:2.0:1783071512.860764:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783071512.860769:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdcf9e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990f9 expref: 69 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.860778:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b2fd67200, rc 0) 00000100:00100000:2.0:1783071512.860849:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03af0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+68:12472:x1869685692926336:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 834us (1068us total) trans 4294967505 rc 301/301 00000100:00100000:2.0:1783071512.860858:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 234 00000100:00100000:3.0:1783071512.873703:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071512.873787:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692926464 00000100:00100000:1.0:1783071512.873801:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692926464 00000100:00100000:1.0:1783071512.873880:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 235 00000100:00100000:1.0:1783071512.873893:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0411fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+68:12472:x1869685692926464:12345-192.168.204.38@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1783071512.873977:0:6517:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1783071512.874339:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0411fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+68:12472:x1869685692926464:12345-192.168.204.38@tcp:53:lhsmtool_posix.0 Request processed in 447us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071512.874348:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 235 00000100:00100000:1.0:1783071512.882276:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071512.882687:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692926720 00000100:00100000:3.0:1783071512.882700:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692926720 00000100:00100000:3.0:1783071512.883277:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 236 00000100:00100000:3.0:1783071512.883293:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03af0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+68:12472:x1869685692926720:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783071512.883321:0:13815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071512.883324:0:13815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1783071512.883354:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67c00/0x6b58994c2cbdcf43 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990dd expref: 68 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071512.883407:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f8a021bdc00) 00010000:00010000:3.0:1783071512.883412:0:13815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783071512.883428:0:13815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdcfb3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d99100 expref: -99 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783071512.884101:0:13815:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:3.0:1783071512.884343:0:13815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdcfba lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071512.884358:0:13815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdcfba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071512.885042:0:13815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdcfba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071512.885139:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdcfb3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99100 expref: 70 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071512.885257:0:13815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdcfba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99100 expref: 69 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071512.885267:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f8a0179f200) 00010000:00010000:3.0:1783071512.885270:0:13815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783071512.885274:0:13815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a01749600, rc 0) 00000100:00100000:3.0:1783071512.885389:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03af0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+69:12472:x1869685692926720:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 2100us (3125us total) trans 4294967506 rc 0/0 00000100:00100000:3.0:1783071512.888299:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 236 00000100:00100000:3.0:1783071512.891268:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071512.891564:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692926976 00000100:00100000:2.0:1783071512.891581:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692926976 00000100:00100000:2.0:1783071512.891670:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 237 00000100:00100000:2.0:1783071512.891683:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0411ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+69:12472:x1869685692926976:12345-192.168.204.38@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783071512.891777:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071512.891810:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdcfba lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99100 expref: 69 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.891831:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f8a0179f200) 00010000:00010000:2.0:1783071512.891842:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783071512.891866:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdcfc8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.891881:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdcfc8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.891891:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdcfc8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.892256:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdcfcf lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x5b05139a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.892266:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdcfcf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x5b05139a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.892274:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdcfcf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x5b05139a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.892337:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdcfc8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.892344:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdcfc8 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.892351:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdcfc8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.892404:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd67200 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:2.0:1783071512.892410:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdcfc8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.892419:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdcfc8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.892430:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f8a021bdc00) 00010000:00010000:2.0:1783071512.892567:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071512.892573:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdcfc8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.892580:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdcfc8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.892591:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdcfcf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x5b05139a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.892597:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdcfcf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x5b05139a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.892667:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdcfcf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x5b05139a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.892673:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd66600 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:2.0:1783071512.892676:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdcfcf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x5b05139a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.892682:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdcfcf lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x5b05139a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.892701:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x5b05139a (ffff8f8a020cac00) 00010000:00010000:2.0:1783071512.892704:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071512.892707:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdcfcf lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x5b05139a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.892713:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdcfcf lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x5b05139a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071512.892826:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0411ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+68:12472:x1869685692926976:12345-192.168.204.38@tcp:36:lhsmtool_posix.0 Request processed in 1142us (1684us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783071512.892835:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 237 00000100:00100000:1.0:1783071512.904006:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071512.904724:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692927104 00000100:00100000:3.0:1783071512.904737:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692927104 00000100:00100000:3.0:1783071512.904810:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 238 00000100:00100000:3.0:1783071512.904821:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b091ec450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+68:12472:x1869685692927104:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783071512.904843:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071512.904866:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdcfd6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d99107 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071512.904903:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdcfdd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071512.904916:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdcfdd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071512.904927:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdcfdd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071512.905053:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdcfd6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99107 expref: 70 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071512.905074:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdcfdd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99107 expref: 69 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071512.905085:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f8a0179f500) 00010000:00010000:3.0:1783071512.905088:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783071512.905092:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a01749000, rc 0) 00000100:00100000:3.0:1783071512.905165:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b091ec450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+69:12472:x1869685692927104:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 346us (1172us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071512.905173:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 238 00000100:00100000:1.0:1783071512.910640:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071512.910856:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692927360 00000100:00100000:3.0:1783071512.910867:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692927360 00000100:00100000:3.0:1783071512.910966:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 239 00000100:00100000:3.0:1783071512.910978:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03af1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+69:12472:x1869685692927360:12345-192.168.204.38@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783071512.911079:0:13815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdcfe4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071512.911101:0:13815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdcfe4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071512.911115:0:13815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdcfe4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783071512.911291:0:13815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:3.0:1783071512.911301:0:13815:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 414699936344ns, next at 415699933822ns, rc = 0 00000004:00010000:3.0:1783071512.911399:0:13815:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000090707ada reply state 00000000be4b6f57 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdcfe4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071512.911414:0:13815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdcfe4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071512.911423:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f8a0179f500) 00010000:00010000:3.0:1783071512.911426:0:13815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1783071512.911429:0:13815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783071512.911594:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03af1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+71:12472:x1869685692927360:12345-192.168.204.38@tcp:36:lhsmtool_posix.0 Request processed in 616us (966us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1783071512.911602:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 239 00000100:00100000:1.0:1783071512.922446:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071512.922607:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692927488 00000100:00100000:2.0:1783071512.922619:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692927488 00000100:00100000:2.0:1783071512.922689:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 240 00000100:00100000:2.0:1783071512.922701:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03af2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+71:12472:x1869685692927488:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783071512.922734:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071512.922763:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdcfeb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d9910e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.922851:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdcfeb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9910e expref: 72 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.922867:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdcfeb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9910e expref: 72 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.922886:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f8a0179f500) 00010000:00010000:2.0:1783071512.922890:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783071512.922907:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b2fd66600, rc 0) 00000100:00100000:2.0:1783071512.922974:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03af2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+72:12472:x1869685692927488:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 275us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071512.922981:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 240 00000100:00100000:1.0:1783071512.934101:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071512.934216:0:8910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692927616 00000100:00100000:0.0:1783071512.934233:0:8910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692927616 00000100:00100000:0.0:1783071512.934328:0:8910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 70 00000100:00100000:0.0:1783071512.934343:0:8910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03af3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf7532e4-6153-424a-9f4e-84941256b41f+9:2405:x1869685692927616:12345-192.168.204.38@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1783071512.934644:0:8910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03af3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf7532e4-6153-424a-9f4e-84941256b41f+10:2405:x1869685692927616:12345-192.168.204.38@tcp:2:lhsmtool_posix.0 Request processed in 306us (552us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1783071512.934653:0:8910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 70 00000100:00080000:2.0:1783071512.935031:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783071512.937854:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071512.938107:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692927872 00000100:00100000:3.0:1783071512.938118:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692927872 00000100:00100000:3.0:1783071512.938188:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 60 00000100:00100000:3.0:1783071512.938199:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03af1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+72:12472:x1869685692927872:12345-192.168.204.38@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1783071512.938473:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03af1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+73:12472:x1869685692927872:12345-192.168.204.38@tcp:35:lhsmtool_posix.0 Request processed in 275us (631us total) trans 4294967508 rc 0/0 00000100:00100000:3.0:1783071512.938481:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 60 00000100:00100000:1.0:1783071512.942043:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071512.942136:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692928128 00000100:00100000:2.0:1783071512.942150:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692928128 00000100:00100000:2.0:1783071512.942222:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 241 00000100:00100000:2.0:1783071512.942234:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03af0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+73:12472:x1869685692928128:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1783071512.942414:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03af0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+73:12472:x1869685692928128:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 Request processed in 182us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071512.942422:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 241 00000100:00100000:1.0:1783071512.960888:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071512.964160:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692928256 00000100:00100000:3.0:1783071512.964180:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692928256 00000100:00100000:3.0:1783071512.964291:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 242 00000100:00100000:3.0:1783071512.964301:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03af1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+73:12472:x1869685692928256:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783071512.964327:0:13815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071512.965025:0:13815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdcff2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d99115 expref: -99 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071512.965195:0:13815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdcff9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071512.965229:0:13815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdcff9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071512.965243:0:13815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdcff9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783071512.965304:0:13815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783071512.965328:0:13815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdcff9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071512.966024:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdcff2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99115 expref: 75 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071512.966120:0:13815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdcff9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99115 expref: 74 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071512.966130:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f8a0179f500) 00010000:00010000:3.0:1783071512.966133:0:13815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1783071512.966136:0:13815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a01749c00, rc 0) 00000100:00100000:3.0:1783071512.966285:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03af1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+74:12472:x1869685692928256:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 1983us (5407us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071512.966295:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 242 00000100:00100000:1.0:1783071512.975513:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071512.976414:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692928384 00000100:00100000:2.0:1783071512.976432:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692928384 00000100:00100000:2.0:1783071512.976506:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 71 00000100:00100000:2.0:1783071512.976517:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b2fe7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf7532e4-6153-424a-9f4e-84941256b41f+10:2406:x1869685692928384:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783071512.976549:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071512.976572:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f377a4d/0x6b58994c2cbdd000 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d9911c expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783071512.976727:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a478319, blocks: 0x0 00010000:00010000:2.0:1783071512.976754:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1783071512.976759:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783071512.976771:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f377a4d/0x6b58994c2cbdd000 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9911c expref: 11 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.976805:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002f377a4d/0x6b58994c2cbdd000 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9911c expref: 11 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071512.976834:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b2fd66e00, rc 0) 00000100:00100000:2.0:1783071512.976899:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b2fe7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf7532e4-6153-424a-9f4e-84941256b41f+11:2406:x1869685692928384:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 384us (1399us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071512.976907:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 71 00000100:00100000:2.0:1783071512.990199:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071512.990415:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692928640 00000100:00100000:3.0:1783071512.990425:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692928640 00000100:00100000:3.0:1783071512.990502:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 243 00000100:00100000:3.0:1783071512.990514:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0397c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+74:12472:x1869685692928640:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783071512.990642:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0397c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+74:12472:x1869685692928640:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 Request processed in 130us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071512.990663:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 243 00000100:00100000:1.0:1783071512.995064:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071512.995482:0:8910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692928768 00000100:00100000:0.0:1783071512.995493:0:8910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692928768 00000100:00100000:0.0:1783071512.995609:0:8910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 72 00000100:00100000:0.0:1783071512.995620:0:8910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03af2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf7532e4-6153-424a-9f4e-84941256b41f+11:12472:x1869685692928768:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783071512.995638:0:8910:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071512.995656:0:8910:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049e80cbc/0x6b58994c2cbdd007 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d99123 expref: -99 pid: 8910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.995700:0:8910:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002f377a4d/0x6b58994c2cbdd000 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9911c expref: 12 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.995709:0:8910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071512.995714:0:8910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071512.995721:0:8910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049e80cbc/0x6b58994c2cbdd007 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99123 expref: 12 pid: 8910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.995759:0:8910:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002f377a4d/0x6b58994c2cbdd000 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9911c expref: 12 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.995794:0:8910:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002f377a4d/0x6b58994c2cbdd000 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9911c expref: 12 pid: 8432 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071512.995811:0:8910:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0391ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8910:1869685707651968:192.168.204.38@tcp:104: 00000100:00100000:0.0:1783071512.995937:0:8910:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a038a8b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783071513.003464:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071513.003752:0:7923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692928896 00000100:00100000:3.0:1783071513.003764:0:7923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692928896 00010000:00010000:3.0:1783071513.003811:0:7923:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002f377a4d/0x6b58994c2cbdd000 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9911c expref: 13 pid: 8432 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071513.003846:0:7923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 103 00000100:00100000:3.0:1783071513.003856:0:7923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03af1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf7532e4-6153-424a-9f4e-84941256b41f+13:2405:x1869685692928896:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783071513.003873:0:7923:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071513.003896:0:7923:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002f377a4d/0x6b58994c2cbdd000 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9911c expref: 13 pid: 8432 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071513.003913:0:7923:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002f377a4d/0x6b58994c2cbdd000 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9911c expref: 13 pid: 8432 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071513.003955:0:7923:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783071513.003961:0:7923:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783071513.003971:0:7923:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000049e80cbc/0x6b58994c2cbdd007 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99123 expref: 13 pid: 8910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071513.003982:0:7923:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049e80cbc/0x6b58994c2cbdd007 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99123 expref: 13 pid: 8910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071513.004029:0:7923:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000049e80cbc/0x6b58994c2cbdd007 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99123 expref: 13 pid: 8910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071513.004067:0:7923:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0411e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7923:1869685707652096:192.168.204.38@tcp:105: 00000100:00100000:3.0:1783071513.004168:0:7923:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b2fc82600 going to sleep for 11 seconds 00000100:00100000:3.0:1783071513.008870:0:7923:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0411e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7923:1869685707652096:192.168.204.38@tcp:105: 00010000:00010000:3.0:1783071513.008912:0:7923:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783071513.008971:0:7923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03af1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf7532e4-6153-424a-9f4e-84941256b41f+13:2405:x1869685692928896:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 5115us (5517us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071513.008982:0:7923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 103 00010000:00010000:0.0:1783071513.010881:0:8910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f377a4d/0x6b58994c2cbdd000 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9911c expref: 12 pid: 8432 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071513.010911:0:8910:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0391ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8910:1869685707651968:192.168.204.38@tcp:104: 00010000:00010000:0.0:1783071513.010949:0:8910:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000049e80cbc/0x6b58994c2cbdd007 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99123 expref: 11 pid: 8910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071513.010967:0:8910:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a03865a00, rc 0) 00000100:00100000:0.0:1783071513.011039:0:8910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03af2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf7532e4-6153-424a-9f4e-84941256b41f+11:12472:x1869685692928768:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 15420us (15984us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071513.011049:0:8910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 72 00000100:00100000:2.0:1783071513.020241:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071513.021537:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692929024 00000100:00100000:0.0:1783071513.021553:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692929024 00002000:00100000:0.0:1783071513.021690:0:8435:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff8f8a0397ed80 x1869685692929024/t0(0) o4->bf7532e4-6153-424a-9f4e-84941256b41f@192.168.204.38@tcp:104/0 lens 504/0 e 0 to 0 dl 1783071524 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783071513.021703:0:8435:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8f8a0397ed80 with x1869685692929024 ext(0->12) 00002000:00010000:0.0:1783071513.021710:0:8435:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f8a0397ed80 00000100:00100000:0.0:1783071513.021799:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 6 00000100:00100000:0.0:1783071513.021827:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0397ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bf7532e4-6153-424a-9f4e-84941256b41f+11:2406:x1869685692929024:12345-192.168.204.38@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1783071513.023072:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0397ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bf7532e4-6153-424a-9f4e-84941256b41f+13:2406:x1869685692929024:12345-192.168.204.38@tcp:4:lhsmtool_posix.0 Request processed in 1239us (2832us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1783071513.023084:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 6 00002000:00100000:0.0:1783071513.023096:0:8435:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff8f8a0397ed80 x1869685692929024/t4294967321(0) o4->bf7532e4-6153-424a-9f4e-84941256b41f@192.168.204.38@tcp:104/0 lens 504/448 e 0 to 0 dl 1783071524 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783071513.023107:0:8435:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8f8a0397ed80 with x1869685692929024 ext(0->12) 00002000:00010000:0.0:1783071513.023113:0:8435:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f8a0397ed80 00000100:00100000:1.0:1783071513.039678:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071513.039825:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692929152 00000100:00100000:0.0:1783071513.039835:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692929152 00000100:00100000:0.0:1783071513.039993:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 244 00000100:00100000:0.0:1783071513.040006:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03af0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+74:12472:x1869685692929152:12345-192.168.204.38@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1783071513.047292:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:3.0:1783071513.047314:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000004:00080000:3.0:1783071513.047395:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:3.0:1783071513.047414:0:6495:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f8b2fc82f00 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1783071513.047421:0:6495:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8f8b3c761700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f8b2fc82240 00000020:00080000:3.0:1783071513.047424:0:6495:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8f8b3c761900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f8b05a8de00 00000004:00080000:3.0:1783071513.047456:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:3.0:1783071513.047481:0:6495:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f8a03022240 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1783071513.047484:0:6495:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8f8b3c761b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f8a03022300 00000020:00080000:3.0:1783071513.047486:0:6495:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8f8b10d05700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f8b07ed5600 00000020:00080000:3.0:1783071513.047501:0:6495:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00010000:00010000:1.0:1783071513.047595:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdcd0c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.047619:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdcd0c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.047652:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdcd0c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.047658:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd67400 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:1.0:1783071513.047662:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdcd0c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.047672:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdcd0c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.047693:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f8b11ce3c00) 00010000:00010000:1.0:1783071513.047697:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071513.047702:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdcd0c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.047709:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdcd0c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.047752:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdcdb4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.047759:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdcdb4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.047766:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdcdb4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.047771:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01749a00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:1.0:1783071513.047773:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdcdb4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.047790:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdcdb4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.047800:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f8a0179f900) 00010000:00010000:1.0:1783071513.047802:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071513.047806:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdcdb4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.047811:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749a00/0x6b58994c2cbdcdb4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.047831:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdce32 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.047837:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdce32 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.047843:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdce32 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.047849:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd67600 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:1.0:1783071513.047851:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdce32 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.047856:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdce32 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.047865:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f8a020caf00) 00010000:00010000:1.0:1783071513.047867:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071513.047870:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdce32 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.047881:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdce32 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.048103:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdce55 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.048110:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdce55 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.048117:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdce55 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.048122:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01748000 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:1.0:1783071513.048125:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdce55 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.048130:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdce55 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.048139:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f8a020caf00) 00010000:00010000:1.0:1783071513.048141:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071513.048145:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdce55 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.048151:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748000/0x6b58994c2cbdce55 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.048168:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdcf27 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.048174:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdcf27 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.048188:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdcf27 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.048194:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd66200 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:1.0:1783071513.048196:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdcf27 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.048203:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdcf27 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.048211:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f8a020ca100) 00010000:00010000:1.0:1783071513.048214:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071513.048216:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdcf27 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.048222:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdcf27 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.048237:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdcfe4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.048243:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdcfe4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.048249:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdcfe4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.048254:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01749e00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:1.0:1783071513.048257:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdcfe4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.048273:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdcfe4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.048282:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f8a0179f500) 00010000:00010000:1.0:1783071513.048285:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783071513.048288:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdcfe4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.048293:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdcfe4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783071513.048404:0:6549:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1783071513.048502:0:6549:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1783071513.048695:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03af0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+22:12472:x1869685692929152:12345-192.168.204.38@tcp:44:lhsmtool_posix.0 Request processed in 8686us (9019us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071513.048708:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 244 00000100:00080000:2.0:1783071513.049089:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783071513.049329:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0397d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707652352:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1783071513.049409:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071513.049458:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783071513.049466:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0397ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707652480:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1783071513.049490:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071513.049521:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707652352 00000100:00100000:1.0:1783071513.049539:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707652352 00000100:00100000:1.0:1783071513.049582:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707652480 00000100:00100000:1.0:1783071513.049586:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707652480 00000100:00100000:1.0:1783071513.049676:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1783071513.049686:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03af3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1869685707652352:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1783071513.049815:0:8429:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1783071513.049819:0:8429:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1783071513 00002000:00010000:1.0:1783071513.049822:0:8429:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1783071513.049825:0:8429:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1783071513 -> 1783071513 00002000:00010000:1.0:1783071513.049828:0:8429:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1783071513.049865:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03af3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3645:x1869685707652352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 180us (455us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1783071513.049883:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1783071513.049901:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1783071513.050122:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0397ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707652224:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1783071513.050154:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783071513.050238:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783071513.050267:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707652224 00000100:00100000:2.0:1783071513.050271:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707652224 00000100:00100000:2.0:1783071513.050294:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783071513.050301:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0411e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3648:x1869685707652224:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783071513.050318:0:8431:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:2.0:1783071513.050339:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b3749a1/0x6b58994c2cbdd00e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071513.050384:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bd4b890e/0x6b58994c2cbdcdc2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9907b expref: 12 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071513.050396:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1783071513.050401:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783071513.050406:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b3749a1/0x6b58994c2cbdd00e lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071513.050437:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bd4b890e/0x6b58994c2cbdcdc2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9907b expref: 12 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071513.050459:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bd4b890e/0x6b58994c2cbdcdc2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9907b expref: 12 pid: 8431 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071513.050472:0:8431:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0397e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8431:1869685707652608:192.168.204.38@tcp:104: 00000100:00100000:2.0:1783071513.050543:0:8431:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a038bccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783071513.051020:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03af2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3645:x1869685707652480:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1783071513.051042:0:8429:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00002000:00010000:1.0:1783071513.051066:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a478318, atime: 0x6a478318, ctime: 0x6a478318, blocks: 0x8 00010000:00010000:1.0:1783071513.051073:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5be14d8/0x6b58994c2cbdd015 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.051084:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=414s v=(0 0) 00010000:00010000:1.0:1783071513.051088:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783071513.051094:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5be14d8/0x6b58994c2cbdd015 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.051110:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5be14d8/0x6b58994c2cbdd015 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.051120:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5be14d8/0x6b58994c2cbdd015 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.051128:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5be14d8/0x6b58994c2cbdd015 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.051143:0:8429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783071513.051267:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03af2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3645:x1869685707652480:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1359us (1774us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1783071513.051275:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000004:00080000:1.0:1783071513.051331:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f8a0397ca80/2, rc 0, transno 4294967311 00000100:00100000:1.0:1783071513.051339:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0397ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707652480:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1783071513.051351:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f8a0397d880/2, rc 0, transno 4294967322 00000100:00100000:1.0:1783071513.051355:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0397d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707652352:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1783071513.056190:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783071513.056211:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5be14d8/0x6b58994c2cbdd015 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071513.056230:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b421d8600 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:0.0:1783071513.056235:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5be14d8/0x6b58994c2cbdd015 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071513.056275:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5be14d8/0x6b58994c2cbdd015 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071513.056301:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5be14d8/0x6b58994c2cbdd015 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071513.056310:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5be14d8/0x6b58994c2cbdd015 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071513.056346:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071513.056348:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071513.056350:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071513.063230:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071513.063291:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071513.063432:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692929280 00000100:00100000:0.0:1783071513.063447:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692929280 00000100:00100000:0.0:1783071513.063508:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 76 00000100:00100000:0.0:1783071513.063519:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03af0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf7532e4-6153-424a-9f4e-84941256b41f+13:2406:x1869685692929280:12345-192.168.204.38@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1783071513.064330:0:8431:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0397e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8431:1869685707652608:192.168.204.38@tcp:104: 00010000:00010000:2.0:1783071513.064404:0:8431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004b3749a1/0x6b58994c2cbdd00e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071513.064578:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692929408 00000100:00100000:3.0:1783071513.064584:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692929408 00010000:00010000:3.0:1783071513.064627:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bd4b890e/0x6b58994c2cbdcdc2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9907b expref: 14 pid: 8431 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071513.064668:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 104 00000100:00100000:3.0:1783071513.064679:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03af1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf7532e4-6153-424a-9f4e-84941256b41f+14:2406:x1869685692929408:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783071513.064693:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071513.064700:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bd4b890e/0x6b58994c2cbdcdc2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9907b expref: 14 pid: 8431 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071513.064713:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bd4b890e/0x6b58994c2cbdcdc2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9907b expref: 14 pid: 8431 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071513.064737:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd4b890e/0x6b58994c2cbdcdc2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9907b expref: 14 pid: 8431 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071513.064752:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783071513.064757:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783071513.064763:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004b3749a1/0x6b58994c2cbdd00e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071513.064773:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b3749a1/0x6b58994c2cbdd00e lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071513.064805:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783071513.064875:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03af1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf7532e4-6153-424a-9f4e-84941256b41f+13:2406:x1869685692929408:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 197us (1665us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071513.064883:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 104 00010000:00010000:2.0:1783071513.065207:0:8431:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004b3749a1/0x6b58994c2cbdd00e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071513.065217:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b3749a1/0x6b58994c2cbdd00e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071513.065228:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b3749a1/0x6b58994c2cbdd00e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071513.065236:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b3749a1/0x6b58994c2cbdd00e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071513.065255:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000001:00080000:0.0:1783071513.065263:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:0.0:1783071513.065273:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:0.0:1783071513.065360:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03af0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf7532e4-6153-424a-9f4e-84941256b41f+7:2406:x1869685692929280:12345-192.168.204.38@tcp:16:lhsmtool_posix.0 Request processed in 1841us (2067us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071513.065411:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 76 00000100:00100000:2.0:1783071513.065477:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0411e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1869685707652224:12345-0@lo:6:osp-syn-0-0.0 Request processed in 15175us (15320us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1783071513.065496:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:2.0:1783071513.065518:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783071513.065536:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b3749a1/0x6b58994c2cbdd00e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071513.065545:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd67c00 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:2.0:1783071513.065549:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b3749a1/0x6b58994c2cbdd00e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071513.065558:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b3749a1/0x6b58994c2cbdd00e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071513.065572:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b3749a1/0x6b58994c2cbdd00e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071513.065579:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b3749a1/0x6b58994c2cbdd00e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071513.065598:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071513.065600:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071513.065602:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071513.066053:0:3648:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:0.0:1783071513.066062:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:0.0:1783071513.066220:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f8a0397d880, transno 4294967322 00000100:00100000:0.0:1783071513.066289:0:3648:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff8f8a0397ea00 x1869685707652224/t4294967323(4294967323) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1783071529 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1783071513.066311:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f8a0397ea00/2, rc 0, transno 4294967323 00000100:00100000:3.0:1783071513.069139:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071513.072786:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692929664 00000100:00100000:1.0:1783071513.072812:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692929664 00000100:00100000:0.0:1783071513.072968:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0397ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707652224:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1783071513.075840:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 245 00000100:00100000:1.0:1783071513.075866:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0411f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+22:12472:x1869685692929664:12345-192.168.204.38@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783071513.075941:0:13815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071513.075981:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdcff9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99115 expref: 22 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.076004:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f8a0179f500) 00010000:00010000:1.0:1783071513.076010:0:13815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783071513.076048:0:13815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9000/0x6b58994c2cbdd01c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.076063:0:13815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9000/0x6b58994c2cbdd01c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.076074:0:13815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9000/0x6b58994c2cbdd01c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783071513.076213:0:13815:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000128b05e1 reply state 000000007baa0499 transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9000/0x6b58994c2cbdd01c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.076226:0:13815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9000/0x6b58994c2cbdd01c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.076249:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f8a0179f500) 00010000:00010000:1.0:1783071513.076252:0:13815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783071513.076256:0:13815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783071513.076401:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0411f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+23:12472:x1869685692929664:12345-192.168.204.38@tcp:36:lhsmtool_posix.0 Request processed in 547us (7274us total) trans 4294967509 rc 0/0 00000100:00100000:1.0:1783071513.076410:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 245 00000100:00100000:3.0:1783071513.084588:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071513.084717:0:8910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692929792 00000100:00100000:2.0:1783071513.084731:0:8910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692929792 00000100:00100000:2.0:1783071513.084799:0:8910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 77 00000100:00100000:2.0:1783071513.084812:0:8910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0411d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf7532e4-6153-424a-9f4e-84941256b41f+7:2406:x1869685692929792:12345-192.168.204.38@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1783071513.085017:0:8910:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1783071513.085036:0:8910:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1783071513 -> 1783071513 00002000:00010000:2.0:1783071513.085039:0:8910:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1783071512 00002000:00010000:2.0:1783071513.085041:0:8910:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1783071513 -> 1783071513 00002000:00010000:2.0:1783071513.085043:0:8910:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1783071513.085116:0:8910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0411d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf7532e4-6153-424a-9f4e-84941256b41f+8:2406:x1869685692929792:12345-192.168.204.38@tcp:2:lhsmtool_posix.0 Request processed in 305us (542us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1783071513.085123:0:8910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 77 00000100:00100000:0.0:1783071513.089130:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071513.089536:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692930048 00000100:00100000:3.0:1783071513.089550:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692930048 00000100:00100000:3.0:1783071513.089631:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 246 00000100:00100000:3.0:1783071513.089643:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0391ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+23:12472:x1869685692930048:12345-192.168.204.38@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1783071513.089860:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdd023 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071513.089883:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdcfdd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99107 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071513.089894:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdd023 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071513.089942:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdcfdd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99107 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071513.089971:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdcfdd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99107 expref: 23 pid: 6517 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071513.090062:0:6517:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0411c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1869685707652736:192.168.204.38@tcp:104: 00000100:00100000:3.0:1783071513.090154:0:6517:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b2fc82840 going to sleep for 11 seconds 00000100:00100000:3.0:1783071513.098323:0:6517:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0411c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1869685707652736:192.168.204.38@tcp:104: 00010000:00010000:3.0:1783071513.098391:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdd023 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071513.098450:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071513.098513:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692930176 00000100:00100000:2.0:1783071513.098530:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692930176 00010000:00010000:2.0:1783071513.098580:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdcfdd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99107 expref: 24 pid: 6517 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071513.098615:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 105 00000100:00100000:2.0:1783071513.098625:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0391d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf7532e4-6153-424a-9f4e-84941256b41f+24:2405:x1869685692930176:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783071513.098642:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071513.098650:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdcfdd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99107 expref: 24 pid: 6517 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071513.098662:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdcfdd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99107 expref: 24 pid: 6517 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071513.098686:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdcfdd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99107 expref: 24 pid: 6517 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071513.098713:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f8a0179f500) 00010000:00010000:2.0:1783071513.098719:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdd023 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071513.098750:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdd023 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071513.098758:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdd023 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071513.098790:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071513.098856:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0391d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf7532e4-6153-424a-9f4e-84941256b41f+23:2405:x1869685692930176:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 232us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071513.098864:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 105 00010000:00010000:1.0:1783071513.099272:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdd023 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.099281:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdd023 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.099329:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdd023 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.099337:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdd023 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.099343:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdd023 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.099349:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01749600 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:1.0:1783071513.099353:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdd023 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.099361:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdd023 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.099389:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f8a0179f500) 00010000:00010000:1.0:1783071513.099393:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1783071513.099406:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdd023 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.099412:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdd023 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071513.099474:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0391ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+22:12472:x1869685692930048:12345-192.168.204.38@tcp:55:lhsmtool_posix.0 Request processed in 9833us (10355us total) trans 0 rc -22/-22 00000100:00100000:1.0:1783071513.099483:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 246 00000100:00100000:0.0:1783071513.103585:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071513.103734:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692930304 00000100:00100000:2.0:1783071513.103743:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692930304 00000100:00100000:2.0:1783071513.103811:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 78 00000100:00100000:2.0:1783071513.103824:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0391e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf7532e4-6153-424a-9f4e-84941256b41f+8:2406:x1869685692930304:12345-192.168.204.38@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1783071513.103878:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004b3749a1/0x6b58994c2cbdd02a lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071513.103903:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000049e80cbc/0x6b58994c2cbdd007 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99123 expref: 8 pid: 8910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071513.103921:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783071513.103925:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783071513.103930:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b3749a1/0x6b58994c2cbdd02a lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071513.103983:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000049e80cbc/0x6b58994c2cbdd007 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99123 expref: 8 pid: 8910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071513.104027:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000049e80cbc/0x6b58994c2cbdd007 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99123 expref: 8 pid: 8910 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071513.104045:0:8432:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0397d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8432:1869685707652864:192.168.204.38@tcp:104: 00000100:00100000:2.0:1783071513.104158:0:8432:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a038bccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783071513.107924:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071513.107996:0:8432:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0397d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8432:1869685707652864:192.168.204.38@tcp:104: 00010000:00010000:2.0:1783071513.108033:0:8432:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004b3749a1/0x6b58994c2cbdd02a lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071513.108825:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692930432 00000100:00100000:3.0:1783071513.108860:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692930432 00010000:00010000:3.0:1783071513.108914:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000049e80cbc/0x6b58994c2cbdd007 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99123 expref: 9 pid: 8910 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071513.108970:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 106 00000100:00100000:3.0:1783071513.109347:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0391fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf7532e4-6153-424a-9f4e-84941256b41f+9:2406:x1869685692930432:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783071513.109395:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071513.109426:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000049e80cbc/0x6b58994c2cbdd007 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99123 expref: 9 pid: 8910 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071513.109444:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000049e80cbc/0x6b58994c2cbdd007 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99123 expref: 9 pid: 8910 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071513.109475:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049e80cbc/0x6b58994c2cbdd007 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99123 expref: 9 pid: 8910 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071513.109492:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783071513.109498:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783071513.109505:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004b3749a1/0x6b58994c2cbdd02a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071513.109517:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b3749a1/0x6b58994c2cbdd02a lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071513.109733:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071513.109805:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0391fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf7532e4-6153-424a-9f4e-84941256b41f+8:2406:x1869685692930432:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 823us (1889us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071513.109815:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 106 00010000:00010000:3.0:1783071513.111189:0:8432:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004b3749a1/0x6b58994c2cbdd02a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071513.111230:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b3749a1/0x6b58994c2cbdd02a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071513.111259:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004b3749a1/0x6b58994c2cbdd02a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071513.111416:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b3749a1/0x6b58994c2cbdd02a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071513.111425:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b3749a1/0x6b58994c2cbdd02a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071513.111433:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd67c00 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:3.0:1783071513.111438:0:8432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b3749a1/0x6b58994c2cbdd02a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071513.111448:0:8432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b3749a1/0x6b58994c2cbdd02a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071513.111466:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b3749a1/0x6b58994c2cbdd02a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071513.111474:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b3749a1/0x6b58994c2cbdd02a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071513.111602:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0391e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf7532e4-6153-424a-9f4e-84941256b41f+7:2406:x1869685692930304:12345-192.168.204.38@tcp:1:lhsmtool_posix.0 Request processed in 7778us (8023us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071513.111617:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 78 00000100:00100000:0.0:1783071513.116533:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071513.116653:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692930688 00000100:00100000:2.0:1783071513.116666:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692930688 00000100:00100000:2.0:1783071513.116736:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 247 00000100:00100000:2.0:1783071513.116748:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0391d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+22:12472:x1869685692930688:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1783071513.116856:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdd031 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071513.116877:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdcf20 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990cf expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071513.116887:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdd031 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071513.116967:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdcf20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990cf expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071513.116986:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdcf20 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990cf expref: 22 pid: 6516 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071513.117005:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0397d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6518:1869685707652992:192.168.204.38@tcp:104: 00000100:00100000:2.0:1783071513.117171:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a038bccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783071513.123574:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071513.123656:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692930816 00000100:00100000:3.0:1783071513.123667:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692930816 00010000:00010000:3.0:1783071513.123716:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdcf20 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990cf expref: 23 pid: 6516 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071513.123777:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 107 00000100:00100000:3.0:1783071513.123788:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0391ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf7532e4-6153-424a-9f4e-84941256b41f+23:2406:x1869685692930816:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783071513.123806:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071513.123815:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdcf20 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990cf expref: 23 pid: 6516 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071513.123829:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdcf20 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990cf expref: 23 pid: 6516 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071513.123857:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f8a020ca100) 00010000:00010000:3.0:1783071513.123863:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdcf82 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990f2 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071513.123875:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdd031 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071513.123883:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdd031 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071513.123925:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdd031 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071513.123958:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783071513.124023:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0391ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf7532e4-6153-424a-9f4e-84941256b41f+23:2406:x1869685692930816:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 236us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071513.124032:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 107 00010000:00010000:2.0:1783071513.124763:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66c00/0x6b58994c2cbdcf20 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990cf expref: 22 pid: 6516 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071513.124783:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0397d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6518:1869685707652992:192.168.204.38@tcp:104: 00010000:00010000:2.0:1783071513.124806:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdd031 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071513.124816:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdd031 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071513.124822:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdd031 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071513.125121:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdd038 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071513.125135:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdcfeb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9910e expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071513.125145:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdd038 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071513.125193:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdcfeb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9910e expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071513.125209:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdcfeb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9910e expref: 22 pid: 6516 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071513.125224:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0397d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6518:1869685707653120:192.168.204.38@tcp:104: 00000100:00100000:2.0:1783071513.125360:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a038bcc00 going to sleep for 11 seconds 00000100:00100000:2.0:1783071513.134250:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0397d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6518:1869685707653120:192.168.204.38@tcp:104: 00010000:00010000:2.0:1783071513.134284:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdd038 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071513.139925:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071513.141414:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692930944 00000100:00100000:2.0:1783071513.141428:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692930944 00010000:00010000:2.0:1783071513.141485:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdcfeb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9910e expref: 23 pid: 6516 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071513.141546:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 108 00000100:00100000:2.0:1783071513.141558:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab88850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf7532e4-6153-424a-9f4e-84941256b41f+23:2406:x1869685692930944:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783071513.141577:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071513.141584:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdcfeb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9910e expref: 23 pid: 6516 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071513.141609:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdcfeb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9910e expref: 23 pid: 6516 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071513.141653:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdcfeb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9910e expref: 23 pid: 6516 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071513.141670:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f8a0179f500) 00010000:00010000:2.0:1783071513.141676:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdd038 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071513.141686:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdd038 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071513.141694:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdd038 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071513.141733:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071513.141802:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab88850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf7532e4-6153-424a-9f4e-84941256b41f+22:2406:x1869685692930944:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 245us (1897us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071513.141811:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 108 00010000:00010000:3.0:1783071513.142006:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdd038 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071513.142015:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdd038 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783071513.142160:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:3.0:1783071513.142285:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:3.0:1783071513.142324:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:3.0:1783071513.142467:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0411c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6518:1869685707653248:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783071513.142545:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071513.142575:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a032359c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783071513.143537:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707653248 00000100:00100000:0.0:1783071513.143550:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707653248 00000100:00100000:0.0:1783071513.143611:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1783071513.143621:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0411d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6518:x1869685707653248:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1783071513.143738:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0411d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6518:x1869685707653248:12345-0@lo:1000:mdt00_002.0 Request processed in 118us (1193us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071513.143746:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1783071513.144155:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0411c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6518:1869685707653248:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1783071513.144297:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:3.0:1783071513.144360:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0411c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6518:1869685707653376:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783071513.144423:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071513.144450:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a03235540 going to sleep for 11 seconds 00000100:00100000:1.0:1783071513.144565:0:9413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707653376 00000100:00100000:1.0:1783071513.144571:0:9413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707653376 00000100:00100000:1.0:1783071513.144692:0:9413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1783071513.144703:0:9413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0411c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6518:x1869685707653376:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1783071513.144833:0:9413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0411c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6518:x1869685707653376:12345-0@lo:1000:mdt00_002.0 Request processed in 132us (408us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1783071513.144891:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0411c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6518:1869685707653376:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1783071513.144938:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdd038 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071513.144974:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdd038 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071513.144981:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdd038 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071513.144988:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd66a00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071513.144993:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdd038 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071513.145002:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdd038 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071513.145020:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f8a0179f500) 00010000:00010000:3.0:1783071513.145023:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783071513.145027:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdd038 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071513.145033:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdd038 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071513.145059:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66400/0x6b58994c2cbdcf7b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071513.145066:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66400/0x6b58994c2cbdcf7b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071513.145071:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66400/0x6b58994c2cbdcf7b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071513.145076:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd66400 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071513.145086:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66400/0x6b58994c2cbdcf7b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071513.145092:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66400/0x6b58994c2cbdcf7b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071513.145101:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f8a020ca100) 00010000:00010000:3.0:1783071513.145103:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783071513.145111:0:6518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdcf82 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990f2 expref: 25 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071513.145122:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdcf82 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990f2 expref: 25 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071513.145132:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdcf82 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990f2 expref: 25 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071513.145160:0:6518:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdcf82 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990f2 expref: 25 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071513.145172:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0411fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6518:1869685707653504:192.168.204.38@tcp:105: 00000100:00100000:3.0:1783071513.145254:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a03235540 going to sleep for 11 seconds 00000100:00100000:3.0:1783071513.151487:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071513.151536:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692931072 00000100:00100000:3.0:1783071513.151546:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692931072 00000100:00100000:3.0:1783071513.151605:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 61 00000100:00100000:3.0:1783071513.151616:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0411ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+26:12471:x1869685692931072:12345-192.168.204.38@tcp:49:lfs.0 00000100:00100000:3.0:1783071513.151767:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0411ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+26:12471:x1869685692931072:12345-192.168.204.38@tcp:49:lfs.0 Request processed in 152us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071513.151791:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 61 00000100:00100000:2.0:1783071513.151919:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0411fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6518:1869685707653504:192.168.204.38@tcp:105: 00010000:00010000:2.0:1783071513.151948:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66400/0x6b58994c2cbdcf7b lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071513.151960:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66400/0x6b58994c2cbdcf7b lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071513.151997:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdd03f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071513.152014:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdd03f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071513.152040:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdd03f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071513.152052:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdd03f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071513.152058:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdd03f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071513.152064:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdd03f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071513.152070:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd66200 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:2.0:1783071513.152073:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdd03f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071513.152080:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdd03f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071513.152093:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f8a020ca100) 00010000:00010000:2.0:1783071513.152096:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071513.152100:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdd03f lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071513.152106:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66200/0x6b58994c2cbdd03f lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071513.152116:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdd031 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071513.152122:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdd031 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071513.152134:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdd031 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071513.152140:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd67200 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:2.0:1783071513.152143:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdd031 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071513.152150:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdd031 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071513.152159:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f8a020ca100) 00010000:00010000:2.0:1783071513.152162:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783071513.152165:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdd031 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071513.152172:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67200/0x6b58994c2cbdd031 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071513.152319:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0391d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+25:12472:x1869685692930688:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 Request processed in 35573us (35809us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1783071513.152328:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 247 00000020:00080000:2.0:1783071513.152332:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1783071513.152721:0:9413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000040:00080000:2.0:1783071513.156347:0:13796:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783071513.156357:0:13796:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783071513.157021:0:13796:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1783071513.157034:0:13796:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783071513.161355:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071513.161464:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692931328 00000100:00100000:3.0:1783071513.161475:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692931328 00000100:00100000:3.0:1783071513.161544:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 62 00000100:00100000:3.0:1783071513.161556:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0699cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+25:12472:x1869685692931328:12345-192.168.204.38@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1783071513.161831:0:6520:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1783071513.161870:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:3.0:1783071513.161917:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdd046 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071513.161935:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdd046 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071513.161946:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdd046 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071513.161956:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdd046 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071513.161962:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdd046 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071513.161968:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdd046 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071513.161987:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783071513.162086:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0699cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+27:12472:x1869685692931328:12345-192.168.204.38@tcp:35:lhsmtool_posix.0 Request processed in 531us (740us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1783071513.162094:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 62 00000020:00080000:3.0:1783071513.162117:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1783071513.162828:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783071513.162839:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdd046 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.162849:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01749600 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:1.0:1783071513.162853:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdd046 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.162873:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdd046 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.162891:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f8a0179f500) 00010000:00010000:1.0:1783071513.162894:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783071513.162899:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdd046 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.162914:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdd046 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.162927:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071513.162929:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071513.162931:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071513.166181:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071513.167813:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692931584 00000100:00100000:3.0:1783071513.167831:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692931584 00000100:00100000:3.0:1783071513.167920:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 248 00000100:00100000:3.0:1783071513.167932:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03af3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+27:12471:x1869685692931584:12345-192.168.204.38@tcp:58:lfs.0 00000040:00080000:3.0:1783071513.168151:0:13815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1783071513.168252:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03af3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+27:12471:x1869685692931584:12345-192.168.204.38@tcp:58:lfs.0 Request processed in 321us (2081us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071513.168261:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 248 00000100:00100000:3.0:1783071513.213090:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071513.213444:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692931712 00000100:00100000:1.0:1783071513.213456:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692931712 00000100:00100000:1.0:1783071513.213532:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 249 00000100:00100000:1.0:1783071513.213544:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0411ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+27:12474:x1869685692931712:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1783071513.213570:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071513.213593:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d8400/0x6b58994c2cbdd04d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d9912a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.213668:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9c00/0x6b58994c2cbdd054 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.213684:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9c00/0x6b58994c2cbdd054 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.213697:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9c00/0x6b58994c2cbdd054 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.213712:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d8600/0x6b58994c2cbdd05b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.213719:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d8600/0x6b58994c2cbdd05b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.213744:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d8600/0x6b58994c2cbdd05b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.213825:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9e00/0x6b58994c2cbdd062 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.213836:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdcf6d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990eb expref: 28 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.213844:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9e00/0x6b58994c2cbdd062 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.213886:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdcf6d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990eb expref: 28 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.213902:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdcf6d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990eb expref: 28 pid: 6517 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071513.213917:0:6517:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03af0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1869685707653632:192.168.204.38@tcp:104: 00000100:00100000:1.0:1783071513.214030:0:6517:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b06c44c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783071513.217759:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071513.217883:0:6517:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03af0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1869685707653632:192.168.204.38@tcp:104: 00010000:00010000:1.0:1783071513.217913:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9e00/0x6b58994c2cbdd062 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071513.218090:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692931968 00000100:00100000:3.0:1783071513.218098:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692931968 00000100:00100000:3.0:1783071513.218153:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 63 00000100:00100000:3.0:1783071513.218164:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0397d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+29:6637:x1869685692931968:12345-192.168.204.38@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1783071513.218461:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0397d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+30:6637:x1869685692931968:12345-192.168.204.38@tcp:35:ldlm_bl.0 Request processed in 298us (713us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1783071513.218470:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 63 00000100:00100000:2.0:1783071513.226517:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071513.226785:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692932096 00000100:00100000:3.0:1783071513.226796:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692932096 00010000:00010000:3.0:1783071513.226841:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdcf6d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990eb expref: 30 pid: 6517 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071513.226884:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 109 00000100:00100000:3.0:1783071513.226895:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0397e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf7532e4-6153-424a-9f4e-84941256b41f+30:2406:x1869685692932096:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783071513.226922:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071513.226929:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdcf6d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990eb expref: 30 pid: 6517 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071513.226957:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdcf6d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990eb expref: 30 pid: 6517 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071513.226981:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdcf6d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990eb expref: 30 pid: 6517 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071513.226998:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f8a020ca100) 00010000:00010000:3.0:1783071513.227003:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9e00/0x6b58994c2cbdd062 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071513.227013:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9e00/0x6b58994c2cbdd062 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071513.227021:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9e00/0x6b58994c2cbdd062 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071513.227052:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783071513.227082:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9e00/0x6b58994c2cbdd062 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.227093:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9e00/0x6b58994c2cbdd062 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071513.227113:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0397e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf7532e4-6153-424a-9f4e-84941256b41f+29:2406:x1869685692932096:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 219us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071513.227122:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 109 00000004:00200000:1.0:1783071513.227159:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1783071513.227163:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783071513.227183:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9e00/0x6b58994c2cbdd062 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.227196:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9e00/0x6b58994c2cbdd062 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.227205:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9c00/0x6b58994c2cbdd054 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.227211:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9c00/0x6b58994c2cbdd054 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.227217:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9c00/0x6b58994c2cbdd054 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.227222:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b421d9c00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:1.0:1783071513.227226:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9c00/0x6b58994c2cbdd054 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.227232:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9c00/0x6b58994c2cbdd054 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.227242:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f8a021bdc00) 00010000:00010000:1.0:1783071513.227244:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071513.227248:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9c00/0x6b58994c2cbdd054 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.227254:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9c00/0x6b58994c2cbdd054 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.227289:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d8600/0x6b58994c2cbdd05b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.227296:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d8600/0x6b58994c2cbdd05b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.227300:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d8600/0x6b58994c2cbdd05b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.227304:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b421d8600 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:1.0:1783071513.227307:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d8600/0x6b58994c2cbdd05b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.227312:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d8600/0x6b58994c2cbdd05b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.227319:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f8b11ce3c00) 00010000:00010000:1.0:1783071513.227321:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071513.227324:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d8600/0x6b58994c2cbdd05b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.227329:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d8600/0x6b58994c2cbdd05b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.227396:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d8400/0x6b58994c2cbdd04d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9912a expref: 29 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.227412:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9e00/0x6b58994c2cbdd062 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9912a expref: 28 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071513.227430:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f8a020ca100) 00010000:00010000:1.0:1783071513.227432:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783071513.227434:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b421d9e00, rc 0) 00000100:00100000:1.0:1783071513.227465:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0411ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+28:12474:x1869685692931712:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 13925us (14387us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071513.227472:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 249 00010000:00010000:2.0:1783071513.858528:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071513.879202:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071513.879245:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071513.879267:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071513.879295:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071513.879316:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071513.879335:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071513.879359:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071513.879409:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692932608 00000100:00100000:2.0:1783071513.879421:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692932608 00000100:00100000:2.0:1783071513.879468:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692932736 00000100:00100000:2.0:1783071513.879471:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692932736 00000100:00100000:2.0:1783071513.879502:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 147 00000100:00100000:2.0:1783071513.879526:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0397c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf7532e4-6153-424a-9f4e-84941256b41f+7:2403:x1869685692932608:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1783071513.879619:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0397c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf7532e4-6153-424a-9f4e-84941256b41f+7:2403:x1869685692932608:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 96us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071513.879627:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 147 00000100:00100000:2.0:1783071513.879643:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 148 00000100:00100000:2.0:1783071513.879650:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0397dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf7532e4-6153-424a-9f4e-84941256b41f+9:2403:x1869685692932736:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1783071513.879673:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0397dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf7532e4-6153-424a-9f4e-84941256b41f+9:2403:x1869685692932736:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 24us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071513.879679:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 148 00000100:00100000:2.0:1783071513.879695:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692932352 00000100:00100000:2.0:1783071513.879699:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692932352 00000100:00100000:2.0:1783071513.879723:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692932864 00000100:00100000:2.0:1783071513.879726:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692932864 00000100:00100000:2.0:1783071513.879739:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692932480 00000100:00100000:2.0:1783071513.879749:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692932480 00000100:00100000:2.0:1783071513.879766:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692932992 00000100:00100000:2.0:1783071513.879768:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692932992 00000100:00100000:2.0:1783071513.879782:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 307 00000100:00100000:2.0:1783071513.879787:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0397fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+28:2403:x1869685692932352:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1783071513.879819:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0397fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+28:2403:x1869685692932352:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 31us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071513.879825:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 307 00000100:00100000:2.0:1783071513.879837:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 308 00000100:00100000:2.0:1783071513.879842:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0397d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2403:x1869685692932864:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1783071513.879862:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0397d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2403:x1869685692932864:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 20us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071513.879868:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 308 00000100:00100000:2.0:1783071513.879877:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 309 00000100:00100000:2.0:1783071513.879883:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0397df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+5:2403:x1869685692932480:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1783071513.879902:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0397df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+5:2403:x1869685692932480:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 19us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071513.879908:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 309 00000100:00100000:2.0:1783071513.879917:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 310 00000100:00100000:2.0:1783071513.879923:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0397c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2403:x1869685692932992:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1783071513.879941:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0397c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2403:x1869685692932992:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 18us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071513.879947:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 310 00000100:00100000:2.0:1783071513.879963:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692932224 00000100:00100000:2.0:1783071513.879972:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692932224 00000100:00100000:2.0:1783071513.880000:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 385 00000100:00100000:2.0:1783071513.880005:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07697850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:2403:x1869685692932224:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1783071513.880030:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07697850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:2403:x1869685692932224:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 25us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071513.880036:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 385 00000100:00080000:2.0:1783071513.880076:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783071513.880080:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783071513.880083:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:0.0:1783071513.920972:0:14652:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783071513.920981:0:14652:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783071513.921014:0:14652:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1783071513.921020:0:14652:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:1.0:1783071513.927603:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:1.0:1783071513.927621:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000040:00080000:2.0:1783071514.180804:0:13796:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783071514.180816:0:13796:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783071514.180851:0:13796:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1783071514.180862:0:13796:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783071514.181023:0:13796:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0397f800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13796:1869685707653760:192.168.204.38@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783071514.181151:0:13796:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a038bca80 going to sleep for 11 seconds 00000100:00100000:2.0:1783071514.190539:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071514.190640:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692933120 00000100:00100000:1.0:1783071514.190650:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692933120 00000100:00100000:1.0:1783071514.190724:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 250 00000100:00100000:1.0:1783071514.190735:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0397ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+29:12486:x1869685692933120:12345-192.168.204.38@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1783071514.190771:0:6516:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1783071514.190902:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0397ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+29:12486:x1869685692933120:12345-192.168.204.38@tcp:53:lhsmtool_posix.0 Request processed in 169us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071514.190911:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 250 00000100:00100000:0.0:1783071514.191992:0:13796:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0397f800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13796:1869685707653760:192.168.204.38@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783071514.195469:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071514.195591:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692933376 00000100:00100000:2.0:1783071514.195602:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692933376 00000100:00100000:2.0:1783071514.195664:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 251 00000100:00100000:2.0:1783071514.195674:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0391c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+28:12486:x1869685692933376:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783071514.195697:0:10292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071514.195718:0:10292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdd069 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d99131 expref: -99 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071514.195842:0:10292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66400/0x6b58994c2cbdd070 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071514.195857:0:10292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66400/0x6b58994c2cbdd070 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071514.195899:0:10292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66400/0x6b58994c2cbdd070 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071514.195913:0:10292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1783071514.196035:0:10292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdd069 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99131 expref: 31 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071514.196055:0:10292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66400/0x6b58994c2cbdd070 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99131 expref: 30 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071514.196064:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f8a020ca100) 00010000:00010000:2.0:1783071514.196067:0:10292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783071514.196070:0:10292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b2fd66400, rc 0) 00000100:00100000:2.0:1783071514.196480:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0391c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+30:12486:x1869685692933376:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 805us (1019us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1783071514.196487:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 251 00000100:00100000:3.0:1783071514.206751:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071514.206864:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071514.207485:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692933632 00000100:00100000:0.0:1783071514.207495:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692933632 00000100:00100000:0.0:1783071514.207572:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 252 00000100:00100000:0.0:1783071514.207684:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0411f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+30:12486:x1869685692933632:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1783071514.207784:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdd07e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071514.207803:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdd07e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071514.207815:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdd07e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071514.209279:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdd07e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071514.209294:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdd07e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071514.209300:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdd07e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071514.209306:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03865600 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:0.0:1783071514.209311:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdd07e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071514.209318:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdd07e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071514.209333:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f8a020ca100) 00010000:00010000:0.0:1783071514.209336:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783071514.209340:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdd07e lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071514.209346:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865600/0x6b58994c2cbdd07e lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071514.209612:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692933760 00000100:00100000:2.0:1783071514.209621:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692933760 00000100:00100000:0.0:1783071514.209626:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0411f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf7532e4-6153-424a-9f4e-84941256b41f+32:12486:x1869685692933632:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 Request processed in 2042us (2891us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1783071514.209636:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 252 00000100:00100000:0.0:1783071514.209688:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 17 00000100:00100000:0.0:1783071514.210020:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0411e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf7532e4-6153-424a-9f4e-84941256b41f+31:2405:x1869685692933760:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783071514.210039:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071514.210059:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66400/0x6b58994c2cbdd070 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99131 expref: 31 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071514.210072:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f8a020ca100) 00010000:00010000:0.0:1783071514.210076:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071514.210111:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0411e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf7532e4-6153-424a-9f4e-84941256b41f+30:2405:x1869685692933760:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 415us (3247us total) trans 0 rc 0/0 00000040:00080000:1.0:1783071514.213711:0:13796:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783071514.213723:0:13796:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783071514.214480:0:13796:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1783071514.214496:0:13796:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783071514.216080:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071514.216358:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692934016 00000100:00100000:1.0:1783071514.216386:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692934016 00000100:00100000:1.0:1783071514.216456:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 64 00000100:00100000:1.0:1783071514.216477:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0411c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+31:12486:x1869685692934016:12345-192.168.204.38@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1783071514.216752:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0411c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+32:12486:x1869685692934016:12345-192.168.204.38@tcp:35:lhsmtool_posix.0 Request processed in 276us (682us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1783071514.216775:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 64 00000100:00100000:0.0:1783071514.217821:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 17 00010000:00010000:1.0:1783071514.884151:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071515.460743:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0397f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707653888:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783071515.460821:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071515.460916:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707653888 00000100:00100000:2.0:1783071515.460924:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707653888 00000100:00100000:2.0:1783071515.460978:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1783071515.460986:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0397f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707653888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783071515.461020:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1783071515.461067:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0397f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707653888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071515.461082:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1783071515.461124:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0397f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707653888:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783071515.462616:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0411fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869685707654144:0@lo:400:kworker.0 00000100:00100000:3.0:1783071515.462689:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071515.462728:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b078da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1869685707654656:0@lo:400:kworker.0 00000100:00100000:3.0:1783071515.462751:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071515.462786:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b078db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1869685707655168:0@lo:400:kworker.0 00000100:00100000:3.0:1783071515.462806:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071515.462829:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1783071515.462834:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0411dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869685707654272:0@lo:400:kworker.0 00000100:00100000:3.0:1783071515.462853:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071515.462883:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b078d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707654784:0@lo:400:kworker.0 00000100:00100000:3.0:1783071515.462905:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071515.462920:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b078dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707655296:0@lo:400:kworker.0 00000100:00100000:3.0:1783071515.462937:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071515.462964:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707654144 00000100:00100000:3.0:1783071515.462969:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707654144 00000100:00100000:3.0:1783071515.463008:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707654656 00000100:00100000:3.0:1783071515.463011:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707654656 00000100:00100000:3.0:1783071515.463028:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707655168 00000100:00100000:3.0:1783071515.463031:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707655168 00000100:00100000:3.0:1783071515.463042:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707654272 00000100:00100000:3.0:1783071515.463045:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707654272 00000100:00100000:3.0:1783071515.463057:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1783071515.463064:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b078db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1869685707654144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071515.463112:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b078db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1869685707654144:12345-0@lo:400:kworker.0 Request processed in 47us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071515.463118:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1783071515.463132:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1783071515.463138:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b078d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1869685707654656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071515.463163:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b078d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1869685707654656:12345-0@lo:400:kworker.0 Request processed in 25us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071515.463170:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1783071515.463189:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1783071515.463195:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b078d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1869685707655168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071515.463223:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b078d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1869685707655168:12345-0@lo:400:kworker.0 Request processed in 27us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071515.463228:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1783071515.463239:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1783071515.463244:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1869685707654272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071515.463267:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1869685707654272:12345-0@lo:400:kworker.0 Request processed in 23us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071515.463272:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1783071515.463287:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707654784 00000100:00100000:3.0:1783071515.463290:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707654784 00000100:00100000:3.0:1783071515.463313:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707655296 00000100:00100000:3.0:1783071515.463315:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707655296 00000100:00100000:3.0:1783071515.463330:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1783071515.463335:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707654784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071515.463384:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707654784:12345-0@lo:400:kworker.0 Request processed in 28us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071515.463390:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1783071515.463400:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1783071515.463405:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707655296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071515.463444:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707655296:12345-0@lo:400:kworker.0 Request processed in 39us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071515.463450:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1783071515.463495:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0411dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869685707654272:0@lo:400:kworker.0 00000100:00100000:3.0:1783071515.463506:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b078d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707654784:0@lo:400:kworker.0 00000100:00100000:3.0:1783071515.463522:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b078dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707655296:0@lo:400:kworker.0 00000100:00100000:3.0:1783071515.463530:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0411fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869685707654144:0@lo:400:kworker.0 00010000:00080000:3.0:1783071515.463541:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b078da680 x1869685707654656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071515.463551:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b078da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1869685707654656:0@lo:400:kworker.0 00010000:00080000:3.0:1783071515.463559:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b078db800 x1869685707655168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071515.463566:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b078db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1869685707655168:0@lo:400:kworker.0 00000100:00080000:2.0:1783071515.467019:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783071515.467034:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783071515.467039:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783071515.467072:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0411ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:feaa1501-b927-4e07-baad-3200e92d7497:3648:1869685707654016:0@lo:400:kworker.0 00000100:00100000:2.0:1783071515.467157:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071515.467206:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b078dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1869685707654528:0@lo:400:kworker.0 00000100:00100000:2.0:1783071515.467235:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071515.467263:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b078d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1869685707655040:0@lo:400:kworker.0 00000100:00100000:1.0:1783071515.467279:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707654528 00000100:00100000:1.0:1783071515.467288:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707654528 00000100:00100000:2.0:1783071515.467289:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071515.467320:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1783071515.467329:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0411d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707654400:0@lo:400:kworker.0 00000100:00100000:1.0:1783071515.467343:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707655040 00000100:00100000:1.0:1783071515.467347:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707655040 00000100:00100000:2.0:1783071515.467359:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071515.467390:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1783071515.467402:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0397f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869685707654528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071515.467408:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b078d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707654912:0@lo:400:kworker.0 00000100:00100000:2.0:1783071515.467458:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071515.467488:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b078d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707655424:0@lo:400:kworker.0 00000100:00100000:2.0:1783071515.467512:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071515.467539:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707654016 00000100:00100000:2.0:1783071515.467544:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707654016 00000100:00100000:2.0:1783071515.467574:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1783071515.467582:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07697450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+24:3648:x1869685707654016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071515.467601:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0397f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869685707654528:12345-0@lo:400:kworker.0 Request processed in 201us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071515.467611:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1783071515.467621:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07697450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:feaa1501-b927-4e07-baad-3200e92d7497+24:3648:x1869685707654016:12345-0@lo:400:kworker.0 Request processed in 39us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071515.467629:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1783071515.467635:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1783071515.467658:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0397d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869685707655040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071515.467674:0:9413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707654400 00000100:00100000:2.0:1783071515.467679:0:9413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707654400 00000100:00100000:1.0:1783071515.467697:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0397d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869685707655040:12345-0@lo:400:kworker.0 Request processed in 53us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071515.467706:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1783071515.467711:0:9413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1783071515.467720:0:9413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0397f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707654400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071515.467757:0:9413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0397f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707654400:12345-0@lo:400:kworker.0 Request processed in 38us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071515.467764:0:9413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1783071515.467789:0:8910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707654912 00000100:00100000:2.0:1783071515.467793:0:8910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707654912 00000100:00100000:2.0:1783071515.467828:0:8910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707655424 00000100:00100000:2.0:1783071515.467831:0:8910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707655424 00000100:00100000:2.0:1783071515.467856:0:8910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1783071515.467863:0:8910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3648:x1869685707654912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071515.467895:0:8910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3648:x1869685707654912:12345-0@lo:400:kworker.0 Request processed in 33us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071515.467901:0:8910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1783071515.467912:0:8910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1783071515.467918:0:8910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707655424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071515.467945:0:8910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707655424:12345-0@lo:400:kworker.0 Request processed in 27us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071515.467951:0:8910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:2.0:1783071515.467971:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783071515.467975:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783071515.467977:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783071515.468017:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0411d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707654400:0@lo:400:kworker.0 00000100:00100000:2.0:1783071515.468030:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b078d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707654912:0@lo:400:kworker.0 00000100:00100000:2.0:1783071515.468039:0:3648:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1783071515.468051:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967311 00000004:00080000:2.0:1783071515.468086:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f8a03ad7b80, transno 4294967308 00000004:00080000:2.0:1783071515.468097:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:2.0:1783071515.468109:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f8a0397ca80, transno 4294967311 00000100:00100000:2.0:1783071515.468114:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b078d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707655424:0@lo:400:kworker.0 00000100:00100000:2.0:1783071515.468126:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0411ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:feaa1501-b927-4e07-baad-3200e92d7497:3648:1869685707654016:0@lo:400:kworker.0 00000100:00100000:2.0:1783071515.468135:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b078dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1869685707654528:0@lo:400:kworker.0 00000100:00100000:2.0:1783071515.468144:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b078d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1869685707655040:0@lo:400:kworker.0 00000040:00080000:0.0:1783071515.811344:0:14704:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783071515.811355:0:14704:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783071515.811490:0:14704:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1783071515.811498:0:14704:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1783071515.917936:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071515.946485:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071515.946666:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692934272 00000100:00100000:1.0:1783071515.946676:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692934272 00000100:00100000:1.0:1783071515.946756:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 253 00000100:00100000:1.0:1783071515.946766:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+31:12507:x1869685692934272:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1783071515.946791:0:10292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071515.946817:0:10292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d8600/0x6b58994c2cbdd085 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d99138 expref: -99 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071515.946946:0:10292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9c00/0x6b58994c2cbdd08c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071515.946975:0:10292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9c00/0x6b58994c2cbdd08c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071515.946986:0:10292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9c00/0x6b58994c2cbdd08c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783071515.947000:0:10292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1783071515.947108:0:10292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d8600/0x6b58994c2cbdd085 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99138 expref: 34 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071515.947128:0:10292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9c00/0x6b58994c2cbdd08c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99138 expref: 33 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071515.947138:0:10292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f8a020ca100) 00010000:00010000:1.0:1783071515.947140:0:10292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1783071515.947144:0:10292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b421d9c00, rc 0) 00000100:00100000:1.0:1783071515.947201:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+33:12507:x1869685692934272:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 437us (736us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1783071515.947208:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 253 00000100:00080000:3.0:1783071515.947659:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783071515.950249:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071515.951004:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692934400 00000100:00100000:0.0:1783071515.951016:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692934400 00000100:00100000:0.0:1783071515.951108:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 254 00000100:00100000:0.0:1783071515.951117:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+33:12507:x1869685692934400:12345-192.168.204.38@tcp:54:lfs.0 00010000:00010000:0.0:1783071515.951182:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdd09a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071515.951200:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdd09a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071515.951217:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdd09a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071515.951260:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdd09a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071515.951266:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdd09a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071515.951273:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdd09a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071515.951279:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03865e00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:0.0:1783071515.951283:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdd09a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071515.951290:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdd09a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071515.951302:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f8a020ca100) 00010000:00010000:0.0:1783071515.951305:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783071515.951311:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdd09a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071515.951316:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865e00/0x6b58994c2cbdd09a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071515.951407:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+33:12507:x1869685692934400:12345-192.168.204.38@tcp:54:lfs.0 Request processed in 290us (1165us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071515.951415:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 254 00000100:00100000:2.0:1783071515.972553:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0391d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707655552:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783071515.972623:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071515.972693:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707655552 00000100:00100000:2.0:1783071515.972703:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707655552 00000100:00100000:2.0:1783071515.972747:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1783071515.972757:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1869685707655552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783071515.972786:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1783071515.972833:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1869685707655552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071515.972839:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1783071515.972885:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0391d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707655552:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783071515.975564:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03b82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707655680:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783071515.975638:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071515.975766:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783071515.975775:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03af0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707655808:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783071515.975824:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071515.975897:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707655680 00000100:00100000:2.0:1783071515.975904:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707655680 00000100:00100000:2.0:1783071515.975938:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707655808 00000100:00100000:2.0:1783071515.975941:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707655808 00000100:00100000:2.0:1783071515.975957:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1783071515.975965:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707655680:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783071515.975991:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1783071515.976174:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707655680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 208us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071515.976181:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1783071515.976197:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1783071515.976202:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707655808:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783071515.976218:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783071515.977226:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707655808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1017us (1395us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071515.977237:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1783071515.978013:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03b83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707655936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783071515.978063:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071515.979526:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03af0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707655808:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783071515.979556:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03b82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707655680:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783071515.980680:0:12254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707655936 00000100:00100000:2.0:1783071515.980689:0:12254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707655936 00000100:00100000:2.0:1783071515.980751:0:12254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1783071515.980762:0:12254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707655936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783071515.980808:0:12254:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783071515.980966:0:12254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707655936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 205us (2902us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071515.980973:0:12254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1783071515.981033:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03b83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707655936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783071516.026025:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071516.026168:0:8910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692934528 00000100:00100000:2.0:1783071516.026178:0:8910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692934528 00000100:00100000:2.0:1783071516.026260:0:8910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 79 00000100:00100000:2.0:1783071516.026270:0:8910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03af0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf7532e4-6153-424a-9f4e-84941256b41f+7:2403:x1869685692934528:12345-192.168.204.38@tcp:101:cat.0 00010000:00010000:2.0:1783071516.026288:0:8910:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071516.026308:0:8910:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038eddc02/0x6b58994c2cbdd0a1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d9913f expref: -99 pid: 8910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783071516.026333:0:8910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a478319, atime: 0x6a478318, ctime: 0x6a478319, blocks: 0x8 00000100:00080000:3.0:1783071516.026595:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1783071516.026675:0:8910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=417s v=(0 0) 00010000:00010000:2.0:1783071516.026681:0:8910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783071516.026691:0:8910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038eddc02/0x6b58994c2cbdd0a1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9913f expref: 8 pid: 8910 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071516.026709:0:8910:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000038eddc02/0x6b58994c2cbdd0a1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9913f expref: 8 pid: 8910 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071516.026722:0:8910:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b2fd66c00, rc 0) 00000100:00100000:3.0:1783071516.027090:0:8910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03af0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf7532e4-6153-424a-9f4e-84941256b41f+8:2403:x1869685692934528:12345-192.168.204.38@tcp:101:cat.0 Request processed in 608us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071516.027101:0:8910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 79 00000100:00100000:1.0:1783071516.031711:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071516.032107:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692934656 00000100:00100000:2.0:1783071516.032116:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692934656 00002000:00100000:2.0:1783071516.032184:0:8436:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff8f8a03af0000 x1869685692934656/t0(0) o3->bf7532e4-6153-424a-9f4e-84941256b41f@192.168.204.38@tcp:107/0 lens 488/0 e 0 to 0 dl 1783071527 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783071516.032194:0:8436:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8f8a03af0000 with x1869685692934656 ext(0->4095) 00002000:00010000:2.0:1783071516.032200:0:8436:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f8a03af0000 00000100:00100000:2.0:1783071516.032276:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 7 00000100:00100000:2.0:1783071516.032294:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03af0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bf7532e4-6153-424a-9f4e-84941256b41f+8:2405:x1869685692934656:12345-192.168.204.38@tcp:3:cat.0 00000100:00100000:2.0:1783071516.032550:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03af0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bf7532e4-6153-424a-9f4e-84941256b41f+8:2405:x1869685692934656:12345-192.168.204.38@tcp:3:cat.0 Request processed in 264us (849us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1783071516.032558:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 7 00002000:00100000:2.0:1783071516.032565:0:8436:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff8f8a03af0000 x1869685692934656/t0(0) o3->bf7532e4-6153-424a-9f4e-84941256b41f@192.168.204.38@tcp:107/0 lens 488/4536 e 0 to 0 dl 1783071527 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783071516.032573:0:8436:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8f8a03af0000 with x1869685692934656 ext(0->4095) 00002000:00010000:2.0:1783071516.032576:0:8436:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f8a03af0000 00010000:00010000:1.0:1783071516.931736:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071516.995488:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783071516.995520:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03af2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707656064:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783071516.995619:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071516.996129:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707656064 00000100:00100000:2.0:1783071516.996140:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707656064 00000100:00100000:2.0:1783071516.996205:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1783071516.996217:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03af3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707656064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783071516.996254:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783071516.996317:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03af3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707656064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071516.996325:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1783071517.001065:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03af2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707656064:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1783071517.954906:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071518.978605:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071519.005281:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071519.005341:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071519.005388:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071519.005433:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071519.005455:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071519.005473:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071519.005496:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071519.005531:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692935040 00000100:00100000:2.0:1783071519.005542:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692935040 00000100:00100000:2.0:1783071519.005612:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692935552 00000100:00100000:2.0:1783071519.005615:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692935552 00000100:00100000:2.0:1783071519.005627:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692934912 00000100:00100000:2.0:1783071519.005629:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692934912 00000100:00100000:2.0:1783071519.005640:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692935424 00000100:00100000:2.0:1783071519.005643:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692935424 00000100:00100000:2.0:1783071519.005662:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 317 00000100:00100000:2.0:1783071519.005673:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+5:2404:x1869685692935040:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1783071519.005790:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+5:2404:x1869685692935040:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 118us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071519.005798:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 317 00000100:00100000:2.0:1783071519.005820:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 318 00000100:00100000:2.0:1783071519.005826:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2404:x1869685692935552:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1783071519.005852:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2404:x1869685692935552:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 26us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071519.005858:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 318 00000100:00100000:2.0:1783071519.005869:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 319 00000100:00100000:2.0:1783071519.005875:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+33:2404:x1869685692934912:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1783071519.005898:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+33:2404:x1869685692934912:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 23us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071519.005915:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 319 00000100:00100000:2.0:1783071519.005928:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 320 00000100:00100000:2.0:1783071519.005933:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2404:x1869685692935424:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1783071519.005958:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2404:x1869685692935424:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 26us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071519.005964:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 320 00000100:00100000:2.0:1783071519.005984:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692935296 00000100:00100000:2.0:1783071519.005988:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692935296 00000100:00100000:2.0:1783071519.006015:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692935168 00000100:00100000:2.0:1783071519.006018:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692935168 00000100:00100000:2.0:1783071519.006040:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 153 00000100:00100000:2.0:1783071519.006046:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf7532e4-6153-424a-9f4e-84941256b41f+5:2404:x1869685692935296:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1783071519.006071:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf7532e4-6153-424a-9f4e-84941256b41f+5:2404:x1869685692935296:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 25us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071519.006077:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 153 00000100:00100000:2.0:1783071519.006088:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 154 00000100:00100000:2.0:1783071519.006093:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf7532e4-6153-424a-9f4e-84941256b41f+8:2404:x1869685692935168:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1783071519.006115:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf7532e4-6153-424a-9f4e-84941256b41f+8:2404:x1869685692935168:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 22us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071519.006121:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 154 00000100:00080000:2.0:1783071519.006154:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783071519.006158:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783071519.006161:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783071519.006163:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783071519.006297:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692934784 00000100:00100000:3.0:1783071519.006301:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692934784 00000100:00100000:3.0:1783071519.006345:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 387 00000100:00100000:3.0:1783071519.006352:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07695450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:2404:x1869685692934784:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1783071519.006402:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07695450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:2404:x1869685692934784:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 51us (1140us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071519.006408:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 387 00000001:00080000:0.0:1783071519.050778:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:0.0:1783071519.050834:0:6495:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f8a032359c0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1783071519.050839:0:6495:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8f8b3c761e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f8a03235cc0 00000020:00080000:0.0:1783071519.050842:0:6495:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8f8b3c761000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f8a03bbca00 00000020:00080000:0.0:1783071519.050872:0:6495:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:0.0:1783071519.050895:0:6549:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1783071519.050979:0:6549:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:3.0:1783071519.051026:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9000/0x6b58994c2cbdd01c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071519.051055:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9000/0x6b58994c2cbdd01c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071519.051064:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9000/0x6b58994c2cbdd01c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071519.051070:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b421d9000 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071519.051077:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9000/0x6b58994c2cbdd01c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071519.051085:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9000/0x6b58994c2cbdd01c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071519.051108:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f8a0179f500) 00010000:00010000:3.0:1783071519.051111:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071519.051117:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9000/0x6b58994c2cbdd01c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071519.051123:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9000/0x6b58994c2cbdd01c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783071519.055887:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:2.0:1783071519.055911:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00010000:00010000:2.0:1783071520.006112:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071520.578601:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783071520.578627:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03b80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707656192:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783071520.578713:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071520.578778:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707656192 00000100:00100000:2.0:1783071520.578787:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707656192 00000100:00100000:2.0:1783071520.579452:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1783071520.579463:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707656192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783071520.579502:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1783071520.579572:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707656192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071520.579579:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1783071520.579737:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03b80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707656192:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783071520.580503:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03af1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869685707656448:0@lo:400:kworker.0 00000100:00100000:1.0:1783071520.580568:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071520.580617:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1869685707656960:0@lo:400:kworker.0 00000100:00100000:1.0:1783071520.580641:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071520.580655:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1869685707657472:0@lo:400:kworker.0 00000100:00100000:1.0:1783071520.580673:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071520.580694:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1783071520.580710:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03af1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869685707656576:0@lo:400:kworker.0 00000100:00100000:1.0:1783071520.580731:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071520.580745:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707657088:0@lo:400:kworker.0 00000100:00100000:1.0:1783071520.580767:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071520.580780:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707657600:0@lo:400:kworker.0 00000100:00100000:1.0:1783071520.580798:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071520.580833:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03af1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707656704:0@lo:400:kworker.0 00000100:00100000:1.0:1783071520.580868:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071520.580884:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707657216:0@lo:400:kworker.0 00000100:00100000:1.0:1783071520.580902:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071520.580915:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707657728:0@lo:400:kworker.0 00000100:00100000:1.0:1783071520.580934:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071520.580949:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1783071520.580955:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03af2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:feaa1501-b927-4e07-baad-3200e92d7497:3645:1869685707656320:0@lo:400:kworker.0 00000100:00100000:1.0:1783071520.580985:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071520.581003:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03af3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1869685707656832:0@lo:400:kworker.0 00000100:00100000:1.0:1783071520.581024:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071520.581037:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1869685707657344:0@lo:400:kworker.0 00000100:00100000:1.0:1783071520.581067:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071520.581091:0:9413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707656704 00000100:00100000:1.0:1783071520.581097:0:9413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707656704 00000100:00100000:1.0:1783071520.581135:0:9413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1783071520.581143:0:9413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707656704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071520.581191:0:9413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707656704:12345-0@lo:400:kworker.0 Request processed in 49us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071520.581197:0:9413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1783071520.581233:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03af1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707656704:0@lo:400:kworker.0 00000100:00100000:3.0:1783071520.581923:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707656448 00000100:00100000:3.0:1783071520.581929:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707656448 00000100:00100000:3.0:1783071520.581959:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707656960 00000100:00100000:3.0:1783071520.581962:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707656960 00000100:00100000:3.0:1783071520.581996:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707657472 00000100:00100000:3.0:1783071520.581999:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707657472 00000100:00100000:2.0:1783071520.582005:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707656576 00000100:00100000:2.0:1783071520.582009:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707656576 00000100:00100000:3.0:1783071520.582011:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707656832 00000100:00100000:3.0:1783071520.582013:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707656832 00000100:00100000:3.0:1783071520.582024:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707657344 00000100:00100000:3.0:1783071520.582026:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707657344 00000100:00100000:2.0:1783071520.582028:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1783071520.582034:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869685707656448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071520.582049:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1783071520.582054:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869685707656960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071520.582094:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869685707656448:12345-0@lo:400:kworker.0 Request processed in 55us (1522us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071520.582101:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1783071520.582116:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00080000:1.0:1783071520.582118:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783071520.582122:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869685707657472:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1783071520.582123:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783071520.585320:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869685707657472:12345-0@lo:400:kworker.0 Request processed in 3190us (4636us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071520.585336:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1783071520.585419:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1783071520.585432:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869685707656576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071520.585509:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869685707656576:12345-0@lo:400:kworker.0 Request processed in 82us (4777us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071520.585515:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1783071520.585530:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1783071520.585537:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1869685707656832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071520.585587:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1869685707656832:12345-0@lo:400:kworker.0 Request processed in 51us (4562us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071520.586017:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869685707656960:12345-0@lo:400:kworker.0 Request processed in 3959us (5372us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071520.586025:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1783071520.586043:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1783071520.586053:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1869685707657344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071520.586087:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1869685707657344:12345-0@lo:400:kworker.0 Request processed in 38us (5019us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071520.586092:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1783071520.588721:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03af3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1869685707656832:0@lo:400:kworker.0 00000100:00100000:1.0:1783071520.588739:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1869685707657344:0@lo:400:kworker.0 00000100:00100000:2.0:1783071520.588798:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1783071520.589074:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707656320 00000100:00100000:3.0:1783071520.589083:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707656320 00000100:00100000:3.0:1783071520.589172:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:3.0:1783071520.589182:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07697c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+24:3645:x1869685707656320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071520.589261:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07697c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+24:3645:x1869685707656320:12345-0@lo:400:kworker.0 Request processed in 81us (8273us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071520.589268:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:3.0:1783071520.589300:0:8910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707657088 00000100:00100000:3.0:1783071520.589304:0:8910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707657088 00000100:00100000:3.0:1783071520.589331:0:8910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707657600 00000100:00100000:3.0:1783071520.589334:0:8910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707657600 00000100:00100000:3.0:1783071520.589347:0:8910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707657216 00000100:00100000:3.0:1783071520.589350:0:8910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707657216 00000100:00100000:3.0:1783071520.589377:0:8910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707657728 00000100:00100000:3.0:1783071520.589380:0:8910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707657728 00000100:00100000:3.0:1783071520.589408:0:8910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1783071520.589414:0:8910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707657088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071520.589449:0:8910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707657088:12345-0@lo:400:kworker.0 Request processed in 35us (8680us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071520.589463:0:8910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1783071520.589475:0:8910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1783071520.589481:0:8910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707657600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071520.589510:0:8910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707657600:12345-0@lo:400:kworker.0 Request processed in 30us (8711us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071520.589516:0:8910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1783071520.589528:0:8910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1783071520.589534:0:8910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707657216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071520.589559:0:8910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707657216:12345-0@lo:400:kworker.0 Request processed in 27us (8656us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071520.589564:0:8910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1783071520.589573:0:8910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1783071520.589579:0:8910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707657728:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1783071520.590271:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783071520.590276:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783071520.601983:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03af1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869685707656576:0@lo:400:kworker.0 00000100:00100000:2.0:1783071520.602005:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707657088:0@lo:400:kworker.0 00000100:00100000:2.0:1783071520.602017:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707657600:0@lo:400:kworker.0 00000100:00100000:2.0:1783071520.602033:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03af1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869685707656448:0@lo:400:kworker.0 00010000:00080000:2.0:1783071520.602051:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a03a9e680 x1869685707656960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071520.602063:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1869685707656960:0@lo:400:kworker.0 00010000:00080000:2.0:1783071520.602076:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a03a9ed80 x1869685707657472/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071520.602084:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1869685707657472:0@lo:400:kworker.0 00000100:00100000:1.0:1783071520.602409:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03af2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:feaa1501-b927-4e07-baad-3200e92d7497:3645:1869685707656320:0@lo:400:kworker.0 00000100:00100000:1.0:1783071520.602429:0:3645:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:1.0:1783071520.602434:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f8a0397ea00, transno 4294967323 00000100:00100000:3.0:1783071520.602446:0:8910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707657728:12345-0@lo:400:kworker.0 Request processed in 12862us (21505us total) trans 0 rc 0/0 00000004:00080000:1.0:1783071520.602450:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:3.0:1783071520.602473:0:8910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1783071520.602480:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707657216:0@lo:400:kworker.0 00000100:00100000:1.0:1783071520.602497:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707657728:0@lo:400:kworker.0 00000100:00100000:3.0:1783071520.931617:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071520.931851:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692935680 00000100:00100000:2.0:1783071520.931861:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692935680 00000100:00100000:2.0:1783071520.931922:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 255 00000100:00100000:2.0:1783071520.931946:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+19:12160:x1869685692935680:12345-192.168.204.38@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1783071520.932074:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf7532e4-6153-424a-9f4e-84941256b41f+19:12160:x1869685692935680:12345-192.168.204.38@tcp:60:lhsmtool_posix.0 Request processed in 129us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071520.932082:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 255 00000100:00100000:1.0:1783071520.941771:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071520.941882:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692935808 00000100:00100000:2.0:1783071520.941893:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692935808 00000100:00100000:2.0:1783071520.941958:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 256 00000100:00100000:2.0:1783071520.941969:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+5:12160:x1869685692935808:12345-192.168.204.38@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1783071520.942083:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf7532e4-6153-424a-9f4e-84941256b41f+5:12160:x1869685692935808:12345-192.168.204.38@tcp:60:lhsmtool_posix.0 Request processed in 114us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071520.942091:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 256 00000100:00100000:0.0:1783071520.946856:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071520.948850:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692936064 00000100:00100000:3.0:1783071520.948867:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692936064 00000100:00100000:3.0:1783071520.948955:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 65 00000100:00100000:3.0:1783071520.948969:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0391df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+19:12160:x1869685692936064:12345-192.168.204.38@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1783071520.949305:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0391df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+20:12160:x1869685692936064:12345-192.168.204.38@tcp:35:lhsmtool_posix.0 Request processed in 339us (2464us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1783071520.949313:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 65 00000040:00080000:2.0:1783071521.027708:0:13798:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1783071521.033553:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071521.092846:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783071521.092871:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03b80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707657856:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783071521.092962:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071521.093061:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707657856 00000100:00100000:2.0:1783071521.093068:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707657856 00000100:00100000:2.0:1783071521.093120:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1783071521.093130:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707657856:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783071521.093141:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783071521.093154:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707657984:0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783071521.093165:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783071521.093187:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071521.093222:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707657856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071521.093231:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1783071521.093240:0:12254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707657984 00000100:00100000:3.0:1783071521.093246:0:12254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707657984 00000100:00100000:3.0:1783071521.093281:0:12254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1783071521.093285:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03b80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707657856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783071521.093291:0:12254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707657984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783071521.093310:0:12254:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1783071521.093351:0:12254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707657984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071521.093358:0:12254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1783071521.093431:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707657984:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783071521.093992:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0391ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707658112:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783071521.094027:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071521.094250:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707658112 00000100:00100000:2.0:1783071521.094272:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707658112 00000100:00100000:2.0:1783071521.094321:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1783071521.094329:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707658112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783071521.094347:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1783071521.094606:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783071521.094619:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707658240:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783071521.094678:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071521.094712:0:12254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707658240 00000100:00100000:1.0:1783071521.094717:0:12254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707658240 00000100:00100000:1.0:1783071521.094741:0:12254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1783071521.094749:0:12254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c9b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707658240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783071521.094762:0:12254:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783071521.094794:0:12254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c9b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707658240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071521.094801:0:12254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1783071521.094845:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707658240:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783071521.095506:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707658112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1174us (1474us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071521.095514:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1783071521.096132:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0391ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707658112:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783071521.238710:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071521.247539:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692936192 00000100:00100000:2.0:1783071521.247557:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692936192 00000100:00080000:1.0:1783071521.247808:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783071521.247966:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 257 00000100:00100000:3.0:1783071521.247996:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:12965:x1869685692936192:12345-192.168.204.38@tcp:101:lsof.0 00010000:00010000:3.0:1783071521.248018:0:13815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071521.248042:0:13815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdd0a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d99146 expref: -99 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071521.248129:0:13815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdd0af lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071521.248166:0:13815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdd0af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071521.248183:0:13815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdd0af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783071521.248252:0:13815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783071521.248257:0:13815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783071521.248280:0:13815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdd0af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071521.248616:0:13815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdd0a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99146 expref: 7 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071521.248648:0:13815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdd0af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99146 expref: 6 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071521.248658:0:13815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8a021bd600) 00010000:00010000:3.0:1783071521.248662:0:13815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783071521.248665:0:13815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a01749000, rc 0) 00000100:00100000:3.0:1783071521.248751:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:39473256-b7f7-4f8b-91c6-e632aff5be8d+6:12965:x1869685692936192:12345-192.168.204.38@tcp:101:lsof.0 Request processed in 762us (10051us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071521.248760:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 257 00000040:00080000:2.0:1783071521.410595:0:13796:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783071521.410605:0:13796:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783071521.410697:0:13796:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:2.0:1783071521.410707:0:13796:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1783071522.050561:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071522.114879:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783071522.114904:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707658368:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783071522.114981:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071522.117460:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707658368 00000100:00100000:2.0:1783071522.117477:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707658368 00000100:00100000:2.0:1783071522.117549:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1783071522.117560:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0391dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707658368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783071522.117605:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783071522.117697:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0391dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707658368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 138us (2715us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071522.117706:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1783071522.117766:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707658368:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1783071523.074735:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071524.105061:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071524.116862:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071524.116913:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071524.118185:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071524.118223:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071524.119231:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692936320 00000100:00100000:2.0:1783071524.119249:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692936320 00000100:00100000:2.0:1783071524.119340:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 389 00000100:00100000:2.0:1783071524.119353:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07696050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:2403:x1869685692936320:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1783071524.119492:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07696050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:2403:x1869685692936320:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 142us (2646us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071524.119507:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 389 00000100:00100000:0.0:1783071524.120268:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071524.120329:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692936576 00000100:00100000:1.0:1783071524.120336:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692936576 00000100:00100000:1.0:1783071524.120528:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692937088 00000100:00100000:1.0:1783071524.120532:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692937088 00000100:00100000:1.0:1783071524.120559:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 327 00000100:00100000:1.0:1783071524.120566:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0391c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+5:2403:x1869685692936576:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1783071524.120637:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0391c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+5:2403:x1869685692936576:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 71us (3723us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071524.120644:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 327 00000100:00100000:1.0:1783071524.120662:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 328 00000100:00100000:1.0:1783071524.120669:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0391ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2403:x1869685692937088:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1783071524.120695:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0391ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2403:x1869685692937088:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 27us (2471us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071524.120701:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 328 00000100:00100000:1.0:1783071524.120726:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692936832 00000100:00100000:1.0:1783071524.120744:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692936832 00000100:00100000:1.0:1783071524.120779:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 159 00000100:00100000:1.0:1783071524.120786:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0391f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf7532e4-6153-424a-9f4e-84941256b41f+5:2403:x1869685692936832:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1783071524.120815:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0391f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf7532e4-6153-424a-9f4e-84941256b41f+5:2403:x1869685692936832:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 29us (2638us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071524.120822:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 159 00000100:00080000:3.0:1783071524.121281:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783071524.121288:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783071524.121541:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071524.121569:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071524.122170:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692936448 00000100:00100000:1.0:1783071524.122180:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692936448 00000100:00100000:1.0:1783071524.122243:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692936960 00000100:00100000:1.0:1783071524.122247:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692936960 00000100:00100000:1.0:1783071524.122271:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 329 00000100:00100000:1.0:1783071524.122279:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0391f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+20:2403:x1869685692936448:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1783071524.122388:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0391f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+20:2403:x1869685692936448:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 108us (2124us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071524.122395:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 329 00000100:00100000:1.0:1783071524.122489:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 330 00000100:00100000:1.0:1783071524.122496:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0391d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:39473256-b7f7-4f8b-91c6-e632aff5be8d+6:2403:x1869685692936960:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1783071524.122524:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0391d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:39473256-b7f7-4f8b-91c6-e632aff5be8d+6:2403:x1869685692936960:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 29us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071524.122531:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 330 00000100:00100000:1.0:1783071524.122553:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692936704 00000100:00100000:1.0:1783071524.122557:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692936704 00000100:00100000:1.0:1783071524.122588:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 160 00000100:00100000:1.0:1783071524.122596:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0391ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf7532e4-6153-424a-9f4e-84941256b41f+7:2403:x1869685692936704:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1783071524.122623:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0391ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf7532e4-6153-424a-9f4e-84941256b41f+7:2403:x1869685692936704:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 29us (1085us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071524.122640:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 160 00000100:00080000:0.0:1783071524.122903:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783071524.122908:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1783071524.371889:0:14901:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 05:38:43 (1783071523) 00010000:00010000:3.0:1783071525.126325:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1783071525.193064:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:1.0:1783071525.193079:0:6495:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:0.0:1783071525.193136:0:6549:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1783071525.193147:0:6549:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:0.0:1783071525.700563:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707658496:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783071525.700639:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071525.702129:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707658496 00000100:00100000:1.0:1783071525.702143:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707658496 00000100:00100000:1.0:1783071525.702208:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1783071525.702221:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0391d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707658496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783071525.702263:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1783071525.702349:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0391d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707658496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 130us (1710us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071525.702357:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1783071525.702491:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707658496:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783071525.705117:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:feaa1501-b927-4e07-baad-3200e92d7497:3648:1869685707658624:0@lo:400:kworker.0 00000100:00100000:2.0:1783071525.705193:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071525.705325:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1869685707659136:0@lo:400:kworker.0 00000100:00100000:2.0:1783071525.705354:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071525.705406:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1869685707659648:0@lo:400:kworker.0 00000100:00100000:2.0:1783071525.705430:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071525.705456:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1783071525.705508:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707658624 00000100:00100000:1.0:1783071525.705516:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707658624 00000100:00100000:2.0:1783071525.705520:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707659008:0@lo:400:kworker.0 00000100:00100000:2.0:1783071525.705547:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071525.705564:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1783071525.705566:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707659520:0@lo:400:kworker.0 00000100:00100000:1.0:1783071525.705572:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07695c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+24:3648:x1869685707658624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071525.705585:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071525.705602:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b078da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707660032:0@lo:400:kworker.0 00000100:00100000:2.0:1783071525.705622:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071525.705623:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07695c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+24:3648:x1869685707658624:12345-0@lo:400:kworker.0 Request processed in 52us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071525.705631:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1783071525.705649:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:feaa1501-b927-4e07-baad-3200e92d7497:3648:1869685707658624:0@lo:400:kworker.0 00000100:00100000:2.0:1783071525.705677:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707659136 00000100:00100000:2.0:1783071525.705680:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707659136 00000100:00100000:2.0:1783071525.705776:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707659648 00000100:00100000:2.0:1783071525.705779:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707659648 00000100:00080000:1.0:1783071525.705806:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783071525.705889:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1783071525.705895:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869685707659136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071525.705951:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869685707659136:12345-0@lo:400:kworker.0 Request processed in 56us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071525.705958:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1783071525.705983:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1783071525.705989:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869685707659648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071525.706019:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869685707659648:12345-0@lo:400:kworker.0 Request processed in 30us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071525.706025:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1783071525.706049:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707659008 00000100:00100000:2.0:1783071525.706053:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707659008 00000100:00100000:2.0:1783071525.706075:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1783071525.706082:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707659008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071525.706112:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707659008:12345-0@lo:400:kworker.0 Request processed in 30us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071525.706118:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1783071525.706135:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707659520 00000100:00100000:2.0:1783071525.706138:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707659520 00000100:00080000:1.0:1783071525.706299:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783071525.706410:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707660032 00000100:00100000:2.0:1783071525.706415:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707660032 00000100:00080000:1.0:1783071525.706474:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783071525.706489:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1783071525.706499:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707659520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071525.706538:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707659520:12345-0@lo:400:kworker.0 Request processed in 42us (951us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071525.706545:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1783071525.706674:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1783071525.706682:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707660032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071525.706719:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707660032:12345-0@lo:400:kworker.0 Request processed in 38us (1095us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071525.706725:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1783071525.706764:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707659008:0@lo:400:kworker.0 00000100:00100000:2.0:1783071525.706776:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707659520:0@lo:400:kworker.0 00000100:00100000:2.0:1783071525.706787:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b078da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707660032:0@lo:400:kworker.0 00000100:00100000:2.0:1783071525.706797:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1869685707659136:0@lo:400:kworker.0 00000100:00100000:2.0:1783071525.706820:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1869685707659648:0@lo:400:kworker.0 00000100:00100000:2.0:1783071525.706882:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869685707658752:0@lo:400:kworker.0 00000100:00100000:0.0:1783071525.706896:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869685707658880:0@lo:400:kworker.0 00000100:00100000:2.0:1783071525.707395:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071525.707423:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1869685707659264:0@lo:400:kworker.0 00000100:00100000:0.0:1783071525.707442:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071525.707477:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707659392:0@lo:400:kworker.0 00000100:00100000:2.0:1783071525.707482:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707658752 00000100:00100000:2.0:1783071525.707488:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707658752 00000100:00100000:0.0:1783071525.707508:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071525.707524:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707658880 00000100:00100000:2.0:1783071525.707528:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707658880 00000100:00100000:0.0:1783071525.707534:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707659904:0@lo:400:kworker.0 00000100:00100000:2.0:1783071525.707554:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1783071525.707564:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071525.707566:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1869685707658752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071525.707599:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707659392 00000100:00100000:0.0:1783071525.707604:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707659392 00000100:00100000:2.0:1783071525.707612:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1869685707658752:12345-0@lo:400:kworker.0 Request processed in 51us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071525.707620:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1783071525.707639:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1783071525.707643:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707659904 00000100:00100000:2.0:1783071525.707648:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0391fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869685707658880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071525.707648:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707659904 00000100:00100000:0.0:1783071525.707681:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1783071525.707691:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0391fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869685707658880:12345-0@lo:400:kworker.0 Request processed in 44us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071525.707692:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0391ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707659392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071525.707704:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1783071525.707739:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0391ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707659392:12345-0@lo:400:kworker.0 Request processed in 49us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071525.707746:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1783071525.707763:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1783071525.707837:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0391c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707659904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071525.707868:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0391c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707659904:12345-0@lo:400:kworker.0 Request processed in 98us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071525.707894:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1783071525.707918:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869685707658880:0@lo:400:kworker.0 00000100:00100000:0.0:1783071525.707930:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707659392:0@lo:400:kworker.0 00000100:00100000:0.0:1783071525.707939:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707659904:0@lo:400:kworker.0 00000100:00100000:2.0:1783071525.707999:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071525.708066:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1869685707659776:0@lo:400:kworker.0 00000100:00100000:2.0:1783071525.708100:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071525.708185:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869685707658752:0@lo:400:kworker.0 00000100:00100000:1.0:1783071525.708306:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707659264 00000100:00100000:1.0:1783071525.708311:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707659264 00000100:00100000:1.0:1783071525.708352:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707659776 00000100:00100000:1.0:1783071525.708356:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707659776 00000100:00100000:1.0:1783071525.708408:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1783071525.708417:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1869685707659264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071525.708466:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1869685707659264:12345-0@lo:400:kworker.0 Request processed in 50us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071525.708474:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00080000:0.0:1783071525.708486:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783071525.708492:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783071525.708494:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00080000:0.0:1783071525.708496:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783071525.708505:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1869685707659776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071525.708539:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1869685707659776:12345-0@lo:400:kworker.0 Request processed in 36us (438us total) trans 0 rc 0/0 00010000:00080000:0.0:1783071525.708543:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a032e7100 x1869685707659264/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071525.708549:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1783071525.708562:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1869685707659264:0@lo:400:kworker.0 00010000:00080000:0.0:1783071525.708588:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a032e5500 x1869685707659776/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071525.708596:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1869685707659776:0@lo:400:kworker.0 00010000:00010000:3.0:1783071526.147459:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071526.210516:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03b81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707660160:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783071526.210593:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071526.210664:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707660288:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783071526.210690:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071526.210731:0:12254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707660160 00000100:00100000:2.0:1783071526.210739:0:12254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707660160 00000100:00100000:2.0:1783071526.210782:0:12254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707660288 00000100:00100000:2.0:1783071526.210785:0:12254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707660288 00000100:00100000:2.0:1783071526.210802:0:12254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1783071526.210809:0:12254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707660160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783071526.210845:0:12254:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783071526.210905:0:12254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707660160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071526.210913:0:12254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1783071526.210931:0:12254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1783071526.210937:0:12254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707660288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783071526.210947:0:12254:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783071526.210975:0:12254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707660288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 38us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071526.210982:0:12254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1783071526.211042:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707660288:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783071526.211085:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03b81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707660160:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783071526.211127:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b078d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707660416:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783071526.211141:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b078d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707660544:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783071526.211165:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071526.213153:0:12254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707660416 00000100:00100000:2.0:1783071526.213166:0:12254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707660416 00000100:00100000:2.0:1783071526.213299:0:12254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1783071526.213309:0:12254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707660416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783071526.213341:0:12254:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1783071526.213420:0:12254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707660416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 113us (2255us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071526.213427:0:12254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1783071526.213471:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b078d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707660416:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783071526.219266:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071526.219355:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707660544 00000100:00100000:2.0:1783071526.219391:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707660544 00000100:00100000:2.0:1783071526.219445:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1783071526.219457:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b078daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707660544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783071526.219484:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1783071526.219540:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b078daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707660544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071526.219547:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1783071526.221347:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b078d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707660544:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783071527.170588:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071527.235786:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707660672:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783071527.235888:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071527.236173:0:9413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707660672 00000100:00100000:0.0:1783071527.236182:0:9413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707660672 00000100:00100000:0.0:1783071527.236241:0:9413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1783071527.236251:0:9413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707660672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783071527.236298:0:9413:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783071527.236385:0:9413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707660672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071527.236393:0:9413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1783071527.236486:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707660672:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783071528.166025:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071528.166280:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692937344 00000100:00100000:3.0:1783071528.166291:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692937344 00000100:00100000:3.0:1783071528.166418:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 66 00000100:00100000:3.0:1783071528.166433:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+19:13188:x1869685692937344:12345-192.168.204.38@tcp:35:umount.0 00000100:00080000:0.0:1783071528.166551:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783071528.166904:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+20:13188:x1869685692937344:12345-192.168.204.38@tcp:35:umount.0 Request processed in 474us (889us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1783071528.166913:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 66 00000100:00100000:1.0:1783071528.178327:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071528.178407:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692937600 00000100:00100000:2.0:1783071528.178419:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692937600 00000100:00100000:2.0:1783071528.178489:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 67 00000100:00100000:2.0:1783071528.178500:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+20:13188:x1869685692937600:12345-192.168.204.38@tcp:35:umount.0 00000100:00100000:2.0:1783071528.178848:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+21:13188:x1869685692937600:12345-192.168.204.38@tcp:35:umount.0 Request processed in 348us (530us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1783071528.178872:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 67 00000100:00100000:0.0:1783071528.184999:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071528.185413:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692937856 00000100:00100000:2.0:1783071528.185425:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692937856 00000100:00100000:2.0:1783071528.185490:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 68 00000100:00100000:2.0:1783071528.185501:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0699d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+21:13188:x1869685692937856:12345-192.168.204.38@tcp:35:umount.0 00000100:00100000:2.0:1783071528.185940:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0699d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf7532e4-6153-424a-9f4e-84941256b41f+22:13188:x1869685692937856:12345-192.168.204.38@tcp:35:umount.0 Request processed in 438us (959us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1783071528.185949:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 68 00000100:00100000:1.0:1783071528.193313:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071528.193454:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692938112 00000100:00100000:3.0:1783071528.193465:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692938112 00000100:00100000:3.0:1783071528.193528:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 69 00000100:00100000:3.0:1783071528.193540:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+22:13188:x1869685692938112:12345-192.168.204.38@tcp:35:umount.0 00000100:00100000:3.0:1783071528.193861:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf7532e4-6153-424a-9f4e-84941256b41f+23:13188:x1869685692938112:12345-192.168.204.38@tcp:35:umount.0 Request processed in 321us (634us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1783071528.193869:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 69 00010000:00010000:3.0:1783071528.197669:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071528.201742:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071528.201774:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071528.201798:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071528.201874:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692938368 00000100:00100000:2.0:1783071528.201883:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692938368 00000100:00100000:2.0:1783071528.201945:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692938240 00000100:00100000:2.0:1783071528.201947:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692938240 00000100:00100000:2.0:1783071528.201966:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18 00000100:00100000:2.0:1783071528.201974:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e4e7df8-beb0-40df-a2a1-9decaa005633+14:2405:x1869685692938368:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783071528.201989:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071528.202008:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b10966a00/0x6b58994c2cbdbfc9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98c5a expref: 14 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071528.202025:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071528.202324:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692938496 00000100:00100000:0.0:1783071528.202329:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692938496 00000100:00100000:0.0:1783071528.202392:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 80 00000100:00100000:0.0:1783071528.202401:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf7532e4-6153-424a-9f4e-84941256b41f+5:2402:x1869685692938496:12345-192.168.204.38@tcp:9:umount.0 00000020:00000080:0.0:1783071528.202425:0:8429:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6b58994c2cbdc3a4 00000100:00080000:0.0:1783071528.202433:0:8429:0:(import.c:65:import_set_state_nolock()) ffff8f8b03274800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783071528.202485:0:8429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1783071528.202685:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19 00000100:00100000:1.0:1783071528.202694:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e4e7df8-beb0-40df-a2a1-9decaa005633+13:2405:x1869685692938240:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783071528.202703:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071528.202713:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b3c460e00/0x6b58994c2cbdc086 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98c99 expref: 13 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071528.202745:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071528.202785:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e4e7df8-beb0-40df-a2a1-9decaa005633+12:2405:x1869685692938240:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 93us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071528.202792:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19 00000100:00080000:1.0:1783071528.202929:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1783071528.202945:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071528.203277:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e4e7df8-beb0-40df-a2a1-9decaa005633+11:2405:x1869685692938368:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1301us (1542us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071528.203286:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18 00000100:00100000:2.0:1783071528.203561:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071528.204341:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf7532e4-6153-424a-9f4e-84941256b41f+2:2402:x1869685692938496:12345-192.168.204.38@tcp:9:umount.0 Request processed in 1938us (2537us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071528.204353:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 80 00000100:00100000:3.0:1783071528.204653:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692938624 00000100:00100000:3.0:1783071528.204660:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692938624 00000100:00100000:3.0:1783071528.204707:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 20 00000100:00100000:3.0:1783071528.204715:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e4e7df8-beb0-40df-a2a1-9decaa005633+11:2406:x1869685692938624:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783071528.204728:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071528.204747:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8a01748a00/0x6b58994c2cbdc2a1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d72 expref: 11 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071528.204780:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783071528.204804:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e4e7df8-beb0-40df-a2a1-9decaa005633+10:2406:x1869685692938624:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 90us (1243us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071528.204811:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 20 00000100:00100000:1.0:1783071528.212996:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071528.213266:0:8910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692939008 00000100:00100000:0.0:1783071528.213277:0:8910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692939008 00000100:00080000:2.0:1783071528.213752:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783071528.213876:0:8910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 81 00000100:00100000:0.0:1783071528.213908:0:8910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf7532e4-6153-424a-9f4e-84941256b41f+7:2402:x1869685692939008:12345-192.168.204.38@tcp:9:umount.0 00000020:00000080:0.0:1783071528.213944:0:8910:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6b58994c2cbdc613 00000020:00010000:0.0:1783071528.213953:0:8910:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8f8a03a55000: total 0 00000100:00080000:0.0:1783071528.213958:0:8910:0:(import.c:65:import_set_state_nolock()) ffff8f8a03a52800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783071528.214023:0:8910:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000020:00010000:1.0:1783071528.215289:0:6505:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8f8a03a55000: total 0 00010000:00010000:1.0:1783071528.215391:0:6505:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8f8a03a55000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1783071528.215462:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d161545a/0x6b58994c2cbdc9d2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f5c expref: 7 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071528.215499:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038eddc02/0x6b58994c2cbdd0a1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9913f expref: 6 pid: 8910 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071528.215514:0:6505:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8f8a03a55000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1783071528.215530:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071528.215532:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071528.215534:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071528.216084:0:8910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf7532e4-6153-424a-9f4e-84941256b41f+2:2402:x1869685692939008:12345-192.168.204.38@tcp:9:umount.0 Request processed in 2176us (3094us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071528.216097:0:8910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 81 00000100:00100000:2.0:1783071528.229849:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071528.229944:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692940032 00000100:00100000:0.0:1783071528.229954:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692940032 00000100:00100000:0.0:1783071528.230015:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 258 00000100:00100000:0.0:1783071528.230027:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+23:2402:x1869685692940032:12345-192.168.204.38@tcp:39:umount.0 00000020:00000080:0.0:1783071528.230061:0:10292:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6b58994c2cbdbfd7 00000020:00010000:0.0:1783071528.230089:0:10292:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8f8a03240800: total 0 00000100:00080000:0.0:1783071528.230095:0:10292:0:(import.c:65:import_set_state_nolock()) ffff8f8a03244000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783071528.230123:0:10292:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:0.0:1783071528.230310:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf7532e4-6153-424a-9f4e-84941256b41f+22:2402:x1869685692940032:12345-192.168.204.38@tcp:39:umount.0 Request processed in 285us (472us total) trans 4294967527 rc 0/0 00000020:00010000:3.0:1783071528.230563:0:6504:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8f8a03240800: total 0 00010000:00010000:3.0:1783071528.230568:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071528.230617:0:6504:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8f8a03240800, canceled 0 locks, left on hash table 14. 00010000:00010000:3.0:1783071528.230661:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f8a020ca100) 00010000:00010000:3.0:1783071528.230665:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783071528.230673:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9e00/0x6b58994c2cbdd062 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9912a expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071528.230693:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f8a020ca100) 00010000:00010000:3.0:1783071528.230696:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1783071528.230700:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b421d9c00/0x6b58994c2cbdd08c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99138 expref: 21 pid: 10292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071528.230713:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f8a0179f400) 00010000:00010000:3.0:1783071528.230715:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1783071528.230720:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748800/0x6b58994c2cbdc37a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d9c expref: 20 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071528.230733:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f8a021bdc00) 00010000:00010000:3.0:1783071528.230735:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783071528.230739:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749400/0x6b58994c2cbdcd44 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99058 expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071528.230772:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8a021bd600) 00010000:00010000:3.0:1783071528.230774:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783071528.230778:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9e00/0x6b58994c2cbdca3b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f78 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071528.230791:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f8b0d17fa00) 00010000:00010000:3.0:1783071528.230794:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071528.230797:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67800/0x6b58994c2cbdc31f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d87 expref: 17 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071528.230814:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f8a020ca200) 00010000:00010000:3.0:1783071528.230816:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1783071528.230820:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67e00/0x6b58994c2cbdc985 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f47 expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071528.230831:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f8a020ca200) 00010000:00010000:3.0:1783071528.230833:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1783071528.230836:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66800/0x6b58994c2cbdc9bd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f55 expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071528.230848:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f8a0179f400) 00010000:00010000:3.0:1783071528.230851:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783071528.230854:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748600/0x6b58994c2cbdc675 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98e75 expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071528.230868:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f8a020ca100) 00010000:00010000:3.0:1783071528.230870:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783071528.230879:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864e00/0x6b58994c2cbdcf82 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d990f2 expref: 13 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071528.230897:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f8a020ca200) 00010000:00010000:3.0:1783071528.230899:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783071528.230903:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01748200/0x6b58994c2cbdc8b3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f0f expref: 12 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071528.230914:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f8a020ca200) 00010000:00010000:3.0:1783071528.230916:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783071528.230920:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03864400/0x6b58994c2cbdc9a8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f4e expref: 11 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071528.230934:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8f8a0179f000) 00010000:00010000:3.0:1783071528.230936:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783071528.230940:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b014b9a00/0x6b58994c2cbdc303 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d80 expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071528.230953:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f8a021bdc00) 00010000:00010000:3.0:1783071528.230955:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1783071528.230959:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03865000/0x6b58994c2cbdca57 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98f7f expref: 9 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071528.230971:0:6504:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8f8a03240800, canceled 14 locks, left on hash table 0. 00010000:00010000:3.0:1783071528.230983:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071528.230986:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071528.230987:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071528.231112:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 258 00000100:00100000:1.0:1783071528.244712:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071528.244830:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692940160 00000100:00100000:2.0:1783071528.244854:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692940160 00000100:00100000:2.0:1783071528.244930:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 259 00000100:00100000:2.0:1783071528.244941:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+5:2402:x1869685692940160:12345-192.168.204.38@tcp:39:umount.0 00000020:00000080:2.0:1783071528.244980:0:6517:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6b58994c2cbdbfde 00000100:00080000:2.0:1783071528.244999:0:6517:0:(import.c:65:import_set_state_nolock()) ffff8f8a02c74800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783071528.245037:0:6517:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1783071528.245267:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf7532e4-6153-424a-9f4e-84941256b41f+3:2402:x1869685692940160:12345-192.168.204.38@tcp:39:umount.0 Request processed in 327us (564us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1783071528.245276:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 259 00000100:00080000:1.0:1783071528.245512:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1783071528.245568:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071529.218597:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071529.237644:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071529.237702:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071529.237736:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071529.237762:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692940288 00000100:00100000:3.0:1783071529.237785:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692940288 00000100:00100000:1.0:1783071529.237794:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692940416 00000100:00100000:1.0:1783071529.237798:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692940416 00000100:00100000:3.0:1783071529.237834:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 391 00000100:00100000:1.0:1783071529.237836:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692940544 00000100:00100000:1.0:1783071529.237838:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692940544 00000100:00100000:3.0:1783071529.237843:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07696450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e4e7df8-beb0-40df-a2a1-9decaa005633+10:2403:x1869685692940288:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1783071529.237856:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 337 00000100:00100000:1.0:1783071529.237863:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39473256-b7f7-4f8b-91c6-e632aff5be8d+6:2403:x1869685692940416:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1783071529.237885:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 338 00000100:00100000:0.0:1783071529.237903:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2403:x1869685692940544:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1783071529.237930:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07696450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e4e7df8-beb0-40df-a2a1-9decaa005633+10:2403:x1869685692940288:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 86us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071529.237939:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 391 00000100:00080000:3.0:1783071529.237999:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783071529.238003:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783071529.239857:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39473256-b7f7-4f8b-91c6-e632aff5be8d+6:2403:x1869685692940416:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 1984us (2213us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071529.239871:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 337 00000100:00100000:0.0:1783071529.241449:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2403:x1869685692940544:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 3543us (3700us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071529.241465:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 338 00000100:00100000:2.0:1783071529.958432:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071529.958475:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071529.958510:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692940672 00000100:00100000:3.0:1783071529.958522:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692940672 00000100:00100000:0.0:1783071529.958566:0:7923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692940800 00000100:00100000:0.0:1783071529.958584:0:7923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692940800 00000100:00100000:3.0:1783071529.958605:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 21 00000100:00100000:3.0:1783071529.958695:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e4e7df8-beb0-40df-a2a1-9decaa005633+11:2405:x1869685692940672:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783071529.958712:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071529.958732:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b01546600/0x6b58994c2cbdc0da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98cae expref: 11 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071529.958750:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783071529.958813:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e4e7df8-beb0-40df-a2a1-9decaa005633+10:2405:x1869685692940672:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 199us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071529.960358:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 22 00000100:00100000:2.0:1783071529.960409:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab88c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e4e7df8-beb0-40df-a2a1-9decaa005633+10:2405:x1869685692940800:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783071529.960429:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071529.960450:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b01546000/0x6b58994c2cbdc0e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98cdf expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071529.960466:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071529.960524:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab88c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e4e7df8-beb0-40df-a2a1-9decaa005633+9:2405:x1869685692940800:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 125us (2047us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071529.960531:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 22 00000100:00100000:3.0:1783071529.962929:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 21 00000100:00100000:0.0:1783071529.963228:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071529.963394:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692940928 00000100:00100000:1.0:1783071529.963405:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692940928 00000100:00100000:1.0:1783071529.963459:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 23 00000100:00100000:1.0:1783071529.963470:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0391f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e4e7df8-beb0-40df-a2a1-9decaa005633+8:2406:x1869685692940928:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783071529.963486:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071529.963508:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b2fd67000/0x6b58994c2cbdc29a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98d6b expref: 8 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071529.963526:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071529.963588:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0391f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e4e7df8-beb0-40df-a2a1-9decaa005633+7:2406:x1869685692940928:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 120us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071529.963595:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 23 00000100:00100000:1.0:1783071529.976560:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071529.976785:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692941184 00000100:00100000:3.0:1783071529.976798:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692941184 00000100:00100000:3.0:1783071529.976875:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 260 00000100:00100000:3.0:1783071529.976886:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39473256-b7f7-4f8b-91c6-e632aff5be8d+6:2402:x1869685692941184:12345-192.168.204.38@tcp:39:umount.0 00000020:00000080:3.0:1783071529.976931:0:6518:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6b58994c2cbdc0ef 00000020:00010000:3.0:1783071529.976944:0:6518:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8f8a02134000: total 0 00000100:00080000:3.0:1783071529.976950:0:6518:0:(import.c:65:import_set_state_nolock()) ffff8f8a02132000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783071529.977006:0:6518:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000020:00010000:0.0:1783071529.977088:0:6505:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8f8a02134000: total 0 00010000:00010000:0.0:1783071529.977162:0:6505:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8f8a02134000, canceled 0 locks, left on hash table 1. 00000100:00100000:3.0:1783071529.977265:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2402:x1869685692941184:12345-192.168.204.38@tcp:39:umount.0 Request processed in 380us (714us total) trans 4294967528 rc 0/0 00000100:00100000:3.0:1783071529.977275:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 260 00010000:00010000:0.0:1783071529.977327:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8a021bd600) 00010000:00010000:0.0:1783071529.977332:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783071529.977340:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749000/0x6b58994c2cbdd0af lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99146 expref: 5 pid: 13815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071529.977405:0:6505:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8f8a02134000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1783071529.977419:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071529.977421:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071529.977423:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071529.994047:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071529.994153:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692941312 00000100:00100000:3.0:1783071529.994165:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692941312 00000100:00100000:3.0:1783071529.994246:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 261 00000100:00100000:3.0:1783071529.994259:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:39473256-b7f7-4f8b-91c6-e632aff5be8d+5:2402:x1869685692941312:12345-192.168.204.38@tcp:39:umount.0 00000020:00000080:3.0:1783071529.994305:0:10292:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6b58994c2cbdc0f6 00000100:00080000:3.0:1783071529.994316:0:10292:0:(import.c:65:import_set_state_nolock()) ffff8f8a02133800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783071529.994357:0:10292:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1783071529.994556:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:39473256-b7f7-4f8b-91c6-e632aff5be8d+3:2402:x1869685692941312:12345-192.168.204.38@tcp:39:umount.0 Request processed in 299us (518us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1783071529.994567:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 261 00010000:00010000:0.0:1783071529.994669:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071530.041978:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071530.042622:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692941568 00000100:00100000:2.0:1783071530.042632:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692941568 00000100:00100000:2.0:1783071530.042709:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 392 00000100:00100000:2.0:1783071530.042720:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07697050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e4e7df8-beb0-40df-a2a1-9decaa005633+7:2402:x1869685692941568:12345-192.168.204.38@tcp:251:umount.0 00000020:00000080:2.0:1783071530.042773:0:6511:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6b58994c2cbdbfb4 00000020:00010000:2.0:1783071530.042781:0:6511:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8f8a02c71000: total 0 00000100:00080000:2.0:1783071530.042787:0:6511:0:(import.c:65:import_set_state_nolock()) ffff8f8a02c71800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1783071530.042881:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07697050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e4e7df8-beb0-40df-a2a1-9decaa005633+3:2402:x1869685692941568:12345-192.168.204.38@tcp:251:umount.0 Request processed in 162us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071530.042890:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 392 00000020:00010000:0.0:1783071530.043185:0:6505:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8f8a02c71000: total 0 00010000:00010000:0.0:1783071530.043190:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071530.043255:0:6505:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8f8a02c71000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1783071530.043291:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b10966e00/0x6b58994c2cbdc08d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d98ca0 expref: 2 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071530.043306:0:6505:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8f8a02c71000, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1783071530.043316:0:6505:0:(genops.c:906:class_export_put()) final put ffff8f8a02c71000/5e4e7df8-beb0-40df-a2a1-9decaa005633 00010000:00010000:0.0:1783071530.043335:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071530.043337:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071530.043339:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783071530.043480:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8a02c71000/5e4e7df8-beb0-40df-a2a1-9decaa005633 for MGS 00000020:00000080:2.0:1783071530.043531:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f8a02c71800 for MGS 00010000:00010000:0.0:1783071530.242472:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071530.819335:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707660800:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783071530.819438:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071530.819636:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869685707661056:0@lo:400:kworker.0 00000100:00100000:2.0:1783071530.819669:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071530.819694:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0397e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1869685707661568:0@lo:400:kworker.0 00000100:00100000:2.0:1783071530.819720:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071530.819739:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03bd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1869685707662080:0@lo:400:kworker.0 00000100:00100000:2.0:1783071530.819764:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071530.819788:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1783071530.819794:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03b81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869685707661184:0@lo:400:kworker.0 00000100:00100000:2.0:1783071530.819819:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071530.819857:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0397ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707661696:0@lo:400:kworker.0 00000100:00100000:2.0:1783071530.819882:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071530.819896:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03bd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707662208:0@lo:400:kworker.0 00000100:00100000:2.0:1783071530.819916:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071530.819954:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707661056 00000100:00100000:2.0:1783071530.819961:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707661056 00000100:00100000:2.0:1783071530.820003:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707661568 00000100:00100000:2.0:1783071530.820007:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707661568 00000100:00100000:2.0:1783071530.820031:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707662080 00000100:00100000:2.0:1783071530.820034:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707662080 00000100:00100000:2.0:1783071530.820046:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707661184 00000100:00100000:2.0:1783071530.820048:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707661184 00000100:00100000:2.0:1783071530.820064:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1783071530.820072:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03bd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869685707661056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071530.820126:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03bd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869685707661056:12345-0@lo:400:kworker.0 Request processed in 54us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071530.820133:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1783071530.820151:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1783071530.820157:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03bd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869685707661568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071530.820185:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03bd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869685707661568:12345-0@lo:400:kworker.0 Request processed in 29us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071530.820200:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1783071530.820212:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1783071530.820219:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03bd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869685707662080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071530.820250:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03bd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869685707662080:12345-0@lo:400:kworker.0 Request processed in 32us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071530.820257:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1783071530.820268:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1783071530.820280:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869685707661184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071530.820307:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869685707661184:12345-0@lo:400:kworker.0 Request processed in 33us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071530.820322:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00080000:2.0:1783071530.820347:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783071530.820384:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0397e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707661312:0@lo:400:kworker.0 00000100:00100000:2.0:1783071530.820415:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071530.820431:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0397ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707661824:0@lo:400:kworker.0 00000100:00100000:2.0:1783071530.820453:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071530.820470:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03bd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707662336:0@lo:400:kworker.0 00000100:00100000:2.0:1783071530.820489:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071530.820506:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1783071530.820511:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:feaa1501-b927-4e07-baad-3200e92d7497:3645:1869685707660928:0@lo:400:kworker.0 00000100:00100000:2.0:1783071530.820536:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071530.820562:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0397d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1869685707661440:0@lo:400:kworker.0 00000100:00100000:2.0:1783071530.820584:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071530.820598:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03bd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1869685707661952:0@lo:400:kworker.0 00000100:00100000:2.0:1783071530.820620:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071530.820644:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707661696 00000100:00100000:2.0:1783071530.820648:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707661696 00000100:00100000:2.0:1783071530.820674:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707662208 00000100:00100000:2.0:1783071530.820677:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707662208 00000100:00100000:2.0:1783071530.820689:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707661824 00000100:00100000:2.0:1783071530.820691:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707661824 00000100:00100000:2.0:1783071530.820702:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707662336 00000100:00100000:2.0:1783071530.820704:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707662336 00000100:00100000:2.0:1783071530.820719:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1783071530.820726:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03bd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707661696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071530.820761:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03bd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707661696:12345-0@lo:400:kworker.0 Request processed in 37us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071530.820775:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1783071530.820789:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1783071530.820795:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03bd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707662208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071530.820824:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03bd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707662208:12345-0@lo:400:kworker.0 Request processed in 29us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071530.820830:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1783071530.820840:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1783071530.820847:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707661824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071530.820874:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707661824:12345-0@lo:400:kworker.0 Request processed in 28us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071530.820879:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1783071530.820889:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1783071530.820894:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03bd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707662336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071530.820917:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03bd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707662336:12345-0@lo:400:kworker.0 Request processed in 23us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071530.820923:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1783071530.820938:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707660928 00000100:00100000:2.0:1783071530.820941:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707660928 00000100:00100000:2.0:1783071530.820965:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:2.0:1783071530.820972:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07694450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+24:3645:x1869685707660928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071530.820997:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07694450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:feaa1501-b927-4e07-baad-3200e92d7497+24:3645:x1869685707660928:12345-0@lo:400:kworker.0 Request processed in 27us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071530.821003:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:2.0:1783071530.821029:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707661440 00000100:00100000:2.0:1783071530.821032:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707661440 00000100:00100000:2.0:1783071530.821060:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707661952 00000100:00100000:2.0:1783071530.821063:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707661952 00000100:00100000:2.0:1783071530.821075:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1783071530.821080:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1869685707661440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071530.821109:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1869685707661440:12345-0@lo:400:kworker.0 Request processed in 29us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071530.821115:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1783071530.821125:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1783071530.821132:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03bd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1869685707661952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071530.821160:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03bd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1869685707661952:12345-0@lo:400:kworker.0 Request processed in 29us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071530.821165:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00080000:2.0:1783071530.821181:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783071530.821184:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783071530.821186:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783071530.821227:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03b81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869685707661184:0@lo:400:kworker.0 00000100:00100000:2.0:1783071530.821240:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0397ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707661696:0@lo:400:kworker.0 00000100:00100000:2.0:1783071530.821250:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03bd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707662208:0@lo:400:kworker.0 00000100:00100000:2.0:1783071530.821261:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869685707661056:0@lo:400:kworker.0 00010000:00080000:2.0:1783071530.821272:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a0397e680 x1869685707661568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071530.821282:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0397e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1869685707661568:0@lo:400:kworker.0 00010000:00080000:2.0:1783071530.821292:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a03bd1f80 x1869685707662080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071530.821312:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03bd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1869685707662080:0@lo:400:kworker.0 00000100:00100000:2.0:1783071530.821355:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:feaa1501-b927-4e07-baad-3200e92d7497:3645:1869685707660928:0@lo:400:kworker.0 00000100:00100000:2.0:1783071530.821386:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0397d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1869685707661440:0@lo:400:kworker.0 00000100:00100000:2.0:1783071530.821397:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03bd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1869685707661952:0@lo:400:kworker.0 00000100:00100000:2.0:1783071530.821406:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0397ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707661824:0@lo:400:kworker.0 00000100:00100000:2.0:1783071530.821415:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03bd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707662336:0@lo:400:kworker.0 00000100:00100000:0.0:1783071530.825166:0:9413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707660800 00000100:00100000:0.0:1783071530.825182:0:9413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707660800 00000100:00100000:0.0:1783071530.825252:0:9413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707661312 00000100:00100000:0.0:1783071530.825255:0:9413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707661312 00000100:00100000:0.0:1783071530.825275:0:9413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1783071530.825297:0:9413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707660800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783071530.825350:0:9413:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1783071530.825474:0:9413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707660800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 178us (6035us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071530.825481:0:9413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1783071530.825500:0:9413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1783071530.825507:0:9413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03bd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707661312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071530.825542:0:9413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03bd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707661312:12345-0@lo:400:kworker.0 Request processed in 35us (5126us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071530.825548:0:9413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1783071530.825600:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0397e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707661312:0@lo:400:kworker.0 00000100:00100000:0.0:1783071530.825618:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707660800:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1783071531.267684:0:13798:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1783071531.277034:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071531.330853:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03bd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707662592:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783071531.330931:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071531.331021:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707662592 00000100:00100000:2.0:1783071531.331030:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707662592 00000100:00100000:2.0:1783071531.331082:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1783071531.331092:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03bd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707662592:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783071531.331129:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783071531.331201:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03bd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707662592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071531.331209:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1783071531.331273:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03bd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707662592:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783071531.334749:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707662720:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783071531.334818:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071531.334867:0:12254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707662720 00000100:00100000:1.0:1783071531.334873:0:12254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707662720 00000100:00100000:1.0:1783071531.334919:0:12254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1783071531.334928:0:12254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707662720:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783071531.334959:0:12254:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1783071531.335004:0:12254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707662720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071531.335021:0:12254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1783071531.335074:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707662720:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783071531.336098:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03bd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707662464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783071531.336147:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071531.336206:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783071531.336213:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0391df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707662848:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783071531.336237:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071531.336441:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707662464 00000100:00100000:2.0:1783071531.336448:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707662464 00000100:00100000:2.0:1783071531.336486:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707662848 00000100:00100000:2.0:1783071531.336490:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707662848 00000100:00100000:2.0:1783071531.336508:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1783071531.336515:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707662464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783071531.336541:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783071531.336600:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707662464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071531.336607:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1783071531.336622:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1783071531.336628:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707662848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783071531.336639:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1783071531.336664:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707662848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 37us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071531.336669:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1783071531.336925:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0391df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707662848:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783071531.336941:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03bd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707662464:0@lo:13:osp-pre-1-0.0 00000020:01000004:2.0:1783071531.594501:0:15097:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1783071531.608836:0:15097:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1783071531.608892:0:15097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461a00/0x6b58994c2cbdc05c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc063 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071531.608907:0:15097:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461a00/0x6b58994c2cbdc05c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdc063 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071531.608915:0:15097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461a00/0x6b58994c2cbdc05c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x6b58994c2cbdc063 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071531.608922:0:15097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461a00/0x6b58994c2cbdc05c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x6b58994c2cbdc063 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071531.609305:0:15097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1783071531.609312:0:15097:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1783071531.609338:0:15097:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783071531.609342:0:15097:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1783071531.609357:0:15097:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1783071531.609398:0:15097:0:(import.c:65:import_set_state_nolock()) ffff8f8b3b5fc000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1783071531.609441:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03bd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1869685707662976:0@lo:39:umount.0 00000100:00100000:2.0:1783071531.609504:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071531.609574:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707662976 00000100:00100000:2.0:1783071531.609582:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707662976 00000100:00100000:2.0:1783071531.609625:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1783071531.609633:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03bd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1869685707662976:12345-0@lo:39:umount.0 00000020:00000080:2.0:1783071531.609662:0:6517:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6b58994c2cbdbbcb 00000100:00080000:2.0:1783071531.609670:0:6517:0:(import.c:65:import_set_state_nolock()) ffff8f8b3b4b7000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1783071531.610583:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783071531.610594:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461a00/0x6b58994c2cbdc05c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x6b58994c2cbdc063 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071531.610605:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b3c461a00 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:1.0:1783071531.610609:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461a00/0x6b58994c2cbdc05c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x6b58994c2cbdc063 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071531.610619:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461a00/0x6b58994c2cbdc05c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x6b58994c2cbdc063 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783071531.610627:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461a00/0x6b58994c2cbdc05c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x6b58994c2cbdc063 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783071531.610633:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783071531.610636:0:6504:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1783071531.610639:0:6504:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1783071531.610772:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071531.610893:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03bd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3644:x1869685707662976:12345-0@lo:39:umount.0 Request processed in 1258us (1388us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071531.610903:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:3.0:1783071531.610914:0:6517:0:(genops.c:906:class_export_put()) final put ffff8f8b3b4b1000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1783071531.610952:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8b3b4b1000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1783071531.611003:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f8b3b4b7000 for lustre-MDT0000 00010000:00010000:3.0:1783071531.611027:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461a00/0x6b58994c2cbdc05c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x6b58994c2cbdc063 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071531.611034:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783071531.611059:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461a00/0x6b58994c2cbdc05c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x6b58994c2cbdc063 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071531.611063:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b078d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:feaa1501-b927-4e07-baad-3200e92d7497:3646:1869685707663104:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783071531.611079:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461a00/0x6b58994c2cbdc05c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x6b58994c2cbdc063 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071531.611090:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071531.611091:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071531.611093:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071531.611243:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071531.611349:0:7923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707663104 00000100:00100000:3.0:1783071531.611356:0:7923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707663104 00000100:00100000:3.0:1783071531.611531:0:7923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783071531.611540:0:7923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01766300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:feaa1501-b927-4e07-baad-3200e92d7497+24:3646:x1869685707663104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783071531.611553:0:7923:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071531.611567:0:7923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8a01749800/0x6b58994c2cbdc063 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6b58994c2cbdc05c expref: 24 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071531.611578:0:7923:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783071531.611604:0:7923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01766300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:feaa1501-b927-4e07-baad-3200e92d7497+23:3646:x1869685707663104:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071531.611610:0:7923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783071531.611676:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b078d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:feaa1501-b927-4e07-baad-3200e92d7497:3646:1869685707663104:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1783071531.611815:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8f8b3b5fc000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1783071531.611834:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03bd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1869685707662976:0@lo:39:umount.0 00000100:00080000:0.0:1783071531.612038:0:15097:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783071531.612045:0:15097:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1783071531.612059:0:15097:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1783071531.616607:0:15097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8a00/0x6b58994c2cbdc06a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc071 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071531.616629:0:15097:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8a00/0x6b58994c2cbdc06a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdc071 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071531.616637:0:15097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8a00/0x6b58994c2cbdc06a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x6b58994c2cbdc071 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071531.616663:0:15097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8a00/0x6b58994c2cbdc06a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x6b58994c2cbdc071 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071531.616691:0:15097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783071531.616700:0:15097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460c00/0x6b58994c2cbdbf6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbf75 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071531.616707:0:15097:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460c00/0x6b58994c2cbdbf6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdbf75 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071531.616713:0:15097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460c00/0x6b58994c2cbdbf6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6b58994c2cbdbf75 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071531.616720:0:15097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460c00/0x6b58994c2cbdbf6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6b58994c2cbdbf75 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071531.616741:0:15097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783071531.616748:0:15097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67a00/0x6b58994c2cbdc2d2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc2d9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071531.616754:0:15097:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67a00/0x6b58994c2cbdc2d2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdc2d9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071531.616761:0:15097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67a00/0x6b58994c2cbdc2d2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x6b58994c2cbdc2d9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071531.616767:0:15097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67a00/0x6b58994c2cbdc2d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x6b58994c2cbdc2d9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071531.616784:0:15097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1783071531.616791:0:15097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b01547800/0x6b58994c2cbdbb2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbb31 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071531.616797:0:15097:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b01547800/0x6b58994c2cbdbb2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdbb31 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071531.616803:0:15097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b01547800/0x6b58994c2cbdbb2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6b58994c2cbdbb31 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071531.616809:0:15097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.138@tcp lock: ffff8f8b01547800/0x6b58994c2cbdbb2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6b58994c2cbdbb31 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071531.616816:0:15097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:1.0:1783071531.616820:0:15097:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1783071531.616859:0:15097:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1783071531.616864:0:15097:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1783071531.616868:0:15097:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783071531.616873:0:15097:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:1.0:1783071531.616880:0:15097:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8f8a0177a800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783071531.616886:0:15097:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8f8a0177c000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783071531.616890:0:15097:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8f8b069b3000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783071531.616895:0:15097:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8f8b34557000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:1.0:1783071531.616902:0:15097:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff8f8a02134000 39473256-b7f7-4f8b-91c6-e632aff5be8d 192.168.204.38@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783071531.616907:0:15097:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff8f8a03240800 bf7532e4-6153-424a-9f4e-84941256b41f 192.168.204.38@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967522 stale:0 00000020:00080000:1.0:1783071531.616912:0:15097:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff8f8b078e4d40) has exports, disconnecting them 00000020:00080000:1.0:1783071531.616923:0:15097:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8f8a0177a800), last request at 1783071530 00000020:00000080:1.0:1783071531.616931:0:15097:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6b58994c2cbdbedb 00000100:00080000:1.0:1783071531.616962:0:15097:0:(import.c:65:import_set_state_nolock()) ffff8f8a0177b000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1783071531.617020:0:15097:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f8a0177a800): rc 0 00000020:00000080:1.0:1783071531.617023:0:15097:0:(genops.c:906:class_export_put()) final put ffff8f8a0177a800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1783071531.617033:0:15097:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8f8a0177c000), last request at 1783071530 00000020:00000080:1.0:1783071531.617037:0:15097:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6b58994c2cbdbdb5 00000100:00080000:1.0:1783071531.617041:0:15097:0:(import.c:65:import_set_state_nolock()) ffff8f8a0177b800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1783071531.617048:0:15097:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f8a0177c000): rc 0 00000020:00000080:1.0:1783071531.617050:0:15097:0:(genops.c:906:class_export_put()) final put ffff8f8a0177c000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1783071531.617053:0:15097:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8f8b069b3000), last request at 1783071315 00000020:00000080:1.0:1783071531.617056:0:15097:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6b58994c2cbdbcb2 00000100:00080000:1.0:1783071531.617059:0:15097:0:(import.c:65:import_set_state_nolock()) ffff8f8b069b0800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1783071531.617064:0:15097:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f8b069b3000): rc 0 00000020:00000080:1.0:1783071531.617067:0:15097:0:(genops.c:906:class_export_put()) final put ffff8f8b069b3000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1783071531.617070:0:15097:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8f8b34557000), last request at 1783071315 00000020:00000080:1.0:1783071531.617074:0:15097:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6b58994c2cbdbc81 00000100:00080000:1.0:1783071531.617076:0:15097:0:(import.c:65:import_set_state_nolock()) ffff8f8b069b2800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783071531.617082:0:15097:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00080000:1.0:1783071531.617168:0:15097:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f8b34557000): rc 0 00000004:00000080:1.0:1783071531.617185:0:15097:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffff9cbcc8067ae0 00000100:00080000:1.0:1783071531.617204:0:15097:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1783071531.617209:0:15097:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00080000:1.0:1783071531.618041:0:15097:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1783071531.618081:0:15097:0:(import.c:65:import_set_state_nolock()) ffff8f8b3c5d3800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1783071531.618213:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1783071531.618222:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8a00/0x6b58994c2cbdc06a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x6b58994c2cbdc071 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071531.618232:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b014b8a00 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:3.0:1783071531.618237:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8a00/0x6b58994c2cbdc06a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x6b58994c2cbdc071 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071531.618249:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8a00/0x6b58994c2cbdc06a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x6b58994c2cbdc071 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783071531.618273:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8a00/0x6b58994c2cbdc06a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x6b58994c2cbdc071 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783071531.618280:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783071531.618283:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:3.0:1783071531.618286:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:3.0:1783071531.618336:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8a00/0x6b58994c2cbdc06a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x6b58994c2cbdc071 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071531.618343:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783071531.618389:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8a00/0x6b58994c2cbdc06a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x6b58994c2cbdc071 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071531.618397:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8b014b8a00/0x6b58994c2cbdc06a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x6b58994c2cbdc071 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071531.618413:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783071531.618418:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460c00/0x6b58994c2cbdbf6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6b58994c2cbdbf75 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071531.618423:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b3c460c00 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:3.0:1783071531.618427:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460c00/0x6b58994c2cbdbf6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6b58994c2cbdbf75 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071531.618434:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460c00/0x6b58994c2cbdbf6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x6b58994c2cbdbf75 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783071531.618441:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460c00/0x6b58994c2cbdbf6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x6b58994c2cbdbf75 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783071531.618456:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1783071531.618458:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1783071531.618461:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1783071531.618479:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460c00/0x6b58994c2cbdbf6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x6b58994c2cbdbf75 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071531.618485:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783071531.618491:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460c00/0x6b58994c2cbdbf6e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x6b58994c2cbdbf75 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071531.618497:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460c00/0x6b58994c2cbdbf6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x6b58994c2cbdbf75 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071531.618505:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783071531.618509:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67a00/0x6b58994c2cbdc2d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x6b58994c2cbdc2d9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071531.618513:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd67a00 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:3.0:1783071531.618516:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67a00/0x6b58994c2cbdc2d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x6b58994c2cbdc2d9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071531.618522:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67a00/0x6b58994c2cbdc2d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x6b58994c2cbdc2d9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783071531.618528:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67a00/0x6b58994c2cbdc2d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x6b58994c2cbdc2d9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783071531.618533:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1783071531.618535:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1783071531.618537:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1783071531.618558:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67a00/0x6b58994c2cbdc2d2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x6b58994c2cbdc2d9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071531.618565:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783071531.618583:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67a00/0x6b58994c2cbdc2d2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x6b58994c2cbdc2d9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071531.618589:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67a00/0x6b58994c2cbdc2d2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x6b58994c2cbdc2d9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071531.618597:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783071531.618601:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8b01547800/0x6b58994c2cbdbb2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6b58994c2cbdbb31 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071531.618606:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b01547800 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:3.0:1783071531.618609:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8b01547800/0x6b58994c2cbdbb2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6b58994c2cbdbb31 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071531.618616:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8b01547800/0x6b58994c2cbdbb2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x6b58994c2cbdbb31 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783071531.618621:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8b01547800/0x6b58994c2cbdbb2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x6b58994c2cbdbb31 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783071531.618626:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1783071531.618628:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1783071531.618630:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1783071531.618643:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8f8b01547800/0x6b58994c2cbdbb2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x6b58994c2cbdbb31 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071531.618649:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783071531.618654:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8b01547800/0x6b58994c2cbdbb2a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x6b58994c2cbdbb31 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071531.618667:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8b01547800/0x6b58994c2cbdbb2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x6b58994c2cbdbb31 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071531.618678:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071531.618679:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071531.618682:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783071531.618694:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8a0177a800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1783071531.618736:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8a0177c000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1783071531.618757:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8b069b3000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1783071531.618780:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f8a0177b000 for lustre-MDT0000 00000020:00000080:3.0:1783071531.618785:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f8a0177b800 for lustre-MDT0000 00000020:00000080:3.0:1783071531.618788:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f8b069b0800 for lustre-MDT0000 00000100:00100000:3.0:1783071531.618895:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b078dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:feaa1501-b927-4e07-baad-3200e92d7497:3648:1869685707663488:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783071531.618961:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071531.619015:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783071531.619022:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b078d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:feaa1501-b927-4e07-baad-3200e92d7497:3648:1869685707663360:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783071531.619041:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071531.619064:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b078d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:feaa1501-b927-4e07-baad-3200e92d7497:3646:1869685707663744:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783071531.619081:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071531.619102:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783071531.619107:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b078d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:feaa1501-b927-4e07-baad-3200e92d7497:3646:1869685707663616:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783071531.619125:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071531.619151:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707663488 00000100:00100000:3.0:1783071531.619158:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707663488 00000100:00100000:3.0:1783071531.619205:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707663360 00000100:00100000:3.0:1783071531.619208:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707663360 00000100:00100000:3.0:1783071531.619225:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707663744 00000100:00100000:3.0:1783071531.619227:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707663744 00000100:00100000:3.0:1783071531.619235:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707663616 00000100:00100000:3.0:1783071531.619237:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707663616 00000100:00100000:3.0:1783071531.619249:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783071531.619257:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b078db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:feaa1501-b927-4e07-baad-3200e92d7497+26:3648:x1869685707663488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783071531.619269:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071531.619282:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b3c460000/0x6b58994c2cbdbf75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6b58994c2cbdbf6e expref: 26 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071531.619294:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783071531.619325:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b078db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:feaa1501-b927-4e07-baad-3200e92d7497+25:3648:x1869685707663488:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071531.619331:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783071531.619345:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783071531.619350:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b078da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:feaa1501-b927-4e07-baad-3200e92d7497+24:3648:x1869685707663360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783071531.619356:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071531.619384:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b10966000/0x6b58994c2cbdc071 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6b58994c2cbdc06a expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071531.619393:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783071531.619409:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b078da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:feaa1501-b927-4e07-baad-3200e92d7497+23:3648:x1869685707663360:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071531.619415:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783071531.619425:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783071531.619430:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b078dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:feaa1501-b927-4e07-baad-3200e92d7497+22:3646:x1869685707663744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783071531.619436:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071531.619442:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b01546400/0x6b58994c2cbdbb31 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6b58994c2cbdbb2a expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071531.619455:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783071531.619476:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b078dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:feaa1501-b927-4e07-baad-3200e92d7497+21:3646:x1869685707663744:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071531.619481:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783071531.619491:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783071531.619496:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b078d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:feaa1501-b927-4e07-baad-3200e92d7497+20:3646:x1869685707663616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783071531.619501:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071531.619509:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b014b8800/0x6b58994c2cbdc2d9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6b58994c2cbdc2d2 expref: 20 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071531.619517:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783071531.619531:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b078d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:feaa1501-b927-4e07-baad-3200e92d7497+19:3646:x1869685707663616:12345-0@lo:103:ldlm_bl.0 Request processed in 36us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071531.619536:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783071531.619567:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b078d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:feaa1501-b927-4e07-baad-3200e92d7497:3646:1869685707663616:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783071531.619574:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b078d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:feaa1501-b927-4e07-baad-3200e92d7497:3646:1869685707663744:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783071531.619596:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b078d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:feaa1501-b927-4e07-baad-3200e92d7497:3648:1869685707663360:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783071531.619602:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b078dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:feaa1501-b927-4e07-baad-3200e92d7497:3648:1869685707663488:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783071531.619777:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071531.619789:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869685707663232:0@lo:39:umount.0 00000100:00100000:2.0:1783071531.619824:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071531.619907:0:9413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707663232 00000100:00100000:3.0:1783071531.619912:0:9413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707663232 00000100:00100000:3.0:1783071531.619985:0:9413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1783071531.619993:0:9413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03bd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1869685707663232:12345-0@lo:39:umount.0 00000020:00000080:3.0:1783071531.620023:0:9413:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6b58994c2cbdbd0d 00000100:00080000:3.0:1783071531.620031:0:9413:0:(import.c:65:import_set_state_nolock()) ffff8f8b34e4a800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783071531.620059:0:9413:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:3.0:1783071531.620209:0:9413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03bd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3644:x1869685707663232:12345-0@lo:39:umount.0 Request processed in 216us (382us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1783071531.620215:0:9413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00080000:1.0:1783071531.620904:0:15097:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1783071531.620910:0:15097:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:1.0:1783071531.620923:0:15097:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1783071531.621064:0:15097:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1783071531.621087:0:15097:0:(import.c:65:import_set_state_nolock()) ffff8f8a01779800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1783071531.621100:0:15097:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1783071531.621103:0:15097:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:1.0:1783071531.621114:0:15097:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1783071531.621185:0:15097:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1783071531.621195:0:15097:0:(import.c:65:import_set_state_nolock()) ffff8f8b37a52800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1783071531.621226:0:15097:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff8f8b078e4d40) has no exports 00000100:00100000:2.0:1783071531.622406:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869685707663872:0@lo:9:umount.0 00000100:00100000:2.0:1783071531.622478:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071531.622514:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869685707664000:0@lo:9:umount.0 00000100:00100000:2.0:1783071531.622536:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783071531.622581:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8f8b3c5d3800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1783071531.622588:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869685707663232:0@lo:39:umount.0 00000100:00100000:2.0:1783071531.622615:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707663872 00000100:00100000:2.0:1783071531.622621:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707663872 00000100:00100000:2.0:1783071531.622663:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707664000 00000100:00100000:2.0:1783071531.622667:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707664000 00000100:00100000:2.0:1783071531.622690:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1783071531.622708:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03bd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1869685707663872:12345-0@lo:9:umount.0 00000020:00000080:2.0:1783071531.622737:0:8431:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6b58994c2cbdbe5d 00000100:00080000:2.0:1783071531.622745:0:8431:0:(import.c:65:import_set_state_nolock()) ffff8f8b3e74d800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783071531.622785:0:8431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1783071531.622914:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03bd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3644:x1869685707663872:12345-0@lo:9:umount.0 Request processed in 207us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071531.622921:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1783071531.622951:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1783071531.622958:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03bd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1869685707664000:12345-0@lo:9:umount.0 00000020:00000080:2.0:1783071531.622970:0:8431:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6b58994c2cbdbf9f 00000100:00080000:2.0:1783071531.622975:0:8431:0:(import.c:65:import_set_state_nolock()) ffff8f8b37a52000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783071531.622991:0:8431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1783071531.623063:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03bd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3644:x1869685707664000:12345-0@lo:9:umount.0 Request processed in 106us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071531.623071:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00010000:2.0:1783071531.623097:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783071531.623115:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8f8a01779800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1783071531.623125:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1783071531.623127:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783071531.623130:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869685707663872:0@lo:9:umount.0 00000100:00080000:2.0:1783071531.623139:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8f8b37a52800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1783071531.623146:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1783071531.623147:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783071531.623149:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869685707664000:0@lo:9:umount.0 00010000:00010000:2.0:1783071531.623201:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1783071531.642868:0:15097:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff8f8b078e4d40) has no exports 00000020:00000080:1.0:1783071531.736217:0:15097:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6b58994c2cbdbb85 00000020:00000080:1.0:1783071531.736236:0:15097:0:(genops.c:906:class_export_put()) final put ffff8f8b076f9000/lustre-QMT0000_UUID 00000020:01000000:1.0:1783071531.736608:0:15097:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1783071531.737389:0:15097:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783071531.737402:0:15097:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783071531.737407:0:15097:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff8f8b078e0000) has no exports 00000020:00000080:2.0:1783071531.737828:0:15097:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6b58994c2cbdbb7e 00000020:00000080:2.0:1783071531.737836:0:15097:0:(genops.c:906:class_export_put()) final put ffff8f8b3b4b3000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783071531.744787:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8b076f9000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1783071531.745134:0:15097:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783071531.745147:0:15097:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1783071531.745153:0:15097:0:(genops.c:906:class_export_put()) final put ffff8f8b078e9800/lustre-QMT0000_UUID 00000020:00000080:2.0:1783071531.745156:0:15097:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8b078e9800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1783071531.745164:0:15097:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1783071531.745324:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8b3b4b3000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:2.0:1783071532.292680:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071533.314932:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071534.338925:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783071534.405029:0:6495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1783071534.405049:0:6495:0:(genops.c:906:class_export_put()) final put ffff8f8b34557000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1783071534.405081:0:6495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 39473256-b7f7-4f8b-91c6-e632aff5be8d 00000001:00080000:1.0:1783071534.405089:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:1.0:1783071534.405093:0:6495:0:(genops.c:906:class_export_put()) final put ffff8f8a02134000/39473256-b7f7-4f8b-91c6-e632aff5be8d 00000001:00100000:1.0:1783071534.405098:0:6495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bf7532e4-6153-424a-9f4e-84941256b41f 00000001:00080000:1.0:1783071534.405102:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:1.0:1783071534.405110:0:6495:0:(genops.c:906:class_export_put()) final put ffff8f8a03240800/bf7532e4-6153-424a-9f4e-84941256b41f 00000020:00000080:3.0:1783071534.405196:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8b34557000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1783071534.405252:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8a02134000/39473256-b7f7-4f8b-91c6-e632aff5be8d for lustre-MDT0000 00000020:00000080:3.0:1783071534.405282:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8a03240800/bf7532e4-6153-424a-9f4e-84941256b41f for lustre-MDT0000 00000020:00000080:3.0:1783071534.405322:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f8b069b2800 for lustre-MDT0000 00000020:00000080:3.0:1783071534.405327:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f8a02132000 for lustre-MDT0000 00000020:00000080:3.0:1783071534.405332:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f8a03244000 for lustre-MDT0000 00000001:00100000:1.0:1783071534.405686:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783071534.405690:0:9510:0:(genops.c:906:class_export_put()) final put ffff8f8b37a53000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1783071534.405711:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bf7532e4-6153-424a-9f4e-84941256b41f 00000020:00000080:1.0:1783071534.405714:0:9510:0:(genops.c:906:class_export_put()) final put ffff8f8b03273000/bf7532e4-6153-424a-9f4e-84941256b41f 00000020:00000080:0.0:1783071534.405759:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8b37a53000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1783071534.405794:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8b03273000/bf7532e4-6153-424a-9f4e-84941256b41f for lustre-OST0001 00000020:00000080:0.0:1783071534.405809:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f8b37a52000 for lustre-OST0001 00000020:00000080:0.0:1783071534.405813:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f8b03274800 for lustre-OST0001 00000001:00100000:2.0:1783071534.406088:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783071534.406093:0:8425:0:(genops.c:906:class_export_put()) final put ffff8f8b3e74f800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1783071534.406316:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bf7532e4-6153-424a-9f4e-84941256b41f 00000020:00000080:2.0:1783071534.406319:0:8425:0:(genops.c:906:class_export_put()) final put ffff8f8a03a55000/bf7532e4-6153-424a-9f4e-84941256b41f 00000001:00100000:3.0:1783071534.406391:0:7447:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1783071534.406401:0:7447:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:3.0:1783071534.406404:0:7447:0:(genops.c:906:class_export_put()) final put ffff8f8b07891800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783071534.406462:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8b3e74f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1783071534.406492:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f8b3e74d800 for lustre-OST0000 00000020:00000080:1.0:1783071534.406645:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8a03a55000/bf7532e4-6153-424a-9f4e-84941256b41f for lustre-OST0000 00000020:00000080:1.0:1783071534.406678:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f8a03a52800 for lustre-OST0000 00000001:00100000:3.0:1783071534.409801:0:7447:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 39473256-b7f7-4f8b-91c6-e632aff5be8d 00000001:00080000:3.0:1783071534.409817:0:7447:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:3.0:1783071534.409823:0:7447:0:(genops.c:906:class_export_put()) final put ffff8f8a02130800/39473256-b7f7-4f8b-91c6-e632aff5be8d 00000001:00100000:3.0:1783071534.409831:0:7447:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of bf7532e4-6153-424a-9f4e-84941256b41f 00000001:00080000:3.0:1783071534.409838:0:7447:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:3.0:1783071534.409840:0:7447:0:(genops.c:906:class_export_put()) final put ffff8f8a02c76000/bf7532e4-6153-424a-9f4e-84941256b41f 00000020:00000080:0.0:1783071534.410006:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8b07891800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1783071534.410078:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8a02130800/39473256-b7f7-4f8b-91c6-e632aff5be8d for lustre-MDT0001 00000020:00000080:0.0:1783071534.410193:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8a02c76000/bf7532e4-6153-424a-9f4e-84941256b41f for lustre-MDT0001 00000020:00000080:0.0:1783071534.410220:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f8b34e4a800 for lustre-MDT0001 00000020:00000080:0.0:1783071534.410225:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f8a02133800 for lustre-MDT0001 00000020:00000080:0.0:1783071534.410229:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f8a02c74800 for lustre-MDT0001 00010000:00010000:2.0:1783071535.363598:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071535.938816:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:feaa1501-b927-4e07-baad-3200e92d7497:3648:1869685707664256:0@lo:400:kworker.0 00000100:00100000:3.0:1783071535.938902:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071535.938973:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1869685707664768:0@lo:400:kworker.0 00000100:00100000:3.0:1783071535.939001:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071535.939022:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707665280:0@lo:400:kworker.0 00000100:00100000:3.0:1783071535.939068:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071535.939105:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1783071535.939112:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707664128:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783071535.939137:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071535.939153:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1869685707664640:0@lo:400:kworker.0 00000100:00100000:3.0:1783071535.939172:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071535.939189:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1869685707665152:0@lo:400:kworker.0 00000100:00100000:3.0:1783071535.939209:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071535.939235:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707664384:0@lo:400:kworker.0 00000100:00100000:3.0:1783071535.939257:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071535.939272:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707664896:0@lo:400:kworker.0 00000100:00100000:3.0:1783071535.939291:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071535.939309:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1783071535.939314:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869685707664512:0@lo:400:kworker.0 00000100:00100000:3.0:1783071535.939335:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071535.939350:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1869685707665024:0@lo:400:kworker.0 00000100:00100000:3.0:1783071535.939410:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071535.939457:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707665280 00000100:00100000:3.0:1783071535.939465:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707665280 00000100:00100000:3.0:1783071535.939515:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707664896 00000100:00100000:3.0:1783071535.939519:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707664896 00000100:00100000:3.0:1783071535.939540:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1783071535.939550:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b078d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707665280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071535.939602:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b078d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707665280:12345-0@lo:400:kworker.0 Request processed in 54us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071535.939609:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1783071535.939636:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1783071535.939644:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b078da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707664896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071535.939679:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b078da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707664896:12345-0@lo:400:kworker.0 Request processed in 37us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071535.939686:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1783071535.939704:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707664768 00000100:00100000:3.0:1783071535.939708:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707664768 00000100:00100000:3.0:1783071535.939725:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707664640 00000100:00100000:3.0:1783071535.939727:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707664640 00000100:00100000:3.0:1783071535.939734:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707665152 00000100:00100000:3.0:1783071535.939736:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707665152 00000100:00100000:3.0:1783071535.939747:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707664512 00000100:00100000:3.0:1783071535.939749:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707664512 00000100:00100000:3.0:1783071535.939755:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707665024 00000100:00100000:3.0:1783071535.939756:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707665024 00000100:00100000:3.0:1783071535.939765:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1783071535.939770:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b078dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869685707664768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071535.939798:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b078dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869685707664768:12345-0@lo:400:kworker.0 Request processed in 28us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071535.939804:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1783071535.939814:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1783071535.939820:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b078d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869685707665152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071535.939845:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b078d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869685707665152:12345-0@lo:400:kworker.0 Request processed in 25us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071535.939850:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1783071535.939861:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1783071535.939864:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b078d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3648:x1869685707664640:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1783071535.939870:0:13815:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1783071535.939903:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b078d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3648:x1869685707664640:12345-0@lo:400:kworker.0 Request processed in 36us (729us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783071535.939908:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1783071535.939919:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1783071535.939923:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0411e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1869685707664512:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1783071535.939928:0:13815:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1783071535.939947:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0411e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1869685707664512:12345-0@lo:400:kworker.0 Request processed in 23us (612us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783071535.939953:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1783071535.939963:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1783071535.939966:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0411c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1869685707665024:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1783071535.939971:0:13815:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1783071535.939989:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0411c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1869685707665024:12345-0@lo:400:kworker.0 Request processed in 21us (579us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783071535.939995:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:3.0:1783071535.940051:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1783071535.940056:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8f8b07890000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1783071535.940060:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1783071535.940412:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707664128 00000100:00100000:1.0:1783071535.940430:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707664128 00000100:00100000:1.0:1783071535.940457:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707664384 00000100:00100000:1.0:1783071535.940466:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707664384 00000100:00100000:1.0:1783071535.940478:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1783071535.940483:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b078d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1869685707664128:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:1.0:1783071535.940488:0:6523:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1783071535.940516:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b078d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1869685707664128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 33us (1378us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783071535.940521:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1783071535.940541:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1783071535.940545:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b078d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1869685707664384:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1783071535.940550:0:6523:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1783071535.940570:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b078d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1869685707664384:12345-0@lo:400:kworker.0 Request processed in 24us (1313us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783071535.940576:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:02020000:1.0:1783071535.940629:0:3648:0:(client.c:1491:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:2.0:1783071535.940727:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783071535.940733:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783071535.940735:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783071535.941340:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707664256 00000100:00100000:0.0:1783071535.941349:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707664256 00000100:00100000:0.0:1783071535.941437:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:0.0:1783071535.941447:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b07694050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+19:3648:x1869685707664256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071535.941498:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b07694050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:feaa1501-b927-4e07-baad-3200e92d7497+19:3648:x1869685707664256:12345-0@lo:400:kworker.0 Request processed in 54us (2597us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071535.941506:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00080000:3.0:1783071535.959154:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8f8b07890000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783071535.961392:0:3645:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 217 00000100:00080000:3.0:1783071535.961405:0:3645:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8f8b07890000 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:3.0:1783071535.961460:0:3645:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8a0411c380 x1869685707665408/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783071535.961491:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869685707664512:0@lo:400:kworker.0 00000100:00080000:3.0:1783071535.961524:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1783071535.961543:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8f8a023e4000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1783071535.961548:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1783071535.961552:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8f8a023e4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783071535.961556:0:3645:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 255 00000100:00080000:3.0:1783071535.961561:0:3645:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8f8a023e4000 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:3.0:1783071535.961573:0:3645:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8a0411ce00 x1869685707665536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783071535.961583:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1869685707665024:0@lo:400:kworker.0 00000100:00080000:3.0:1783071535.961598:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1783071535.961601:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8f8b34556000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1783071535.961604:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1783071535.961609:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8f8b34556000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783071535.961612:0:3645:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 217 00000100:00080000:3.0:1783071535.961616:0:3645:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8f8b34556000 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:3.0:1783071535.961627:0:3645:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8a0411d880 x1869685707665664/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783071535.961636:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707664384:0@lo:400:kworker.0 00000100:00100000:3.0:1783071535.961655:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707664896:0@lo:400:kworker.0 00000100:00100000:0.0:1783071535.963333:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0411c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1869685707665408:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1783071535.963450:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071535.963487:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0411ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1869685707665536:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1783071535.963510:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071535.963527:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0411d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1869685707665664:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1783071535.963549:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071535.963609:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707665408 00000100:00100000:0.0:1783071535.963616:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707665408 00000100:00100000:0.0:1783071535.963647:0:10292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707665536 00000100:00100000:0.0:1783071535.963650:0:10292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707665536 00000100:00100000:0.0:1783071535.963667:0:10292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1783071535.963675:0:10292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1869685707665408:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1783071535.963692:0:10292:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:1.0:1783071535.973474:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783071535.973483:0:3648:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff8f8b34556000 already not connected (conn 2, was 1): CONNECTING 00000100:00080000:1.0:1783071535.973534:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783071535.973541:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8f8a01e4c800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1783071535.973545:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1783071535.973552:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8f8a01e4c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783071535.973556:0:3648:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 234 00000100:00080000:1.0:1783071535.973568:0:3648:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8f8a01e4c800 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:1.0:1783071535.973620:0:3648:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8a03a9ed80 x1869685707665792/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783071535.973674:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1869685707664640:0@lo:400:kworker.0 00010000:00080000:1.0:1783071535.973715:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a03a9c700 x1869685707665152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071535.973726:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1869685707665152:0@lo:400:kworker.0 00000100:00100000:1.0:1783071535.973737:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:feaa1501-b927-4e07-baad-3200e92d7497:3648:1869685707664256:0@lo:400:kworker.0 00010000:00080000:1.0:1783071535.973748:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c6a8000 x1869685707664768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071535.973755:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1869685707664768:0@lo:400:kworker.0 00000100:00100000:1.0:1783071535.973768:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707665280:0@lo:400:kworker.0 00000100:00100000:1.0:1783071535.973853:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707665664 00000100:00100000:1.0:1783071535.973861:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707665664 00000100:00100000:1.0:1783071535.973897:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1783071535.973905:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1869685707665664:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:1.0:1783071535.973920:0:6523:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783071535.973996:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1869685707665664:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 90us (10444us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783071535.974003:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1783071535.974037:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1783071535.974044:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01765f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1869685707665536:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:1.0:1783071535.974052:0:13815:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783071535.974079:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01765f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1869685707665536:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 35us (10568us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783071535.974085:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1783071535.974917:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1869685707665792:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1783071535.974964:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783071535.975013:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8f8a023e4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783071535.975018:0:3644:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783071535.975033:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0411ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1869685707665536:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:3.0:1783071535.975046:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8f8b34556000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783071535.975050:0:3644:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783071535.975053:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0411d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1869685707665664:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1783071535.977299:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707665792 00000100:00100000:1.0:1783071535.977317:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707665792 00000100:00100000:1.0:1783071535.977543:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1783071535.977552:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0411df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1869685707665792:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:1.0:1783071535.977574:0:6516:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783071535.977674:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0411df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1869685707665792:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 121us (2709us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783071535.977682:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:2.0:1783071535.977810:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8f8a01e4c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783071535.977816:0:3644:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783071535.977820:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1869685707665792:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1783071535.985145:0:10292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1869685707665408:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 21458us (21684us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783071535.985161:0:10292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:3.0:1783071535.985308:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8f8b07890000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783071535.985317:0:3644:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783071535.985323:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0411c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1869685707665408:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:2.0:1783071536.386520:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071536.450902:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03bd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707665920:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783071536.450974:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071536.451109:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707665920 00000100:00100000:2.0:1783071536.451117:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707665920 00000100:00100000:2.0:1783071536.451186:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1783071536.451197:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0411c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707665920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783071536.451233:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783071536.451285:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0411c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707665920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071536.451310:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1783071536.451404:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03bd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707665920:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783071536.453308:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0411d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707666048:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783071536.453406:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071536.453621:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707666048 00000100:00100000:3.0:1783071536.453627:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707666048 00000100:00100000:3.0:1783071536.453675:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1783071536.453685:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707666048:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783071536.453712:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1783071536.453761:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707666048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071536.453769:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1783071536.453849:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0411d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707666048:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1783071537.410662:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1783071537.794669:0:15097:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8f8a0317a600 - data ffff8f8a019e5d80/ffff8f8a03283400 00000020:01000000:2.0:1783071537.794808:0:15097:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8f8b07eebae0 - data ffff8f8b2b851e58/ffff8f8b3b5e5800 00000001:00000004:2.0:1783071537.808762:0:15097:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:1.0:1783071537.885790:0:15097:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1783071537.885800:0:15097:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:1.0:1783071537.885815:0:15097:0:(client.c:3149:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8f8b3c6abb80 x1869685707663232/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783071541 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071537.885842:0:15097:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1783071537.887767:0:15097:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1783071537.887775:0:15097:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:3.0:1783071537.887799:0:15097:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783071537.887802:0:15097:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1783071537.888093:0:8908:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1783071537.888098:0:8908:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:2.0:1783071537.888108:0:8908:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1783071537.889115:0:15097:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1783071537.889120:0:15097:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:3.0:1783071537.889136:0:15097:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783071537.889138:0:15097:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1783071537.889730:0:10003:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1783071537.889735:0:10003:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:2.0:1783071537.889744:0:10003:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1783071537.895088:0:15097:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6b58994c2cbdbb4d 00000020:00000080:3.0:1783071537.895119:0:15097:0:(genops.c:906:class_export_put()) final put ffff8f8b08854800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783071537.900804:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8b08854800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1783071537.905340:0:15097:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6b58994c2cbdbb62 00000020:00000080:3.0:1783071537.905356:0:15097:0:(genops.c:906:class_export_put()) final put ffff8f8b078ea800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1783071537.905395:0:15097:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1783071537.905410:0:15097:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783071537.905419:0:15097:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1783071537.905424:0:15097:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff8f8b06c70000) has no exports 00000004:01000000:3.0:1783071537.906691:0:15097:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1783071537.906797:0:15097:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6b58994c2cbdbf98 00000020:00000080:3.0:1783071537.906807:0:15097:0:(genops.c:906:class_export_put()) final put ffff8f8a03008000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1783071537.906814:0:15097:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1783071537.906822:0:15097:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783071537.906833:0:15097:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1783071537.906837:0:15097:0:(genops.c:1579:class_disconnect_exports()) OBD device 28 (ffff8f8a03364d40) has no exports 00000020:00000080:3.0:1783071537.906843:0:15097:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6b58994c2cbdbf91 00000020:00000080:3.0:1783071537.906847:0:15097:0:(genops.c:906:class_export_put()) final put ffff8f8a01e38800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783071537.906914:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8b078ea800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1783071537.906932:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8a03008000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1783071537.906937:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8a01e38800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1783071537.908812:0:15097:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1783071537.908821:0:15097:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1783071537.908826:0:15097:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:3.0:1783071537.908834:0:15097:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783071537.908837:0:15097:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783071537.908887:0:15097:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783071537.908901:0:15097:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783071537.908909:0:15097:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6b58994c2cbdbe56 00000020:00000080:3.0:1783071537.908916:0:15097:0:(genops.c:906:class_export_put()) final put ffff8f8b37a50000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1783071537.908921:0:15097:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1783071537.908925:0:15097:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783071537.908929:0:15097:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1783071537.908932:0:15097:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff8f8b3c6c8000) has no exports 00000020:00000080:3.0:1783071537.908939:0:15097:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6b58994c2cbdbe4f 00000020:00000080:3.0:1783071537.908942:0:15097:0:(genops.c:906:class_export_put()) final put ffff8f8a0177f000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783071537.909225:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f8b37a52800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1783071537.909235:0:38:0:(genops.c:906:class_export_put()) final put ffff8f8a01e48800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783071537.909238:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8a01e48800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1783071537.909245:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783071537.909377:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8b37a50000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1783071537.909384:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8a0177f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1783071537.910093:0:15097:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1783071537.910106:0:15097:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1783071537.910110:0:15097:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:3.0:1783071537.910116:0:15097:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783071537.910118:0:15097:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783071537.910170:0:15097:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783071537.910179:0:15097:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1783071537.910196:0:15097:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1783071537.910204:0:15097:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6b58994c2cbdbd06 00000020:00000080:3.0:1783071537.910210:0:15097:0:(genops.c:906:class_export_put()) final put ffff8f8b3c5d1000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1783071537.910216:0:15097:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1783071537.910220:0:15097:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783071537.910225:0:15097:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1783071537.910228:0:15097:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff8f8b345719c0) has no exports 00000020:00000080:3.0:1783071537.910234:0:15097:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6b58994c2cbdbcff 00000020:00000080:3.0:1783071537.910236:0:15097:0:(genops.c:906:class_export_put()) final put ffff8f8b3c5d2000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783071537.911689:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f8a01779800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1783071537.911705:0:38:0:(genops.c:906:class_export_put()) final put ffff8f8a01e3e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783071537.911709:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8a01e3e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1783071537.911715:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783071537.911836:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8b3c5d1000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1783071537.911851:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8b3c5d2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1783071537.914775:0:15097:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1783071537.914785:0:15097:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1783071537.914790:0:15097:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1783071537.914799:0:15097:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783071537.914895:0:15097:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783071537.914909:0:15097:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783071537.914935:0:15097:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783071537.914938:0:15097:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783071537.914943:0:15097:0:(genops.c:906:class_export_put()) final put ffff8f8b08857800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783071537.914948:0:15097:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8b08857800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1783071537.914959:0:15097:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783071537.915051:0:15097:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6b58994c2cbdbb69 00000020:00000080:2.0:1783071537.915071:0:15097:0:(genops.c:906:class_export_put()) final put ffff8f8b078ef000/lustre-MDD0000_UUID 00000020:01000000:2.0:1783071537.915076:0:15097:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1783071537.915080:0:15097:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783071537.915085:0:15097:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783071537.915089:0:15097:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff8f8b078e19c0) has no exports 00000020:00000080:2.0:1783071537.915127:0:15097:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783071537.915131:0:15097:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1783071537.915136:0:15097:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6b58994c2cbdbb70 00000020:00000080:2.0:1783071537.915140:0:15097:0:(genops.c:906:class_export_put()) final put ffff8f8b078ee800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1783071537.915149:0:15097:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f8b10f7e000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1783071537.915152:0:15097:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8f8b10f7e000 3 00000020:01000004:2.0:1783071537.915156:0:15097:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8f8b10f7e000 from lustre-MDT0000 00000020:00000080:2.0:1783071537.915179:0:15097:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783071537.915182:0:15097:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1783071537.915184:0:15097:0:(genops.c:906:class_export_put()) final put ffff8f8b08850000/lustre-MDT0000_UUID 00000020:00000080:2.0:1783071537.915186:0:15097:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8b08850000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1783071537.915194:0:15097:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1783071537.915230:0:15097:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1783071537.915234:0:15097:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1783071537.915237:0:15097:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1783071537.915239:0:15097:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783071537.915242:0:15097:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1783071537.915248:0:15097:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff8f8b05a5f800 feaa1501-b927-4e07-baad-3200e92d7497 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783071537.915253:0:15097:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff8f8b06ca99c0) has exports, disconnecting them 00000020:00080000:2.0:1783071537.915258:0:15097:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8f8b05a5f800), last request at 1783071299 00000020:00000080:2.0:1783071537.915272:0:15097:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6b58994c2cbdbb0e 00000020:00010000:2.0:1783071537.915276:0:15097:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8f8b05a5f800: total 2 00000100:00080000:2.0:1783071537.915281:0:15097:0:(import.c:65:import_set_state_nolock()) ffff8f8b05a58800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1783071537.915297:0:15097:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f8b05a5f800): rc 0 00000020:00080000:2.0:1783071537.915302:0:15097:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff8f8b06ca99c0) has no exports 00000020:00010000:2.0:1783071537.915313:0:6504:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8f8b05a5f800: total 2 00010000:00010000:2.0:1783071537.915345:0:6504:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8f8b05a5f800, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1783071537.915392:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b10967e00/0x6b58994c2cbdc039 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6b58994c2cbdc032 expref: 14 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071537.915409:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b3c460800/0x6b58994c2cbdc02b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6b58994c2cbdc024 expref: 13 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071537.915429:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8a01748400/0x6b58994c2cbdc047 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6b58994c2cbdc040 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071537.915439:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b10967600/0x6b58994c2cbdc055 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6b58994c2cbdc04e expref: 11 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071537.915449:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b01546e00/0x6b58994c2cbdbc0a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6b58994c2cbdbc03 expref: 10 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071537.915463:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b01547a00/0x6b58994c2cbdbc18 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6b58994c2cbdbc11 expref: 9 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071537.915475:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8a03864c00/0x6b58994c2cbdc2af lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6b58994c2cbdc2a8 expref: 8 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071537.915485:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8a03864200/0x6b58994c2cbdc2bd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6b58994c2cbdc2b6 expref: 7 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071537.915496:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b3c461200/0x6b58994c2cbdc01d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6b58994c2cbdc016 expref: 6 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071537.915506:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8a03865800/0x6b58994c2cbdc2cb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6b58994c2cbdc2c4 expref: 5 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071537.915518:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8a01748c00/0x6b58994c2cbdbf2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6b58994c2cbdbf28 expref: 4 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071537.915530:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b3c461600/0x6b58994c2cbdc07f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6b58994c2cbdc078 expref: 3 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071537.915552:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b10966400/0x6b58994c2cbdc00f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6b58994c2cbdc008 expref: 2 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071537.915565:0:6504:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8f8b05a5f800, canceled 13 locks, left on hash table 0. 00000020:00000080:2.0:1783071537.915579:0:6504:0:(genops.c:906:class_export_put()) final put ffff8f8b05a5f800/feaa1501-b927-4e07-baad-3200e92d7497 00010000:00010000:2.0:1783071537.915585:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071537.915588:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071537.915590:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783071537.915622:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f8b3c5d3800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1783071537.915632:0:38:0:(genops.c:906:class_export_put()) final put ffff8f8b3c5d1800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783071537.915636:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8b3c5d1800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1783071537.915643:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000100:00100000:2.0:1783071537.915685:0:6511:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8f8b1ee04400:6511] 2 exiting: rc = 0 00000020:00000080:1.0:1783071537.915717:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8b078ef000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1783071537.915722:0:38:0:(genops.c:906:class_export_put()) final put ffff8f8b08857000/lustre-MDD0000_UUID 00000020:00000080:1.0:1783071537.915724:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8b08857000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1783071537.915728:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1783071537.915765:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8b078ee800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1783071537.915771:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8b05a5f800/feaa1501-b927-4e07-baad-3200e92d7497 for MGS 00000020:00000080:1.0:1783071537.915804:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f8b05a58800 for MGS 00000100:00100000:2.0:1783071537.915812:0:6508:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8f8b186b1800:6508] 0 exiting: rc = 1 00000100:00100000:1.0:1783071537.917041:0:6510:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8f8b419b2c00:6510] 1 exiting: rc = 0 00000100:00100000:2.0:1783071537.917980:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071537.917989:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071537.917996:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071537.918002:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071537.918009:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071537.918014:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071537.918020:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071537.918025:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071537.918032:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071537.918037:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071537.918043:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071537.918048:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071537.918054:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071537.918070:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071537.918076:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071537.918083:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071537.918089:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071537.918096:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071537.918102:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071537.918111:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071537.918118:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071537.918138:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071537.918144:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071537.918149:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071537.918155:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071537.918162:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071537.918168:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071537.918174:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071537.918181:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071537.918186:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071537.918192:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071537.918199:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071537.918205:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071537.918210:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071537.918216:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071537.918688:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071537.918693:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071537.918699:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071537.918705:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071537.918711:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071537.918716:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071537.918721:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071537.918727:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071537.918733:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071537.918739:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071537.918744:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071537.918749:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071537.918755:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071537.918761:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071537.918766:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071537.918772:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071537.918778:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071537.918783:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071537.918789:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071537.918795:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071537.918801:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071537.918968:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071537.918974:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071537.918979:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071537.918985:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071537.918990:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071537.918997:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071537.919003:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071537.919009:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1783071537.920994:0:15097:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8f8b34ff9240 - data ffff8f8b2ba78000/ffff8f8a02c5cc00 00000020:01000000:1.0:1783071537.922417:0:15097:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8f8b0ab0a840 - data ffff8f8b2b855288/ffff8f8b07696c00 00000020:00000080:1.0:1783071537.924202:0:15097:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6b58994c2cbdbaf2 00000020:00000080:1.0:1783071537.929430:0:15097:0:(genops.c:906:class_export_put()) final put ffff8f8b069db800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783071537.929484:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8b069db800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:1.0:1783071537.929504:0:15097:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f8b10f7e000 from MGS, refs=2 00000020:01000004:1.0:1783071537.929508:0:15097:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8f8b10f7e000 2 00000020:01000004:1.0:1783071537.929512:0:15097:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8f8b10f7e000 from MGS 00000020:00000080:1.0:1783071537.929545:0:15097:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783071537.929554:0:15097:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1783071537.929558:0:15097:0:(genops.c:906:class_export_put()) final put ffff8f8b069df000/MGS 00000020:00000080:1.0:1783071537.929560:0:15097:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8b069df000/MGS for MGS 00000020:01000000:1.0:1783071537.929567:0:15097:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1783071537.929674:0:15097:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1783071537.929679:0:15097:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783071537.929685:0:15097:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1783071537.929692:0:15097:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8f8b3b5ff800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783071537.929710:0:15097:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff8f8b3b5c0000) has exports, disconnecting them 00000020:00080000:1.0:1783071537.929715:0:15097:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8f8b3b5ff800), last request at 1783071300 00000020:00000080:1.0:1783071537.929721:0:15097:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6b58994c2cbdbbbd 00000020:00080000:1.0:1783071537.929733:0:15097:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f8b3b5ff800): rc 0 00000020:00000080:1.0:1783071537.929737:0:15097:0:(genops.c:906:class_export_put()) final put ffff8f8b3b5ff800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1783071537.930166:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8b3b5ff800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1783071537.936195:0:15097:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1783071537.936205:0:15097:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783071537.936210:0:15097:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1783071537.936219:0:15097:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783071537.936251:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f8b3b5fc000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1783071537.936540:0:15097:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783071537.936549:0:15097:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1783071537.936554:0:15097:0:(genops.c:906:class_export_put()) final put ffff8f8b10912000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1783071537.936559:0:15097:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8b10912000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1783071537.936607:0:15097:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1783071537.936809:0:15097:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8f8b10f7e000 1 00000020:00000080:2.0:1783071537.936818:0:15097:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6b58994c2cbdbae4 00000020:00000080:2.0:1783071537.936824:0:15097:0:(genops.c:906:class_export_put()) final put ffff8f8b069d9800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1783071537.936834:0:15097:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1783071537.936843:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8b069d9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1783071537.936853:0:15097:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783071537.936858:0:15097:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1783071537.936862:0:15097:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff8f8b06c73380) has no exports 00000020:00000080:2.0:1783071538.068793:0:15097:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783071538.068809:0:15097:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1783071538.068817:0:15097:0:(genops.c:906:class_export_put()) final put ffff8f8b10f7d000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783071538.068823:0:15097:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8b10f7d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1783071538.068841:0:15097:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1783071538.068978:0:15097:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff8f8b10f78800 00000020:02000400:2.0:1783071538.069071:0:15097:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1783071538.434970:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071539.458504:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071540.482529:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783071541.061404:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783071541.061415:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783071541.061421:0:38:0:(import.c:65:import_set_state_nolock()) ffff8f8b34556000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783071541.061432:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 437 00000100:00080000:3.0:1783071541.061440:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783071541.061450:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8f8b34556000 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:3.0:1783071541.061484:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8a0411fb80 x1869685707666304/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783071541.061504:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783071541.061507:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783071541.061509:0:38:0:(import.c:65:import_set_state_nolock()) ffff8f8b07890000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783071541.061512:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 437 00000100:00080000:3.0:1783071541.061515:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783071541.061518:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8f8b07890000 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:3.0:1783071541.061542:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8a0411dc00 x1869685707666432/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783071541.061552:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783071541.061556:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783071541.061558:0:38:0:(import.c:65:import_set_state_nolock()) ffff8f8a01e4c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783071541.061561:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 437 00000100:00080000:3.0:1783071541.061564:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783071541.061569:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8f8a01e4c800 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:3.0:1783071541.061580:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8a0411d880 x1869685707666560/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783071541.061617:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783071541.061621:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783071541.061623:0:38:0:(import.c:65:import_set_state_nolock()) ffff8f8a023e4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783071541.061627:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 437 00000100:00080000:3.0:1783071541.061629:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783071541.061633:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8f8a023e4000 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:3.0:1783071541.061644:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8b3c6a9500 x1869685707666944/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783071541.061698:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0411ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:feaa1501-b927-4e07-baad-3200e92d7497:3647:1869685707666176:0@lo:400:kworker.0 00000400:00000100:3.0:1783071541.061767:0:3647:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869685707666176 offset 0 length 224: 4 00000100:00100000:3.0:1783071541.061825:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707667200:0@lo:400:kworker.0 00000100:00100000:3.0:1783071541.061864:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071541.061895:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783071541.061902:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1869685707666688:0@lo:400:kworker.0 00000100:00100000:3.0:1783071541.061941:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071541.061984:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0411fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1869685707666304:0@lo:38:kworker.0 00000100:00100000:3.0:1783071541.062026:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071541.062047:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0411dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1869685707666432:0@lo:38:kworker.0 00000100:00100000:3.0:1783071541.062069:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071541.062096:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0411d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1869685707666560:0@lo:38:kworker.0 00000100:00100000:3.0:1783071541.062118:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071541.062135:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1869685707666944:0@lo:38:kworker.0 00000100:00100000:3.0:1783071541.062155:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071541.062184:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707666816:0@lo:400:kworker.0 00000100:00100000:3.0:1783071541.062212:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071541.062232:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783071541.062238:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1869685707667072:0@lo:400:kworker.0 00000100:00100000:3.0:1783071541.062261:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071541.062299:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707667200 00000100:00100000:3.0:1783071541.062308:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707667200 00000100:00100000:3.0:1783071541.062395:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707666816 00000100:00100000:3.0:1783071541.062399:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707666816 00000100:00100000:3.0:1783071541.062430:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1783071541.062440:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707667200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071541.062509:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707667200:12345-0@lo:400:kworker.0 Request processed in 70us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071541.062517:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1783071541.062537:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1783071541.062545:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02e40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707666816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071541.062592:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02e40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707666816:12345-0@lo:400:kworker.0 Request processed in 48us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071541.062599:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1783071541.062621:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707666688 00000100:00100000:3.0:1783071541.062625:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707666688 00000100:00100000:3.0:1783071541.062647:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707666432 00000100:00100000:3.0:1783071541.062650:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707666432 00000100:00100000:3.0:1783071541.062659:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707666560 00000100:00100000:3.0:1783071541.062662:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707666560 00000100:00100000:3.0:1783071541.062670:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707666944 00000100:00100000:3.0:1783071541.062672:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707666944 00000100:00100000:3.0:1783071541.062682:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707667072 00000100:00100000:3.0:1783071541.062685:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707667072 00000100:00100000:3.0:1783071541.062700:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1783071541.062706:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869685707666688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071541.062741:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869685707666688:12345-0@lo:400:kworker.0 Request processed in 35us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071541.062747:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1783071541.062762:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1783071541.062768:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02e43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1869685707667072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071541.062795:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02e43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1869685707667072:12345-0@lo:400:kworker.0 Request processed in 28us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071541.062801:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1783071541.062813:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1783071541.062818:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02e42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1869685707666432:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783071541.062842:0:6517:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783071541.062879:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02e42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1869685707666432:12345-0@lo:38:kworker.0 Request processed in 59us (809us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783071541.062892:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1783071541.062906:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1783071541.062911:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02e41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1869685707666560:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783071541.062921:0:6517:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783071541.062946:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02e41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1869685707666560:12345-0@lo:38:kworker.0 Request processed in 33us (826us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783071541.062952:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1783071541.062963:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1783071541.062967:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02e43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1869685707666944:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783071541.062977:0:6517:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783071541.063015:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02e43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1869685707666944:12345-0@lo:38:kworker.0 Request processed in 46us (859us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783071541.063021:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1783071541.063046:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707666304 00000100:00100000:3.0:1783071541.063051:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707666304 00000100:00100000:3.0:1783071541.063077:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1783071541.063082:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1869685707666304:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783071541.063093:0:6522:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783071541.063120:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1869685707666304:12345-0@lo:38:kworker.0 Request processed in 37us (1093us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783071541.063126:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00080000:3.0:1783071541.063168:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783071541.063174:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783071541.063176:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1783071541.063221:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8f8b3c6a8380 x1869685707667072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071557 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071541.063246:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1869685707667072:0@lo:400:kworker.0 00000100:00100000:3.0:1783071541.063264:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707666816:0@lo:400:kworker.0 00000100:00080000:3.0:1783071541.063307:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8f8b34556000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783071541.063313:0:3644:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783071541.063316:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0411fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1869685707666304:0@lo:38:kworker.0 00000100:00080000:3.0:1783071541.063325:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8f8b07890000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783071541.063329:0:3644:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783071541.063332:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0411dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1869685707666432:0@lo:38:kworker.0 00000100:00080000:3.0:1783071541.063339:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8f8a01e4c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783071541.063343:0:3644:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783071541.063346:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0411d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1869685707666560:0@lo:38:kworker.0 00000100:00080000:3.0:1783071541.063354:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8f8a023e4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783071541.063357:0:3644:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783071541.063359:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1869685707666944:0@lo:38:kworker.0 00010000:00080000:3.0:1783071541.063421:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8f8b3c6abb80 x1869685707666688/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071557 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071541.063430:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1869685707666688:0@lo:400:kworker.0 00000100:00100000:3.0:1783071541.063443:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707667200:0@lo:400:kworker.0 00000020:01000004:1.0:1783071541.112796:0:15298:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1783071541.131201:0:15298:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:0.0:1783071541.131280:0:15298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461e00/0x6b58994c2cbdc040 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc047 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071541.131300:0:15298:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461e00/0x6b58994c2cbdc040 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdc047 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071541.131308:0:15298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461e00/0x6b58994c2cbdc040 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x6b58994c2cbdc047 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071541.131316:0:15298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461e00/0x6b58994c2cbdc040 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x6b58994c2cbdc047 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071541.131339:0:15298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1783071541.131346:0:15298:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1783071541.131395:0:15298:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783071541.131420:0:15298:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1783071541.131427:0:15298:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1783071541.131434:0:15298:0:(import.c:65:import_set_state_nolock()) ffff8f8b07890000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1783071541.131440:0:15298:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783071541.131441:0:15298:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1783071541.131445:0:15298:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1783071541.132533:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783071541.132550:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461e00/0x6b58994c2cbdc040 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x6b58994c2cbdc047 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071541.132562:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b3c461e00 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:2.0:1783071541.132566:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461e00/0x6b58994c2cbdc040 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x6b58994c2cbdc047 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071541.132578:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461e00/0x6b58994c2cbdc040 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x6b58994c2cbdc047 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783071541.132586:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461e00/0x6b58994c2cbdc040 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x6b58994c2cbdc047 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071541.132593:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783071541.132596:0:6504:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1783071541.132599:0:6504:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1783071541.132652:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461e00/0x6b58994c2cbdc040 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x6b58994c2cbdc047 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071541.132660:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783071541.132696:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461e00/0x6b58994c2cbdc040 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x6b58994c2cbdc047 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071541.132703:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461e00/0x6b58994c2cbdc040 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x6b58994c2cbdc047 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071541.132735:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071541.132737:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071541.132739:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071541.132757:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783071541.132781:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03bd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:feaa1501-b927-4e07-baad-3200e92d7497:3647:1869685707667328:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783071541.132881:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071541.132963:0:7923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707667328 00000100:00100000:2.0:1783071541.132972:0:7923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707667328 00010000:00010000:0.0:1783071541.135231:0:15298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461800/0x6b58994c2cbdc04e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc055 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071541.135255:0:15298:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461800/0x6b58994c2cbdc04e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdc055 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071541.135263:0:15298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461800/0x6b58994c2cbdc04e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x6b58994c2cbdc055 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071541.135271:0:15298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461800/0x6b58994c2cbdc04e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x6b58994c2cbdc055 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071541.135290:0:15298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783071541.135296:0:15298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461000/0x6b58994c2cbdbf28 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbf2f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071541.135303:0:15298:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461000/0x6b58994c2cbdbf28 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdbf2f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071541.135310:0:15298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461000/0x6b58994c2cbdbf28 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6b58994c2cbdbf2f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071541.135315:0:15298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461000/0x6b58994c2cbdbf28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6b58994c2cbdbf2f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071541.135347:0:15298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783071541.135355:0:15298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b014b9200/0x6b58994c2cbdc2c4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc2cb expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071541.135379:0:15298:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b014b9200/0x6b58994c2cbdc2c4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdc2cb expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071541.135387:0:15298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b014b9200/0x6b58994c2cbdc2c4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x6b58994c2cbdc2cb expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071541.135393:0:15298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.138@tcp lock: ffff8f8b014b9200/0x6b58994c2cbdc2c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x6b58994c2cbdc2cb expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071541.135401:0:15298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1783071541.135406:0:15298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b00031400/0x6b58994c2cbdbc11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdbc18 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071541.135413:0:15298:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b00031400/0x6b58994c2cbdbc11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdbc18 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071541.135418:0:15298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b00031400/0x6b58994c2cbdbc11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6b58994c2cbdbc18 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071541.135425:0:15298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.138@tcp lock: ffff8f8b00031400/0x6b58994c2cbdbc11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6b58994c2cbdbc18 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071541.135432:0:15298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:0.0:1783071541.135436:0:15298:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:0.0:1783071541.135471:0:15298:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:0.0:1783071541.135476:0:15298:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:0.0:1783071541.135480:0:15298:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783071541.135486:0:15298:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1783071541.135493:0:15298:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff8f8a02c70800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783071541.135499:0:15298:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff8f8b3c6eb800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783071541.135504:0:15298:0:(genops.c:1574:class_disconnect_exports()) OBD device 11 (ffff8f8b06cacd40) has exports, disconnecting them 00000020:00080000:0.0:1783071541.135509:0:15298:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8f8a02c70800), last request at 1783071541 00000020:00000080:0.0:1783071541.135518:0:15298:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6b58994c2cbdbef0 00000100:00080000:0.0:1783071541.135542:0:15298:0:(import.c:65:import_set_state_nolock()) ffff8f8a02c73800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1783071541.135593:0:15298:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f8a02c70800): rc 0 00000020:00000080:0.0:1783071541.135596:0:15298:0:(genops.c:906:class_export_put()) final put ffff8f8a02c70800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:0.0:1783071541.135608:0:15298:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8f8b3c6eb800), last request at 1783071541 00000020:00000080:0.0:1783071541.135611:0:15298:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6b58994c2cbdbdca 00000100:00080000:0.0:1783071541.135617:0:15298:0:(import.c:65:import_set_state_nolock()) ffff8f8b3c6e8800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1783071541.135624:0:15298:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f8b3c6eb800): rc 0 00000020:00000080:0.0:1783071541.135626:0:15298:0:(genops.c:906:class_export_put()) final put ffff8f8b3c6eb800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:0.0:1783071541.135634:0:15298:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffff9cbcc14ebae0 00000100:00080000:0.0:1783071541.135658:0:15298:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783071541.135668:0:15298:0:(client.c:3600:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff8f8a01764380 x1869685707664128/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783071551 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071541.135682:0:15298:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00010000:00010000:3.0:1783071541.136194:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1783071541.136205:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461800/0x6b58994c2cbdc04e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x6b58994c2cbdc055 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071541.136228:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b3c461800 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:3.0:1783071541.136232:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461800/0x6b58994c2cbdc04e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x6b58994c2cbdc055 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071541.136243:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461800/0x6b58994c2cbdc04e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x6b58994c2cbdc055 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783071541.136250:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461800/0x6b58994c2cbdc04e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x6b58994c2cbdc055 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783071541.136255:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783071541.136258:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:3.0:1783071541.136260:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:3.0:1783071541.136311:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461800/0x6b58994c2cbdc04e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x6b58994c2cbdc055 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071541.136318:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783071541.136346:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461800/0x6b58994c2cbdc04e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x6b58994c2cbdc055 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071541.136353:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461800/0x6b58994c2cbdc04e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x6b58994c2cbdc055 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071541.136394:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783071541.136397:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461000/0x6b58994c2cbdbf28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6b58994c2cbdbf2f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071541.136403:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b3c461000 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:3.0:1783071541.136406:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461000/0x6b58994c2cbdbf28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6b58994c2cbdbf2f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071541.136419:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461000/0x6b58994c2cbdbf28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x6b58994c2cbdbf2f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783071541.136426:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461000/0x6b58994c2cbdbf28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x6b58994c2cbdbf2f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783071541.136431:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1783071541.136434:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1783071541.136436:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1783071541.136450:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461000/0x6b58994c2cbdbf28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6b58994c2cbdbf2f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071541.136456:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783071541.136462:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461000/0x6b58994c2cbdbf28 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6b58994c2cbdbf2f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071541.136468:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461000/0x6b58994c2cbdbf28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6b58994c2cbdbf2f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071541.136497:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783071541.136502:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8b014b9200/0x6b58994c2cbdc2c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x6b58994c2cbdc2cb expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071541.136507:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b014b9200 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:3.0:1783071541.136510:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8b014b9200/0x6b58994c2cbdc2c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x6b58994c2cbdc2cb expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071541.136516:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8b014b9200/0x6b58994c2cbdc2c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x6b58994c2cbdc2cb expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783071541.136532:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8b014b9200/0x6b58994c2cbdc2c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x6b58994c2cbdc2cb expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783071541.136538:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1783071541.136540:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1783071541.136542:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1783071541.136559:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8f8b014b9200/0x6b58994c2cbdc2c4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x6b58994c2cbdc2cb expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071541.136565:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783071541.136587:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8b014b9200/0x6b58994c2cbdc2c4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x6b58994c2cbdc2cb expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071541.136593:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8b014b9200/0x6b58994c2cbdc2c4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x6b58994c2cbdc2cb expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071541.136604:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783071541.136608:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8b00031400/0x6b58994c2cbdbc11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6b58994c2cbdbc18 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071541.136614:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b00031400 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:3.0:1783071541.136617:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8b00031400/0x6b58994c2cbdbc11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6b58994c2cbdbc18 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071541.136624:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8b00031400/0x6b58994c2cbdbc11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x6b58994c2cbdbc18 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783071541.136631:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8b00031400/0x6b58994c2cbdbc11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x6b58994c2cbdbc18 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783071541.136646:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1783071541.136648:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1783071541.136650:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1783071541.136664:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8f8b00031400/0x6b58994c2cbdbc11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6b58994c2cbdbc18 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071541.136670:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783071541.136676:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8b00031400/0x6b58994c2cbdbc11 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6b58994c2cbdbc18 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071541.136682:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8b00031400/0x6b58994c2cbdbc11 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6b58994c2cbdbc18 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071541.136697:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071541.136699:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071541.136701:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783071541.136717:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8a02c70800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1783071541.136772:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8b3c6eb800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1783071541.136797:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f8a02c73800 for lustre-MDT0001 00000020:00000080:3.0:1783071541.136801:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f8b3c6e8800 for lustre-MDT0001 00000100:00100000:3.0:1783071541.136822:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02e40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:feaa1501-b927-4e07-baad-3200e92d7497:3645:1869685707667456:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783071541.136911:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071541.136968:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783071541.136975:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02e40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:feaa1501-b927-4e07-baad-3200e92d7497:3645:1869685707667584:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783071541.137011:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071541.137057:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707667456 00000100:00100000:3.0:1783071541.137066:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707667456 00010000:00010000:1.0:1783071541.137198:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071541.137305:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02e41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:feaa1501-b927-4e07-baad-3200e92d7497:3647:1869685707667712:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783071541.137341:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071541.137387:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783071541.137393:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02e41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:feaa1501-b927-4e07-baad-3200e92d7497:3647:1869685707667840:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783071541.137415:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071541.137442:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707667584 00000100:00100000:2.0:1783071541.137445:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707667584 00000100:00100000:2.0:1783071541.137472:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707667712 00000100:00100000:2.0:1783071541.137475:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707667712 00000100:00100000:2.0:1783071541.137483:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707667840 00000100:00100000:2.0:1783071541.137485:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707667840 00000100:00100000:2.0:1783071541.137499:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783071541.137508:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab89850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3647:x1869685707667328:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1783071541.137516:0:6501:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783071541 with bad export cookie 7735100912456022798 00000100:00100000:1.0:1783071541.138194:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783071541.138202:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02e43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3645:x1869685707667584:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1783071541.138208:0:6503:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783071541 with bad export cookie 7735100912456022798 00000100:00100000:1.0:1783071541.138284:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02e43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3645:x1869685707667584:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (1271us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783071541.138292:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783071541.138317:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783071541.138321:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3647:x1869685707667712:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1783071541.138325:0:6503:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783071541 with bad export cookie 7735100912456022798 00000100:00100000:1.0:1783071541.138358:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3647:x1869685707667712:12345-0@lo:103:ldlm_bl.0 Request processed in 34us (1016us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783071541.138378:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783071541.138390:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783071541.138395:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3647:x1869685707667840:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1783071541.138399:0:6503:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783071541 with bad export cookie 7735100912456022798 00000100:00100000:1.0:1783071541.138422:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3647:x1869685707667840:12345-0@lo:103:ldlm_bl.0 Request processed in 25us (1006us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783071541.138428:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1783071541.138467:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.138@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783071541.138473:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8f8b06c52000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1783071541.138490:0:3645:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.138@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:3.0:1783071541.138584:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783071541.138598:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02e41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3645:x1869685707667456:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1783071541.138603:0:6502:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783071541 with bad export cookie 7735100912456022798 00000100:00100000:3.0:1783071541.138635:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02e41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3645:x1869685707667456:12345-0@lo:103:ldlm_bl.0 Request processed in 36us (1725us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783071541.138641:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783071541.138668:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707664128:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1783071541.139333:0:15298:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1783071541.139343:0:15298:0:(import.c:65:import_set_state_nolock()) ffff8f8b34556000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1783071541.142628:0:15298:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1783071541.142641:0:15298:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:3.0:1783071541.142665:0:15298:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1783071541.142732:0:15298:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1783071541.142778:0:15298:0:(import.c:65:import_set_state_nolock()) ffff8f8a01779000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1783071541.142807:0:15298:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1783071541.142810:0:15298:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:3.0:1783071541.142824:0:15298:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783071541.142909:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02e42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1869685707667968:0@lo:9:umount.0 00000100:00100000:3.0:1783071541.143017:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071541.143089:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707667968 00000100:00100000:3.0:1783071541.143099:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707667968 00000100:00100000:3.0:1783071541.143163:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1783071541.143174:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02e42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1869685707667968:12345-0@lo:9:umount.0 00000020:00000080:3.0:1783071541.143209:0:8431:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6b58994c2cbdbe17 00000100:00080000:3.0:1783071541.143221:0:8431:0:(import.c:65:import_set_state_nolock()) ffff8f8b3c6ec000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783071541.143273:0:8431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1783071541.143485:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02e42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3644:x1869685707667968:12345-0@lo:9:umount.0 Request processed in 311us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071541.143494:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00010000:3.0:1783071541.143522:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783071541.143569:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8f8a01779000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1783071541.143574:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1783071541.143576:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783071541.143580:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02e42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1869685707667968:0@lo:9:umount.0 00000100:00080000:3.0:1783071541.143602:0:15298:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1783071541.143612:0:15298:0:(import.c:65:import_set_state_nolock()) ffff8f8a0319d000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1783071541.143629:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02e42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1869685707668096:0@lo:9:umount.0 00000100:00100000:3.0:1783071541.143660:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071541.143691:0:8910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707668096 00000100:00100000:3.0:1783071541.143695:0:8910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707668096 00000100:00100000:3.0:1783071541.143724:0:8910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1783071541.143732:0:8910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02e41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1869685707668096:12345-0@lo:9:umount.0 00000020:00000080:3.0:1783071541.143748:0:8910:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6b58994c2cbdbf59 00000100:00080000:3.0:1783071541.143755:0:8910:0:(import.c:65:import_set_state_nolock()) ffff8f8a023e2800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783071541.143792:0:8910:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1783071541.143885:0:8910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02e41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3644:x1869685707668096:12345-0@lo:9:umount.0 Request processed in 154us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071541.143892:0:8910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:3.0:1783071541.143918:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8f8a0319d000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1783071541.143922:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1783071541.143924:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783071541.143927:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02e42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1869685707668096:0@lo:9:umount.0 00000020:00080000:3.0:1783071541.143967:0:15298:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff8f8b06cacd40) has no exports 00000100:00080000:3.0:1783071541.144432:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.138@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:2.0:1783071541.147254:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab89850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3647:x1869685707667328:12345-0@lo:103:ldlm_bl.0 Request processed in 9736us (14365us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783071541.147273:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:0.0:1783071541.151341:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783071541.158939:0:3645:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.138@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1783071541.158947:0:3645:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1783071541.158961:0:3645:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f8a0411ce00 x1869685707666176/t0(0) o400->MGC192.168.204.138@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783071557 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071541.158980:0:3645:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f8a03bd3480 x1869685707667328/t0(0) o103->MGC192.168.204.138@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783071557 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071541.158991:0:3645:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f8a02e40000 x1869685707667456/t0(0) o103->MGC192.168.204.138@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783071557 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071541.159090:0:3645:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f8a02e40380 x1869685707667584/t0(0) o103->MGC192.168.204.138@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783071557 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071541.159098:0:3645:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f8a02e41500 x1869685707667712/t0(0) o103->MGC192.168.204.138@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783071557 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071541.159107:0:3645:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f8a02e41f80 x1869685707667840/t0(0) o103->MGC192.168.204.138@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783071557 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1783071541.159117:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1783071541.159120:0:3645:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1783071541.159122:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1783071541.159309:0:3647:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8f8b06c52000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:3.0:1783071541.159483:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02e41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:feaa1501-b927-4e07-baad-3200e92d7497:3647:1869685707667712:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783071541.159497:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03bd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:feaa1501-b927-4e07-baad-3200e92d7497:3647:1869685707667328:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783071541.159531:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0411ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:feaa1501-b927-4e07-baad-3200e92d7497:3647:1869685707666176:0@lo:400:kworker.0 00000100:00100000:3.0:1783071541.159577:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02e41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:feaa1501-b927-4e07-baad-3200e92d7497:3647:1869685707667840:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1783071541.159725:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8f8b06c52000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783071541.159732:0:3645:0:(import.c:512:import_select_connection()) MGC192.168.204.138@tcp: connect to NID 0@lo last attempt 201 00000100:00080000:1.0:1783071541.159744:0:3645:0:(import.c:626:import_select_connection()) MGC192.168.204.138@tcp: import ffff8f8b06c52000 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:1.0:1783071541.160518:0:3645:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8a03a9d180 x1869685707668224/t0(0) o250->MGC192.168.204.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783071541.160591:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:feaa1501-b927-4e07-baad-3200e92d7497:3644:1869685707668224:0@lo:250:ptlrpcd_00_00.0 00000100:00100000:1.0:1783071541.160711:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02e40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:feaa1501-b927-4e07-baad-3200e92d7497:3645:1869685707667456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783071541.160738:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02e40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:feaa1501-b927-4e07-baad-3200e92d7497:3645:1869685707667584:0@lo:103:ldlm_bl.0 00000400:00000100:2.0:1783071541.160802:0:3644:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869685707668224 offset 0 length 520: 4 00000020:00080000:3.0:1783071541.166808:0:15298:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff8f8b06cacd40) has no exports 00000020:01000000:1.0:1783071541.226762:0:15298:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8f8b34ff9d80 - data ffff8f8b2bb27438/ffff8f8a02c5d000 00000020:01000000:1.0:1783071541.227199:0:15298:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8f8b1ee06cc0 - data ffff8f8b2b968870/ffff8f8b3c5a5c00 00000001:00000004:2.0:1783071541.238206:0:15298:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:1.0:1783071541.290035:0:15298:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783071541.290045:0:15298:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:1.0:1783071541.290054:0:15298:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1783071541.294502:0:15298:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1783071541.294513:0:15298:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:1.0:1783071541.294539:0:15298:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783071541.294543:0:15298:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1783071541.294942:0:8903:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1783071541.294950:0:8903:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:3.0:1783071541.294962:0:8903:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1783071541.296982:0:15298:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1783071541.297004:0:15298:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:2.0:1783071541.297034:0:15298:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783071541.297037:0:15298:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1783071541.297858:0:9998:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1783071541.297865:0:9998:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:1.0:1783071541.297877:0:9998:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1783071541.301961:0:15298:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6b58994c2cbdbc34 00000020:00000080:2.0:1783071541.301981:0:15298:0:(genops.c:906:class_export_put()) final put ffff8f8b34560000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1783071541.302959:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8b34560000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1783071541.307186:0:15298:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6b58994c2cbdbc49 00000020:00000080:2.0:1783071541.307203:0:15298:0:(genops.c:906:class_export_put()) final put ffff8f8b34564000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1783071541.307257:0:15298:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1783071541.307263:0:15298:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783071541.307271:0:15298:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783071541.307275:0:15298:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff8f8b06cab380) has no exports 00000004:01000000:2.0:1783071541.307479:0:15298:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1783071541.307489:0:15298:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6b58994c2cbdbf52 00000020:00000080:2.0:1783071541.307494:0:15298:0:(genops.c:906:class_export_put()) final put ffff8f8a0319b000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1783071541.307742:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8b34564000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1783071541.307784:0:15298:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1783071541.307790:0:15298:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783071541.307842:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8a0319b000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1783071541.307873:0:15298:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783071541.307877:0:15298:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff8f8a017d8000) has no exports 00000020:00000080:2.0:1783071541.307884:0:15298:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6b58994c2cbdbf4b 00000020:00000080:2.0:1783071541.307891:0:15298:0:(genops.c:906:class_export_put()) final put ffff8f8a0319e000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1783071541.308299:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8a0319e000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1783071541.309136:0:15298:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1783071541.309141:0:15298:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1783071541.309146:0:15298:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:3.0:1783071541.309153:0:15298:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783071541.309156:0:15298:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783071541.309263:0:15298:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783071541.309274:0:15298:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1783071541.309283:0:15298:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6b58994c2cbdbe10 00000020:00000080:3.0:1783071541.309291:0:15298:0:(genops.c:906:class_export_put()) final put ffff8f8a01e3c800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1783071541.309348:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f8a0319d000 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1783071541.309357:0:8:0:(genops.c:906:class_export_put()) final put ffff8f8b069d8800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1783071541.309360:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8b069d8800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1783071541.309402:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1783071541.309658:0:15298:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:1.0:1783071541.309658:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8a01e3c800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1783071541.309663:0:15298:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783071541.309670:0:15298:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1783071541.309676:0:15298:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff8f8b34e619c0) has no exports 00000020:00000080:3.0:1783071541.309685:0:15298:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6b58994c2cbdbe09 00000020:00000080:3.0:1783071541.309691:0:15298:0:(genops.c:906:class_export_put()) final put ffff8f8a01778000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1783071541.309730:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8a01778000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1783071541.310348:0:15298:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1783071541.310352:0:15298:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1783071541.310356:0:15298:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:3.0:1783071541.310434:0:15298:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783071541.310436:0:15298:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783071541.310526:0:15298:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783071541.310535:0:15298:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1783071541.310571:0:15298:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1783071541.310580:0:15298:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6b58994c2cbdbc6c 00000020:00000080:3.0:1783071541.310593:0:15298:0:(genops.c:906:class_export_put()) final put ffff8f8b3b5fa000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1783071541.310640:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f8a01779000 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1783071541.310648:0:8:0:(genops.c:906:class_export_put()) final put ffff8f8a0177f800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1783071541.310651:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8a0177f800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1783071541.310656:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1783071541.310686:0:15298:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1783071541.310691:0:15298:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783071541.310695:0:15298:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1783071541.310698:0:15298:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff8f8b34e63380) has no exports 00000020:00000080:3.0:1783071541.310703:0:15298:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6b58994c2cbdbc65 00000020:00000080:3.0:1783071541.310706:0:15298:0:(genops.c:906:class_export_put()) final put ffff8f8b34557800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1783071541.310713:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8b3b5fa000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1783071541.310717:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8b34557800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1783071541.311621:0:15298:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:2.0:1783071541.311627:0:15298:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783071541.311631:0:15298:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1783071541.311637:0:15298:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783071541.311721:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f8b34556000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1783071541.311753:0:15298:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783071541.311763:0:15298:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1783071541.311767:0:15298:0:(genops.c:906:class_export_put()) final put ffff8f8b34552800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1783071541.311771:0:15298:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8b34552800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:2.0:1783071541.311785:0:15298:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1783071541.312013:0:15298:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783071541.312018:0:15298:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1783071541.312022:0:15298:0:(genops.c:906:class_export_put()) final put ffff8f8b3447b800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1783071541.312024:0:15298:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8b3447b800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1783071541.312030:0:15298:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1783071541.312162:0:15298:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6b58994c2cbdbc50 00000020:00000080:2.0:1783071541.312168:0:15298:0:(genops.c:906:class_export_put()) final put ffff8f8b34563800/lustre-MDD0001_UUID 00000020:01000000:2.0:1783071541.312182:0:15298:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:2.0:1783071541.312187:0:15298:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783071541.312193:0:15298:0:(obd_config.c:955:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783071541.312196:0:15298:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff8f8b34574d40) has no exports 00000020:00000080:2.0:1783071541.312226:0:15298:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783071541.312230:0:15298:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:2.0:1783071541.312235:0:15298:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6b58994c2cbdbc57 00000020:00000080:2.0:1783071541.312240:0:15298:0:(genops.c:906:class_export_put()) final put ffff8f8b34560800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1783071541.312257:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8b34563800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000004:2.0:1783071541.312265:0:15298:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f8b3447b000 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1783071541.312265:0:38:0:(genops.c:906:class_export_put()) final put ffff8f8b34567000/lustre-MDD0001_UUID 00000020:00000080:1.0:1783071541.312269:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8b34567000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000004:2.0:1783071541.312271:0:15298:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8f8b3447b000 2 00000020:01000004:2.0:1783071541.312277:0:15298:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8f8b3447b000 from lustre-MDT0001 00000020:01000000:1.0:1783071541.312277:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:2.0:1783071541.312315:0:15298:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783071541.312323:0:15298:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:2.0:1783071541.312328:0:15298:0:(genops.c:906:class_export_put()) final put ffff8f8b34561000/lustre-MDT0001_UUID 00000020:00000080:2.0:1783071541.312339:0:15298:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8b34561000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:2.0:1783071541.312351:0:15298:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:2.0:1783071541.312524:0:15298:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:2.0:1783071541.312531:0:15298:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:2.0:1783071541.312534:0:15298:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783071541.312537:0:15298:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1783071541.312543:0:15298:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff8f8b34552000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783071541.312550:0:15298:0:(genops.c:1574:class_disconnect_exports()) OBD device 14 (ffff8f8b34e64d40) has exports, disconnecting them 00000020:00080000:2.0:1783071541.312557:0:15298:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff8f8b34552000), last request at 1783071315 00000020:00000080:2.0:1783071541.312569:0:15298:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6b58994c2cbdbcab 00000020:00080000:2.0:1783071541.312585:0:15298:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f8b34552000): rc 0 00000020:00000080:2.0:1783071541.312590:0:15298:0:(genops.c:906:class_export_put()) final put ffff8f8b34552000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1783071541.312773:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8b34560800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1783071541.312781:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8b34552000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:3.0:1783071541.323487:0:15298:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:3.0:1783071541.323501:0:15298:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783071541.323507:0:15298:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1783071541.323514:0:15298:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783071541.323621:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f8b07890000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1783071541.323930:0:15298:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783071541.323940:0:15298:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:3.0:1783071541.323945:0:15298:0:(genops.c:906:class_export_put()) final put ffff8f8b34556800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1783071541.323950:0:15298:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8b34556800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1783071541.323960:0:15298:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:3.0:1783071541.324121:0:15298:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8f8b3447b000 1 00000020:00000080:3.0:1783071541.324129:0:15298:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6b58994c2cbdbbe7 00000020:00000080:3.0:1783071541.324141:0:15298:0:(genops.c:906:class_export_put()) final put ffff8f8b07895000/lustre-MDT0001-osd_UUID 00000020:01000000:3.0:1783071541.324205:0:15298:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:3.0:1783071541.324210:0:15298:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783071541.324215:0:15298:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1783071541.324220:0:15298:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff8f8b06ca8000) has no exports 00000020:00000080:1.0:1783071541.326489:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8b07895000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1783071541.371298:0:15298:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783071541.371318:0:15298:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:3.0:1783071541.371327:0:15298:0:(genops.c:906:class_export_put()) final put ffff8f8b34478800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1783071541.371349:0:15298:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8b34478800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1783071541.373781:0:15298:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1783071541.374019:0:15298:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff8f8b3447a000 00000020:01000000:3.0:1783071541.374059:0:15298:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1783071541.374066:0:15298:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783071541.374073:0:15298:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1783071541.374078:0:15298:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff8f8b06c719c0) has no exports 00000100:00100000:0.0:1783071541.374325:0:6517:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8f8b186b1600:6517] 1 exiting: rc = 0 00000100:00100000:3.0:1783071541.374661:0:13815:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff8f8a0322e200:13815] 4 exiting: rc = 0 00000100:00100000:3.0:1783071541.374798:0:10292:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8f8b3c599200:10292] 3 exiting: rc = 0 00000100:00100000:3.0:1783071541.374886:0:6516:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8f8b05aa8200:6516] 0 exiting: rc = 1 00000100:00100000:2.0:1783071541.375062:0:6518:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8f8b186b1400:6518] 2 exiting: rc = 0 00000100:00100000:3.0:1783071541.375206:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071541.375216:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071541.375223:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071541.375230:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071541.375237:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071541.375243:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071541.375250:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071541.375256:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071541.375262:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071541.375268:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071541.375274:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071541.375280:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071541.375286:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071541.375292:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071541.375297:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071541.375303:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071541.375310:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071541.375316:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071541.375708:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071541.375723:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071541.375730:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071541.375736:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071541.375741:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071541.375748:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071541.375822:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071541.375829:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071541.375835:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071541.375842:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071541.375847:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071541.375854:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071541.375860:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071541.375867:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071541.375873:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071541.375880:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071541.375886:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071541.375892:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071541.375898:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071541.375905:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071541.375911:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071541.375918:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071541.375924:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071541.375931:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071541.375936:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071541.375943:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071541.375948:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071541.375953:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071541.375959:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071541.375965:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071541.375971:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071541.375977:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071541.375983:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071541.375989:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071541.376009:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071541.376016:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071541.376022:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071541.376028:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071541.376035:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071541.376041:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071541.376049:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071541.376064:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071541.376070:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071541.376076:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071541.376083:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071541.376104:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071541.380946:0:6520:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8f8b186b1a00:6520] 1 exiting: rc = 0 00000100:00100000:2.0:1783071541.381214:0:6519:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8f8b186b1e00:6519] 0 exiting: rc = 1 00000100:00100000:0.0:1783071541.381344:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.381355:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.383243:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.383252:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.383260:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.383269:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.383277:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.383284:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.383290:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.383296:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.383302:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.383310:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.383317:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.383323:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.383328:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.383334:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.383339:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.383344:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.383350:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.383356:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.383383:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.383391:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.383396:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.383402:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.383407:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.383413:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.383420:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.383426:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.383432:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.383438:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.383445:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.383451:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.383457:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.383462:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.383468:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.383475:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.383481:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.383496:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.383502:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.383508:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.383515:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.383521:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.383526:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.383533:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.383538:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.383543:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.383549:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.383555:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.383560:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.383566:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.383572:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.383578:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.383583:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.383590:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.383596:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.383601:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.383606:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.383612:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.383617:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.383623:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.383629:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.383634:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.383639:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.383645:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071541.384591:0:6523:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8f8b18690c00:6523] 1 exiting: rc = 0 00000100:00100000:2.0:1783071541.384739:0:6522:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8f8b18691e00:6522] 0 exiting: rc = 1 00000100:00100000:1.0:1783071541.384922:0:9413:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff8f8a01789e00:9413] 2 exiting: rc = 0 00000100:00100000:2.0:1783071541.385079:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071541.385092:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071541.385100:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071541.385107:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071541.385117:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071541.385125:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071541.385134:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071541.385141:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071541.385149:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071541.385156:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071541.385162:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071541.385170:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071541.385177:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071541.385202:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071541.385213:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071541.385222:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071541.385229:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071541.385238:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071541.385247:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071541.385255:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071541.385263:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071541.385272:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071541.385281:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071541.385288:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071541.385297:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071541.385322:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071541.385346:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071541.385354:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071541.385855:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071541.385867:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071541.385873:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071541.385880:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071541.385887:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071541.385895:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071541.385902:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071541.385910:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071541.385920:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071541.385944:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071541.385952:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071541.385961:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071541.385969:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071541.385976:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071541.385984:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071541.386000:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071541.386009:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071541.386015:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071541.386022:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071541.386029:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071541.386036:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071541.386059:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071541.386068:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071541.386074:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071541.386081:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071541.386087:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071541.386094:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071541.386101:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071541.386108:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071541.386116:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071541.386122:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071541.386128:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071541.386134:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071541.386153:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071541.386160:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071541.386174:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071541.404865:0:6524:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8f8b18690200:6524] 0 exiting: rc = 1 00000100:00100000:3.0:1783071541.405655:0:6525:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8f8b1f983a00:6525] 1 exiting: rc = 0 00000100:00100000:0.0:1783071541.405839:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.405848:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.405854:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.405860:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.405865:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.405871:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.405876:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.405881:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.405903:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.405909:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.405917:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.405924:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.405930:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.405935:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.405942:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.405949:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.405956:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.405964:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.405974:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.405981:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.406000:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.406006:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.406019:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.406025:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.406030:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.406035:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.406041:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.406047:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.406052:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.406057:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.406062:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.406068:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.406075:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.406081:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.406088:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.406093:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.406099:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.406105:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.406111:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.406117:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.406122:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.406128:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.406133:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.406147:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.406152:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.406158:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.406164:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.406170:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.406176:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.406181:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.406604:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.406622:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.406629:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.406635:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.406641:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.406647:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.406652:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.406658:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.406665:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.406671:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.406676:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.406682:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.406688:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.406694:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.407173:0:6526:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8f8b03cab600:6526] 0 exiting: rc = 1 00000100:00100000:1.0:1783071541.407698:0:6527:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8f8b13ef2600:6527] 1 exiting: rc = 0 00000100:00100000:0.0:1783071541.408162:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.408170:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.408175:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.408181:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.408196:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.408202:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.408208:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.408215:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.408222:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.408229:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.408236:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.408242:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.408248:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.408273:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.408280:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.408286:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.408290:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.408295:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.408301:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.408307:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.408315:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.408322:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.408330:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.408337:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.408342:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.408347:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.408353:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.408358:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.408381:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.408388:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.408394:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.408401:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.408407:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.408416:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.408424:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.408430:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.408440:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.408449:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.408458:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.408463:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.408469:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.408475:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.408482:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.408487:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.408493:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.408498:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.408504:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.408509:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.408525:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.408535:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.408545:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.408551:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.408560:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.408569:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.408579:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.408586:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.408594:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.408603:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.408625:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.408633:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.408641:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.408648:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.408655:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.408663:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.409803:0:6529:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8f8b13ef3800:6529] 1 exiting: rc = 0 00000100:00100000:3.0:1783071541.410346:0:6528:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8f8b13ef2400:6528] 0 exiting: rc = 1 00000100:00100000:0.0:1783071541.410694:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.410703:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.410709:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.410715:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.410720:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.410724:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.410729:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.410734:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.410739:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.410744:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.410748:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.410753:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.410760:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.410765:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.410770:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.410775:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.410780:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.410785:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.410807:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.410811:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.410816:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.410834:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.410842:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.410847:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.410851:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.410856:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.410861:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.410865:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.410870:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.410874:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.410880:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.410885:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.410901:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.410907:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.410912:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.410917:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.410922:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.410927:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.410933:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.410938:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.410942:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.410950:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.410954:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.410958:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.410963:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.410969:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.412190:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.412211:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.412215:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.412220:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.412225:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.412230:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.412235:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.412255:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.412260:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.412264:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.412269:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.412273:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.412278:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.412287:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.412299:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.412307:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.412316:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.412320:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071541.413155:0:6530:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8f8b1f0a1800:6530] 0 exiting: rc = 1 00000100:00100000:3.0:1783071541.413188:0:6532:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8f8b1f0a1400:6532] 2 exiting: rc = 0 00000100:00100000:2.0:1783071541.413618:0:6531:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8f8b1f0a1600:6531] 1 exiting: rc = 0 00000100:00100000:0.0:1783071541.413763:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.413776:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.413783:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.413796:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.413812:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.413966:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.414048:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.414057:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.414063:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.414069:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.414076:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.414081:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.414086:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.414162:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.414167:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.414173:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.414179:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.414184:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.414263:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.414270:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.414276:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.414281:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.414286:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.414292:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.414309:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.414316:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.414322:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.414328:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.414336:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.414343:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.414352:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.414397:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.414411:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.414417:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.414424:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.414429:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.414437:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.414448:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.414454:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.414464:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.414469:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.414475:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.414574:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.414584:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.414590:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.414597:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.414605:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.414614:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.414621:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.414628:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.414637:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.414644:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.414652:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.414658:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.414665:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.414672:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.414680:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.414687:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.414695:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.414712:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.414720:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.414727:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.414735:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071541.414750:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1783071541.425196:0:15298:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783071541.425215:0:15298:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1783071541.425222:0:15298:0:(genops.c:906:class_export_put()) final put ffff8f8b06c53000/MDS_uuid 00000020:00000080:2.0:1783071541.425229:0:15298:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8b06c53000/MDS_uuid for MDS 00000020:01000000:2.0:1783071541.425237:0:15298:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1783071541.425568:0:15298:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:3.0:1783071541.506583:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071542.530595:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071543.555695:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071544.584403:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1783071545.102052:0:15499:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1783071545.111063:0:15499:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1783071545.111124:0:15499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b10967c00/0x6b58994c2cbdc024 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc02b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071545.111138:0:15499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b10967c00/0x6b58994c2cbdc024 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdc02b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071545.111145:0:15499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b10967c00/0x6b58994c2cbdc024 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x6b58994c2cbdc02b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071545.111153:0:15499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.138@tcp lock: ffff8f8b10967c00/0x6b58994c2cbdc024 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x6b58994c2cbdc02b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071545.111178:0:15499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1783071545.111184:0:15499:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:3.0:1783071545.111187:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783071545.111195:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8b10967c00/0x6b58994c2cbdc024 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x6b58994c2cbdc02b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071545.111203:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b10967c00 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:3.0:1783071545.111207:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8b10967c00/0x6b58994c2cbdc024 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x6b58994c2cbdc02b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783071545.111213:0:15499:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:3.0:1783071545.111216:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8b10967c00/0x6b58994c2cbdc024 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x6b58994c2cbdc02b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071545.111217:0:15499:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1783071545.111222:0:15499:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 10000000:00010000:3.0:1783071545.111223:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8b10967c00/0x6b58994c2cbdc024 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x6b58994c2cbdc02b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783071545.111228:0:15499:0:(import.c:65:import_set_state_nolock()) ffff8f8a01e4c800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 10000000:01000000:3.0:1783071545.111229:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783071545.111232:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 00000100:00080000:1.0:1783071545.111233:0:15499:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783071545.111234:0:15499:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 10000000:01000000:3.0:1783071545.111235:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1783071545.111248:0:6505:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f8b06c52000 00000100:00100000:1.0:1783071545.111251:0:15499:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1783071545.111252:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8b10967c00/0x6b58994c2cbdc024 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x6b58994c2cbdc02b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071545.111267:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8b10967c00/0x6b58994c2cbdc024 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x6b58994c2cbdc02b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071545.111277:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071545.111279:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071545.111281:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783071545.112111:0:15499:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1783071545.112116:0:15499:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1783071545.112120:0:15499:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1783071545.112140:0:15499:0:(import.c:65:import_set_state_nolock()) ffff8f8a01e3f000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1783071545.114250:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1869685707668352:0@lo:39:umount.0 00000400:00000100:2.0:1783071545.114321:0:3644:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869685707668352 offset 0 length 224: 4 00010000:00010000:0.0:1783071545.602479:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783071546.179766:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) feaa1501-b927-4e07-baad-3200e92d7497->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783071546.179777:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) feaa1501-b927-4e07-baad-3200e92d7497->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783071546.179780:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783071546.179783:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783071546.179787:0:8:0:(import.c:65:import_set_state_nolock()) ffff8f8a023e4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783071546.179795:0:8:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 442 00000100:00080000:3.0:1783071546.179801:0:8:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1783071546.179809:0:8:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8f8a023e4000 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:3.0:1783071546.179848:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8a02e43100 x1869685707668480/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783071546.179952:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02e43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1869685707668480:0@lo:38:kworker.0 00000400:00000100:2.0:1783071546.180005:0:3644:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869685707668480 offset 0 length 520: 4 00000100:00100000:1.0:1783071546.180021:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02e42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1869685707668608:0@lo:400:kworker.0 00000400:00000100:1.0:1783071546.180044:0:3645:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869685707668608 offset 0 length 224: 4 00010000:00010000:3.0:1783071546.627422:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783071547.205749:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1783071547.205761:0:9510:0:(genops.c:906:class_export_put()) final put ffff8f8a023e7000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1783071547.205828:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8a023e7000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1783071547.205879:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f8a023e2800 for lustre-OST0001 00000001:00100000:1.0:1783071547.209807:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1783071547.209821:0:8425:0:(genops.c:906:class_export_put()) final put ffff8f8b3c6ef800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1783071547.210788:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8b3c6ef800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1783071547.211043:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f8b3c6ec000 for lustre-OST0000 00010000:00010000:0.0:1783071547.650718:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071548.680783:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071549.698681:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071550.722608:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071551.299630:0:3644:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783071541/real 1783071541] req@ffff8f8a03a9d180 x1869685707668224/t0(0) o250->MGC192.168.204.138@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783071551 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071551.299665:0:3644:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f8a03a9d180 x1869685707668224/t0(0) o250->MGC192.168.204.138@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783071551 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783071551.299687:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8f8b06c52000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783071551.299926:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) feaa1501-b927-4e07-baad-3200e92d7497->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783071551.299933:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1783071551.299936:0:38:0:(import.c:65:import_set_state_nolock()) ffff8f8b06c52000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783071551.299941:0:38:0:(import.c:512:import_select_connection()) MGC192.168.204.138@tcp: connect to NID 0@lo last attempt 442 00000100:00080000:1.0:1783071551.299947:0:38:0:(import.c:591:import_select_connection()) MGC192.168.204.138@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783071551.299956:0:38:0:(import.c:626:import_select_connection()) MGC192.168.204.138@tcp: import ffff8f8b06c52000 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:1.0:1783071551.300000:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8a03a9e680 x1869685707668736/t0(0) o250->MGC192.168.204.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783071551.300016:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783071551.300020:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783071551.300146:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783071551.300160:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1869685707668864:0@lo:400:kworker.0 00000400:00000100:2.0:1783071551.300219:0:3645:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869685707668864 offset 0 length 224: 4 00000100:00080000:0.0:1783071551.301306:0:3644:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1783071551.301315:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:feaa1501-b927-4e07-baad-3200e92d7497:3644:1869685707668224:0@lo:250:ptlrpcd_00_00.0 00000100:00100000:0.0:1783071551.301348:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:feaa1501-b927-4e07-baad-3200e92d7497:3644:1869685707668736:0@lo:250:kworker.0 00000400:00000100:0.0:1783071551.301419:0:3644:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869685707668736 offset 0 length 520: 4 00000100:00080000:1.0:1783071551.303598:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783071551.303607:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1783071551.746952:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071552.770616:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071553.794620:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071554.821008:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071555.396174:0:3644:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783071545/real 1783071545] req@ffff8f8a03a9c700 x1869685707668352/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783071555 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071555.396210:0:3644:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f8a03a9c700 x1869685707668352/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783071555 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783071555.396229:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8f8a01e3f000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1783071555.396252:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1869685707668352:0@lo:39:umount.0 00000100:00080000:1.0:1783071555.397010:0:15499:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1783071555.397018:0:15499:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1783071555.397024:0:15499:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1783071555.400667:0:15499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461400/0x6b58994c2cbdc032 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc039 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071555.400710:0:15499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461400/0x6b58994c2cbdc032 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdc039 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071555.400718:0:15499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461400/0x6b58994c2cbdc032 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x6b58994c2cbdc039 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071555.400725:0:15499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461400/0x6b58994c2cbdc032 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x6b58994c2cbdc039 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071555.400840:0:15499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783071555.400852:0:15499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8a01749200/0x6b58994c2cbdc2b6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc2bd expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071555.400859:0:15499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8a01749200/0x6b58994c2cbdc2b6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdc2bd expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071555.400864:0:15499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8a01749200/0x6b58994c2cbdc2b6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6b58994c2cbdc2bd expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071555.400871:0:15499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.138@tcp lock: ffff8f8a01749200/0x6b58994c2cbdc2b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6b58994c2cbdc2bd expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071555.405584:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783071555.405601:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461400/0x6b58994c2cbdc032 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x6b58994c2cbdc039 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071555.405613:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b3c461400 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:3.0:1783071555.405617:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461400/0x6b58994c2cbdc032 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x6b58994c2cbdc039 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071555.405628:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461400/0x6b58994c2cbdc032 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x6b58994c2cbdc039 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783071555.405635:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461400/0x6b58994c2cbdc032 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x6b58994c2cbdc039 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783071555.405640:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783071555.405643:0:6504:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:3.0:1783071555.405659:0:6504:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f8b06c52000 00010000:00010000:3.0:1783071555.405663:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461400/0x6b58994c2cbdc032 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x6b58994c2cbdc039 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071555.405669:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461400/0x6b58994c2cbdc032 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x6b58994c2cbdc039 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071555.405688:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783071555.405692:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8a01749200/0x6b58994c2cbdc2b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6b58994c2cbdc2bd expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071555.405697:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01749200 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:3.0:1783071555.405700:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8a01749200/0x6b58994c2cbdc2b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6b58994c2cbdc2bd expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071555.405741:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8a01749200/0x6b58994c2cbdc2b6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x6b58994c2cbdc2bd expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783071555.405748:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8a01749200/0x6b58994c2cbdc2b6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x6b58994c2cbdc2bd expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783071555.405754:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1783071555.405756:0:6504:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1783071555.405762:0:6504:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f8b06c52000 00010000:00010000:3.0:1783071555.405765:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8a01749200/0x6b58994c2cbdc2b6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x6b58994c2cbdc2bd expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071555.405772:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071555.405774:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071555.405775:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071555.405856:0:15499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1783071555.405874:0:15499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8a01749200/0x6b58994c2cbdc2b6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x6b58994c2cbdc2bd expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783071555.405887:0:15499:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:1.0:1783071555.405893:0:15499:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:1.0:1783071555.405896:0:15499:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00010000:00010000:3.0:1783071555.405942:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1783071555.405942:0:15499:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1783071555.405948:0:15499:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1783071555.405956:0:15499:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783071555.405962:0:15499:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1783071555.405965:0:15499:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff8f8a017dcd40) has no exports 00000020:00080000:1.0:1783071555.405993:0:15499:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff8f8a017dcd40) has no exports 00000020:01000000:1.0:1783071555.407693:0:15499:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8f8b34ff9f60 - data ffff8f8a019020d8/ffff8f8a01791800 00000020:01000000:1.0:1783071555.407819:0:15499:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8f8b3b621420 - data ffff8f8b2bab8a20/ffff8f8b3eb76c00 00100000:10000000:0.0:1783071555.418302:0:15499:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1783071555.430791:0:15499:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6b58994c2cbdbd84 00000020:00000080:1.0:1783071555.430806:0:15499:0:(genops.c:906:class_export_put()) final put ffff8f8b34e2a000/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1783071555.430830:0:15499:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f8b069b2000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1783071555.430834:0:15499:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8f8b069b2000 2 00000020:01000004:1.0:1783071555.430838:0:15499:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8f8b069b2000 from lustre-OST0000 00000020:00000080:1.0:1783071555.430864:0:15499:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783071555.430875:0:15499:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1783071555.430878:0:15499:0:(genops.c:906:class_export_put()) final put ffff8f8b34e2c000/lustre-OST0000_UUID 00000020:00000080:1.0:1783071555.430881:0:15499:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8b34e2c000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1783071555.430887:0:15499:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1783071555.430940:0:15499:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1783071555.430945:0:15499:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1783071555.430950:0:15499:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783071555.430954:0:15499:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1783071555.430961:0:15499:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8f8a01e4e800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783071555.430966:0:15499:0:(genops.c:1574:class_disconnect_exports()) OBD device 19 (ffff8f8a017d99c0) has exports, disconnecting them 00000020:00080000:1.0:1783071555.430971:0:15499:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8f8a01e4e800), last request at 1783071333 00000020:00000080:1.0:1783071555.430975:0:15499:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6b58994c2cbdbdae 00000020:00080000:1.0:1783071555.430983:0:15499:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f8a01e4e800): rc 0 00000020:00000080:1.0:1783071555.430987:0:15499:0:(genops.c:906:class_export_put()) final put ffff8f8a01e4e800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1783071555.431760:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8b34e2a000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1783071555.431775:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8a01e4e800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1783071555.435437:0:15499:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1783071555.435448:0:15499:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783071555.435453:0:15499:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1783071555.435461:0:15499:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783071555.435644:0:15499:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783071555.435654:0:15499:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1783071555.435662:0:15499:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1783071555.435667:0:15499:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783071555.435685:0:15499:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1783071555.435693:0:15499:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8f8a01e3a800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783071555.435700:0:15499:0:(genops.c:1574:class_disconnect_exports()) OBD device 20 (ffff8f8b34573380) has exports, disconnecting them 00000020:00080000:2.0:1783071555.435705:0:15499:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8f8a01e3a800), last request at 1783071333 00000020:00000080:2.0:1783071555.435710:0:15499:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6b58994c2cbdbdc3 00000020:00080000:2.0:1783071555.435737:0:15499:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f8a01e3a800): rc 0 00000020:00000080:2.0:1783071555.435743:0:15499:0:(genops.c:906:class_export_put()) final put ffff8f8a01e3a800/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1783071555.436423:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f8a01e4c800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1783071555.436432:0:8:0:(genops.c:906:class_export_put()) final put ffff8f8a01e4f800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1783071555.436435:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8a01e4f800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1783071555.436443:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1783071555.436514:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8a01e3a800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1783071555.436537:0:15499:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1783071555.436540:0:15499:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1783071555.436543:0:15499:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1783071555.436547:0:15499:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783071555.436571:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f8a01e3f000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1783071555.436674:0:15499:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783071555.436682:0:15499:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1783071555.436686:0:15499:0:(genops.c:906:class_export_put()) final put ffff8f8a01e38000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1783071555.436688:0:15499:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8a01e38000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1783071555.436692:0:15499:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1783071555.436718:0:15499:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8f8b069b2000 1 00000020:00000080:3.0:1783071555.436724:0:15499:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6b58994c2cbdbd4c 00000020:00000080:3.0:1783071555.436739:0:15499:0:(genops.c:906:class_export_put()) final put ffff8f8b34e4d800/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1783071555.436747:0:15499:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1783071555.436754:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8b34e4d800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1783071555.436763:0:15499:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783071555.436767:0:15499:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1783071555.436769:0:15499:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff8f8b078e3380) has no exports 00000020:00000080:3.0:1783071555.477747:0:15499:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783071555.477762:0:15499:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1783071555.477768:0:15499:0:(genops.c:906:class_export_put()) final put ffff8f8b07896000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1783071555.477773:0:15499:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8b07896000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1783071555.477782:0:15499:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1783071555.477924:0:15499:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff8f8b069b0000 00000020:02000400:3.0:1783071555.477974:0:15499:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1783071555.843957:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783071556.421086:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) feaa1501-b927-4e07-baad-3200e92d7497->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783071556.421096:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) feaa1501-b927-4e07-baad-3200e92d7497->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783071556.421100:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783071556.421104:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783071556.421181:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783071556.421204:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1869685707668992:0@lo:400:kworker.0 00000400:00000100:2.0:1783071556.421262:0:3648:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869685707668992 offset 0 length 224: 4 00010000:00010000:3.0:1783071556.866683:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071557.890575:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071558.915196:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1783071558.964656:0:15701:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1783071558.972939:0:15701:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1783071558.973038:0:15701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8a01748e00/0x6b58994c2cbdc008 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc00f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071558.973056:0:15701:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8a01748e00/0x6b58994c2cbdc008 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdc00f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071558.973064:0:15701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8a01748e00/0x6b58994c2cbdc008 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x6b58994c2cbdc00f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071558.973071:0:15701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.138@tcp lock: ffff8f8a01748e00/0x6b58994c2cbdc008 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x6b58994c2cbdc00f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071558.973134:0:15701:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1783071558.973142:0:15701:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1783071558.973174:0:15701:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783071558.973188:0:15701:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f8a02e43100 x1869685707668480/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783071566 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071558.973215:0:15701:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1783071558.973223:0:15701:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1783071558.973230:0:15701:0:(import.c:65:import_set_state_nolock()) ffff8f8a023e4000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1783071558.973236:0:15701:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783071558.973239:0:15701:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f8a02e43100 x1869685707668480/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783071566 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071558.973246:0:15701:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1783071558.973249:0:15701:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 10s for inflight to error out 00000100:00100000:1.0:1783071558.973333:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02e43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1869685707668480:0@lo:38:kworker.0 00000100:00080000:0.0:1783071558.974319:0:15701:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783071558.974329:0:15701:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f8a02e42300 x1869685707668608/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071562 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071558.974460:0:15701:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f8a03a9dc00 x1869685707668864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071567 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071558.974470:0:15701:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f8a032e5c00 x1869685707668992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071572 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071558.974484:0:15701:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1783071558.974489:0:15701:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1783071558.974512:0:15701:0:(import.c:65:import_set_state_nolock()) ffff8f8a023e6800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1783071558.974569:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01766d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1869685707669120:0@lo:39:umount.0 00000400:00000100:0.0:1783071558.974627:0:3644:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869685707669120 offset 0 length 224: 4 00010000:00010000:3.0:1783071558.974745:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783071558.974756:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8a01748e00/0x6b58994c2cbdc008 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x6b58994c2cbdc00f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071558.974765:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01748e00 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:3.0:1783071558.974769:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8a01748e00/0x6b58994c2cbdc008 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x6b58994c2cbdc00f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071558.974790:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8a01748e00/0x6b58994c2cbdc008 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x6b58994c2cbdc00f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783071558.974797:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8a01748e00/0x6b58994c2cbdc008 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x6b58994c2cbdc00f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783071558.974803:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783071558.974806:0:6504:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1783071558.974808:0:6504:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1783071558.974823:0:6504:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f8b06c52000 00010000:00010000:3.0:1783071558.974827:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8a01748e00/0x6b58994c2cbdc008 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x6b58994c2cbdc00f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071558.974834:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8a01748e00/0x6b58994c2cbdc008 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x6b58994c2cbdc00f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071558.974844:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071558.974846:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071558.974848:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071558.974866:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1869685707668992:0@lo:400:kworker.0 00000100:00100000:1.0:1783071558.974974:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02e42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1869685707668608:0@lo:400:kworker.0 00000100:00100000:1.0:1783071558.974987:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1869685707668864:0@lo:400:kworker.0 00010000:00010000:1.0:1783071559.939018:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071560.963412:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783071561.539014:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) feaa1501-b927-4e07-baad-3200e92d7497->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783071561.539025:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) feaa1501-b927-4e07-baad-3200e92d7497->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1783071561.986875:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071563.010610:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071564.034806:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071565.058699:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071566.082571:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071566.146629:0:3644:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783071551/real 1783071551] req@ffff8f8a03a9e680 x1869685707668736/t0(0) o250->MGC192.168.204.138@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783071566 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071566.146664:0:3644:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f8a03a9e680 x1869685707668736/t0(0) o250->MGC192.168.204.138@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783071566 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783071566.146686:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8f8b06c52000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783071566.146717:0:3644:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1783071566.146722:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:feaa1501-b927-4e07-baad-3200e92d7497:3644:1869685707668736:0@lo:250:kworker.0 00000100:00080000:1.0:1783071566.146958:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) feaa1501-b927-4e07-baad-3200e92d7497->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783071566.146965:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1783071566.146968:0:38:0:(import.c:65:import_set_state_nolock()) ffff8f8b06c52000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783071566.146972:0:38:0:(import.c:512:import_select_connection()) MGC192.168.204.138@tcp: connect to NID 0@lo last attempt 453 00000100:00080000:1.0:1783071566.146989:0:38:0:(import.c:591:import_select_connection()) MGC192.168.204.138@tcp: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783071566.146997:0:38:0:(import.c:626:import_select_connection()) MGC192.168.204.138@tcp: import ffff8f8b06c52000 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:1.0:1783071566.147036:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8a03a9dc00 x1869685707669248/t0(0) o250->MGC192.168.204.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783071566.147582:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:feaa1501-b927-4e07-baad-3200e92d7497:3644:1869685707669248:0@lo:250:kworker.0 00000400:00000100:0.0:1783071566.147639:0:3644:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869685707669248 offset 0 length 520: 4 00010000:00010000:3.0:1783071567.106969:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071568.130711:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071568.195466:0:3644:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783071558/real 1783071558] req@ffff8f8a01766d80 x1869685707669120/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783071568 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071568.195509:0:3644:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f8a01766d80 x1869685707669120/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783071568 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783071568.195534:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8f8a023e6800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1783071568.195573:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01766d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1869685707669120:0@lo:39:umount.0 00000100:00080000:1.0:1783071568.195784:0:15701:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1783071568.195790:0:15701:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1783071568.195796:0:15701:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1783071568.196722:0:15701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b10967800/0x6b58994c2cbdc016 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc01d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071568.196738:0:15701:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b10967800/0x6b58994c2cbdc016 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdc01d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071568.196746:0:15701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b10967800/0x6b58994c2cbdc016 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6b58994c2cbdc01d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071568.196766:0:15701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.138@tcp lock: ffff8f8b10967800/0x6b58994c2cbdc016 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6b58994c2cbdc01d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071568.196788:0:15701:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783071568.196795:0:15701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66000/0x6b58994c2cbdc2a8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdc2af expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071568.196802:0:15701:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66000/0x6b58994c2cbdc2a8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdc2af expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071568.196808:0:15701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66000/0x6b58994c2cbdc2a8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6b58994c2cbdc2af expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071568.196814:0:15701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66000/0x6b58994c2cbdc2a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6b58994c2cbdc2af expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071568.196838:0:15701:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1783071568.196843:0:15701:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1783071568.196869:0:15701:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1783071568.196873:0:15701:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1783071568.196878:0:15701:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783071568.196883:0:15701:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1783071568.196888:0:15701:0:(genops.c:1579:class_disconnect_exports()) OBD device 24 (ffff8f8b3b5c4d40) has no exports 00010000:00010000:2.0:1783071568.196890:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783071568.196897:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8b10967800/0x6b58994c2cbdc016 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6b58994c2cbdc01d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071568.196904:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b10967800 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:2.0:1783071568.196908:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8b10967800/0x6b58994c2cbdc016 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6b58994c2cbdc01d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783071568.196911:0:15701:0:(genops.c:1579:class_disconnect_exports()) OBD device 24 (ffff8f8b3b5c4d40) has no exports 00010000:00010000:2.0:1783071568.196917:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8b10967800/0x6b58994c2cbdc016 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x6b58994c2cbdc01d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783071568.196925:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8b10967800/0x6b58994c2cbdc016 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x6b58994c2cbdc01d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071568.196941:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783071568.196944:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1783071568.196946:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1783071568.196959:0:6505:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f8b06c52000 00010000:00010000:2.0:1783071568.196963:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8b10967800/0x6b58994c2cbdc016 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x6b58994c2cbdc01d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071568.196970:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8b10967800/0x6b58994c2cbdc016 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x6b58994c2cbdc01d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071568.196984:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783071568.196988:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66000/0x6b58994c2cbdc2a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6b58994c2cbdc2af expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071568.196993:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd66000 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:2.0:1783071568.196996:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66000/0x6b58994c2cbdc2a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6b58994c2cbdc2af expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071568.197002:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66000/0x6b58994c2cbdc2a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x6b58994c2cbdc2af expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783071568.197009:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66000/0x6b58994c2cbdc2a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x6b58994c2cbdc2af expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071568.197014:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1783071568.197016:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1783071568.197017:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1783071568.197020:0:6505:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f8b06c52000 00010000:00010000:2.0:1783071568.197023:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66000/0x6b58994c2cbdc2a8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x6b58994c2cbdc2af expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071568.197036:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66000/0x6b58994c2cbdc2a8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x6b58994c2cbdc2af expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071568.197049:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071568.197050:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071568.197052:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071568.197583:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1783071568.198676:0:15701:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8f8a0317ad20 - data ffff8f8a019e5a20/ffff8f8b3c663000 00000020:01000000:1.0:1783071568.198852:0:15701:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8f8b3b621240 - data ffff8f8a0180e5e8/ffff8f8a03334000 00100000:10000000:1.0:1783071568.210190:0:15701:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1783071568.222089:0:15701:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6b58994c2cbdbeaa 00000020:00000080:1.0:1783071568.222117:0:15701:0:(genops.c:906:class_export_put()) final put ffff8f8a023e1800/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1783071568.222147:0:15701:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f8b34e49800 from lustre-OST0001, refs=2 00000020:01000004:1.0:1783071568.222150:0:15701:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8f8b34e49800 2 00000020:01000004:1.0:1783071568.222154:0:15701:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8f8b34e49800 from lustre-OST0001 00000020:00000080:1.0:1783071568.222177:0:15701:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783071568.222192:0:15701:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1783071568.222195:0:15701:0:(genops.c:906:class_export_put()) final put ffff8f8b106d7000/lustre-OST0001_UUID 00000020:00000080:1.0:1783071568.222198:0:15701:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8b106d7000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1783071568.222205:0:15701:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1783071568.222348:0:15701:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import feaa1501-b927-4e07-baad-3200e92d7497->MGS 00010000:00010000:1.0:1783071568.222382:0:15701:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8b00030200/0x6b58994c2cbdbc03 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x6b58994c2cbdbc0a expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783071568.222395:0:15701:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8b00030200/0x6b58994c2cbdbc03 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x6b58994c2cbdbc0a expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783071568.222403:0:15701:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1783071568.222405:0:15701:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1783071568.222410:0:15701:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1783071568.222425:0:15701:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f8b06c52000 00010000:00010000:1.0:1783071568.222429:0:15701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8b00030200/0x6b58994c2cbdbc03 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x6b58994c2cbdbc0a expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071568.222446:0:15701:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460600/0x6b58994c2cbdc078 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x6b58994c2cbdc07f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783071568.222454:0:15701:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460600/0x6b58994c2cbdc078 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x6b58994c2cbdc07f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783071568.222459:0:15701:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783071568.222462:0:15701:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1783071568.222464:0:15701:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1783071568.222480:0:15701:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f8b06c52000 00010000:00010000:1.0:1783071568.222483:0:15701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8b3c460600/0x6b58994c2cbdc078 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x6b58994c2cbdc07f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783071568.222510:0:15701:0:(import.c:65:import_set_state_nolock()) ffff8f8b06c52000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1783071568.222515:0:15701:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1783071568.222517:0:15701:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1783071568.222519:0:15701:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1783071568.222524:0:15701:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1783071568.222535:0:15701:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f8a03a9dc00 x1869685707669248/t0(0) o250->MGC192.168.204.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1783071586 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1783071568.222564:0:15701:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1783071568.222567:0:15701:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 24s for inflight to error out 00000100:00100000:3.0:1783071568.222684:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:feaa1501-b927-4e07-baad-3200e92d7497:3644:1869685707669248:0@lo:250:kworker.0 00000020:00000080:2.0:1783071568.222786:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8a023e1800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:01000000:1.0:1783071568.222903:0:15701:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1783071568.222911:0:15701:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6b58994c2cbdbb00 00000020:00000080:1.0:1783071568.222916:0:15701:0:(genops.c:906:class_export_put()) final put ffff8f8b06c52800/feaa1501-b927-4e07-baad-3200e92d7497 00000020:01000000:1.0:1783071568.222959:0:15701:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGC192.168.204.138@tcp (flags='') 00000020:00000080:1.0:1783071568.222965:0:15701:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783071568.222970:0:15701:0:(obd_config.c:955:class_cleanup()) MGC192.168.204.138@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1783071568.222974:0:15701:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff8f8b06c74d40) has no exports 10000000:01000000:3.0:1783071568.223040:0:6513:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1783071568.224352:0:15701:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.204.138@tcp: client import never connected 00000100:00080000:1.0:1783071568.224361:0:15701:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1783071568.224376:0:15701:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1783071568.224379:0:15701:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1783071568.224382:0:15701:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1783071568.227336:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8b06c52800/feaa1501-b927-4e07-baad-3200e92d7497 for MGC192.168.204.138@tcp 00000020:00000080:1.0:1783071568.227886:0:15701:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783071568.227900:0:15701:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.138@tcp (uuid feaa1501-b927-4e07-baad-3200e92d7497) 00000020:01000000:1.0:1783071568.227911:0:15701:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1783071568.227918:0:15701:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783071568.227924:0:15701:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1783071568.227934:0:15701:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8f8a023e7800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783071568.227941:0:15701:0:(genops.c:1574:class_disconnect_exports()) OBD device 25 (ffff8f8b3c6cb380) has exports, disconnecting them 00000020:00080000:1.0:1783071568.227964:0:15701:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8f8a023e7800), last request at 1783071353 00000020:00000080:1.0:1783071568.227971:0:15701:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6b58994c2cbdbed4 00000020:00000080:2.0:1783071568.228071:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f8b06c52000 for MGC192.168.204.138@tcp 00000020:00000080:2.0:1783071568.228080:0:38:0:(genops.c:906:class_export_put()) final put ffff8f8b06c57000/feaa1501-b927-4e07-baad-3200e92d7497 00000020:00000080:2.0:1783071568.228083:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8b06c57000/feaa1501-b927-4e07-baad-3200e92d7497 for MGC192.168.204.138@tcp 00000020:01000000:2.0:1783071568.228089:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.138@tcp (feaa1501-b927-4e07-baad-3200e92d7497) 00000020:00080000:1.0:1783071568.228134:0:15701:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f8a023e7800): rc 0 00000020:00000080:1.0:1783071568.228140:0:15701:0:(genops.c:906:class_export_put()) final put ffff8f8a023e7800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1783071568.229077:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8a023e7800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1783071568.231517:0:15701:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1783071568.231527:0:15701:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783071568.231532:0:15701:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1783071568.231539:0:15701:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783071568.231730:0:15701:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783071568.231740:0:15701:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:3.0:1783071568.231747:0:15701:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1783071568.231754:0:15701:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783071568.231758:0:15701:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1783071568.231765:0:15701:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff8f8a023e1000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783071568.231772:0:15701:0:(genops.c:1574:class_disconnect_exports()) OBD device 26 (ffff8f8b3b5c19c0) has exports, disconnecting them 00000020:00080000:3.0:1783071568.231777:0:15701:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff8f8a023e1000), last request at 1783071353 00000020:00000080:3.0:1783071568.231782:0:15701:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6b58994c2cbdbee9 00000020:00080000:3.0:1783071568.231798:0:15701:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f8a023e1000): rc 0 00000020:00000080:3.0:1783071568.231805:0:15701:0:(genops.c:906:class_export_put()) final put ffff8f8a023e1000/lustre-MDT0001-lwp-OST0001 00000020:00000080:2.0:1783071568.232139:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f8a023e4000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1783071568.232147:0:38:0:(genops.c:906:class_export_put()) final put ffff8f8a01e3e000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1783071568.232150:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8a01e3e000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1783071568.232156:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1783071568.232218:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8a023e1000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:2.0:1783071568.234459:0:15701:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:2.0:1783071568.234470:0:15701:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1783071568.234474:0:15701:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1783071568.234482:0:15701:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783071568.234527:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f8a023e6800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:2.0:1783071568.234579:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1783071568.234872:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:2.0:1783071568.235107:0:6499:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8f8b1f86ac00:6499] 0 exiting: rc = 1 00000100:00100000:2.0:1783071568.235173:0:6500:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8f8b1f86a200:6500] 1 exiting: rc = 0 00000100:00100000:2.0:1783071568.235238:0:13184:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff8f8b3c79b200:13184] 2 exiting: rc = 0 00000100:00100000:2.0:1783071568.235301:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.235578:0:6501:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8f8b1f86aa00:6501] 0 exiting: rc = 1 00000100:00100000:2.0:1783071568.235659:0:7923:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8f8b34fcbe00:7923] 3 exiting: rc = 0 00000100:00100000:2.0:1783071568.235739:0:6503:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8f8b04faee00:6503] 2 exiting: rc = 0 00000100:00100000:2.0:1783071568.236167:0:6502:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8f8b1f86a800:6502] 1 exiting: rc = 0 00000100:00100000:2.0:1783071568.236223:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.236231:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.236237:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.236243:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.236249:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.236254:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.236259:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.236264:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.236271:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.236277:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.236283:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.236288:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.236293:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.236300:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.236307:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.236312:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.236318:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.236325:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.236331:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.236337:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.236343:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.236348:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.236354:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.236359:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.236386:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.236391:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.236397:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.236413:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.236418:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.236423:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.236429:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.236434:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.236440:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.236445:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.236451:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.236457:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.236462:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.236467:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.236473:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.236478:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.236482:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.236498:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.236503:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.236509:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.236515:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.236520:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.236525:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.236530:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.236536:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.236541:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.236546:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.236552:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.236557:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.236563:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.236569:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.236574:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.236579:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.236584:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.236589:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.236594:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.236598:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.236604:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.236616:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.236621:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1783071568.255772:0:15701:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783071568.255799:0:15701:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:2.0:1783071568.255809:0:15701:0:(genops.c:906:class_export_put()) final put ffff8f8a023e5800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:2.0:1783071568.255814:0:15701:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8a023e5800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:2.0:1783071568.255824:0:15701:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:2.0:1783071568.255885:0:15701:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8f8b34e49800 1 00000020:00000080:2.0:1783071568.255892:0:15701:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6b58994c2cbdbe79 00000020:00000080:2.0:1783071568.255898:0:15701:0:(genops.c:906:class_export_put()) final put ffff8f8a02130000/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1783071568.255912:0:15701:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1783071568.255926:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8a02130000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1783071568.255941:0:15701:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783071568.255947:0:15701:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1783071568.255952:0:15701:0:(genops.c:1579:class_disconnect_exports()) OBD device 23 (ffff8f8b3b5c3380) has no exports 00000020:00000080:0.0:1783071568.290053:0:15701:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783071568.290068:0:15701:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1783071568.290073:0:15701:0:(genops.c:906:class_export_put()) final put ffff8f8b3c6ee800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1783071568.290077:0:15701:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8b3c6ee800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1783071568.290084:0:15701:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1783071568.290521:0:15701:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff8f8b3c6e8000 00000020:01000000:0.0:1783071568.290542:0:15701:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1783071568.290546:0:15701:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783071568.290550:0:15701:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1783071568.290553:0:15701:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff8f8b34570000) has no exports 00000020:00000080:0.0:1783071568.290663:0:15701:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783071568.290670:0:15701:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1783071568.290672:0:15701:0:(genops.c:906:class_export_put()) final put ffff8f8b34e4b000/OSS_uuid 00000020:00000080:0.0:1783071568.290675:0:15701:0:(genops.c:865:class_export_destroy()) destroying export ffff8f8b34e4b000/OSS_uuid for OSS 00000020:01000000:0.0:1783071568.290679:0:15701:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:3.0:1783071568.290818:0:6512:0:(pinger.c:550:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1783071568.290927:0:8910:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8f8b3c79ac00:8910] 3 exiting: rc = 0 00000100:00100000:3.0:1783071568.290971:0:8432:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8f8b3c4ef000:8432] 2 exiting: rc = 0 00000100:00100000:0.0:1783071568.291120:0:8429:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8f8b1f0a1a00:8429] 0 exiting: rc = 1 00000100:00100000:3.0:1783071568.291138:0:8431:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8f8b3c4efa00:8431] 1 exiting: rc = 0 00000100:00100000:0.0:1783071568.291198:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.291208:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.291214:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.291221:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.291227:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.291233:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.291238:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.291243:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.291248:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.291254:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.291259:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.291264:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.291270:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.291275:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.291281:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.291286:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.291303:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.291309:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.291316:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.291321:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.291326:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.291332:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.291337:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.291342:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.291348:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.291354:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.291359:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.291522:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.291529:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.291534:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.291540:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.291552:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.291558:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.291575:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.291580:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.291586:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.291591:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.291596:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.291601:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.291606:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.291612:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.291617:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.291622:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.291628:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.291633:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.291639:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.291644:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.291650:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.291655:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.291662:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.291667:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.291680:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.291686:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.291691:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.291696:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.291707:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.291714:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.291720:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.291725:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.291731:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.291736:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.291741:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.291747:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.291753:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.292616:0:8434:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8f8b109c7200:8434] 1 exiting: rc = 0 00000100:00100000:3.0:1783071568.292796:0:8433:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8f8b34f94800:8433] 0 exiting: rc = 1 00000100:00100000:3.0:1783071568.292844:0:12254:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff8f8a0301cc00:12254] 2 exiting: rc = 0 00000100:00100000:0.0:1783071568.292952:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.292957:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.292962:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.292966:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.292969:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.292973:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.292976:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.292979:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.292983:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.292986:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.292989:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.292991:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.292995:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.292997:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.293000:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.293004:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.293007:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.293011:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.293014:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.293017:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.293020:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.293023:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.293035:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.293038:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.293041:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.293045:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.293048:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.293051:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.293054:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.293057:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.293061:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.293063:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.293066:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.293069:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.293096:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.293100:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.293103:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.293106:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.293109:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.293112:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.293115:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.293118:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.293121:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.293124:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.293127:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.293130:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.293133:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.293136:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.293139:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.293142:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.293145:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.293149:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.293152:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.293154:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.293157:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.293161:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.293165:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.293172:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.293175:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.293178:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.293181:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.293184:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.293187:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.293193:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.294259:0:8436:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8f8b3c50b000:8436] 1 exiting: rc = 0 00000100:00100000:1.0:1783071568.294275:0:8437:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8f8b3c50ba00:8437] 2 exiting: rc = 0 00000100:00100000:3.0:1783071568.294552:0:8435:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8f8b3c50b600:8435] 0 exiting: rc = 1 00000100:00100000:0.0:1783071568.294772:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.294779:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.294786:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.294793:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.294798:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.294804:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.294810:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.294816:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.294822:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.294829:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.294834:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.294840:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.294846:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.294852:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.294857:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.294862:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.294867:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.294872:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.294878:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.294896:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.294903:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.294910:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.294915:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.294921:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.294928:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.294934:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.294940:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.294945:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.294963:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.294969:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.294976:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.294981:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.294987:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.294993:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.294999:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.295005:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.295011:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.295017:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.295024:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.295031:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.295037:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.295042:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.295047:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.295068:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.295074:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.295081:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.295086:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.295092:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.295098:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.295103:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.295108:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.295114:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.295120:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.295126:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.295131:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.295137:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.295143:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.295148:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.295155:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.295172:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.295179:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.295185:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.295190:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.295208:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071568.302204:0:8439:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8f8b057ec800:8439] 1 exiting: rc = 0 00000100:00100000:1.0:1783071568.302305:0:8438:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8f8b057edc00:8438] 0 exiting: rc = 1 00000100:00100000:0.0:1783071568.302421:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.302429:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.302434:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.302439:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.302445:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.302450:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.302456:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.302462:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.302468:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.302473:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.302478:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.302492:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.302498:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.302503:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.302510:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.302515:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.302521:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.302527:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.302532:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.302538:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.302544:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.302550:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.302556:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.302561:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.302567:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.302581:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.302587:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.302593:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.302598:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.302603:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.302609:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.302615:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.302620:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.302626:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.302647:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.302652:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.302656:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.302661:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.302666:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.302670:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.302675:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.302680:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.302684:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.302689:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.302695:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.302701:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.302707:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.302713:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.302718:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.302723:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.302728:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.302733:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.302739:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.302743:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.302749:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.302754:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.302759:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.302765:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.302770:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.302776:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.302781:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.302787:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.302793:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.302798:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.303818:0:8440:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8f8b3c519200:8440] 0 exiting: rc = 1 00000100:00100000:0.0:1783071568.305234:0:8441:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8f8b3c51fe00:8441] 1 exiting: rc = 0 00000100:00100000:0.0:1783071568.305321:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.305329:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.305335:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.305353:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.305393:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.305401:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.305407:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.305413:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.305419:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.305425:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.305432:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.305438:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.305445:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.305451:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.305457:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.305464:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.305497:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.305506:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.305512:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.305519:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.305525:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.305531:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.305537:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.305543:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.305549:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.305555:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.305562:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.305569:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.305598:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.305606:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.305611:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.305618:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.305624:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.305630:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.305636:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.305642:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.305648:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.305654:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.305668:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.305673:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.305692:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.305698:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.305704:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.305710:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.305715:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.305722:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.305727:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.305733:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.305739:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.305745:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.305751:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.305757:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.305779:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.305786:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.305792:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.305798:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.305805:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.305811:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.305818:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.305830:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.305837:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.305843:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.305849:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071568.305855:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1783071568.317304:0:15701:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1783071586.414111:0:16465:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg438-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1783071596.274536:0:17065:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:3.0:1783071596.274558:0:17065:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1783071596.274560:0:17065:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1783071596.274873:0:17065:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8f8a041ea000 00000020:01000004:3.0:1783071596.274975:0:17065:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1783071596.274987:0:17065:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1783071596.275008:0:17065:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8f8a033619c0) 00000020:00000080:3.0:1783071596.275027:0:17065:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1783071596.418419:0:17065:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1783071596.420147:0:17065:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1783071596.421494:0:17065:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1783071596.422216:0:17065:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1783071596.422461:0:17065:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1783071596.423862:0:17065:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1783071596.424560:0:17065:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:1.0:1783071596.424826:0:17065:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1783071596.425416:0:17065:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1783071596.425652:0:17065:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1783071596.426208:0:17065:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:1.0:1783071596.426601:0:17065:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1783071596.426975:0:17065:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1783071596.427395:0:17065:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:0.0:1783071596.430931:0:17065:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:0.0:1783071596.432829:0:17065:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1783071596.433324:0:17065:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1783071596.433651:0:17065:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1783071596.433944:0:17065:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1783071596.434482:0:17065:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1783071596.435227:0:17065:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1783071596.435548:0:17065:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1783071596.435866:0:17065:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1783071596.436309:0:17065:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1783071596.436758:0:17065:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1783071596.437015:0:17065:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1783071596.437399:0:17065:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1783071596.437613:0:17065:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1783071596.437942:0:17065:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1783071596.438327:0:17065:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1783071596.438640:0:17065:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1783071596.438928:0:17065:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1783071596.439360:0:17065:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1783071596.439640:0:17065:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1783071596.440156:0:17065:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1783071596.440535:0:17065:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1783071596.440843:0:17065:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1783071596.441350:0:17065:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1783071596.441614:0:17065:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1783071596.441964:0:17065:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1783071596.442432:0:17065:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1783071596.442648:0:17065:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1783071596.443079:0:17065:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1783071596.443454:0:17065:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1783071596.444455:0:17065:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:0.0:1783071596.445148:0:17065:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:0.0:1783071596.445602:0:17065:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:0.0:1783071596.449489:0:17065:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:0.0:1783071596.450530:0:17065:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:0.0:1783071596.451194:0:17065:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:0.0:1783071596.452185:0:17065:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:0.0:1783071596.452425:0:17065:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:0.0:1783071596.452623:0:17065:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:0.0:1783071596.453650:0:17065:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1783071596.453937:0:17065:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1783071596.453947:0:17065:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:0.0:1783071596.453973:0:17065:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6b58994c2cbdd0bd 00000020:01000004:0.0:1783071596.453984:0:17065:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1783071596.453991:0:17065:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1783071596.453997:0:17065:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8f8a041ea000 from MGS 00000020:01000004:0.0:1783071596.454002:0:17065:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1783071596.454015:0:17065:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8f8b34e60000) 00000020:00000080:0.0:1783071596.454044:0:17065:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1783071596.454123:0:17065:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f8a041ea000 from MGS, refs=2 00080000:01000000:0.0:1783071596.454128:0:17065:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:0.0:1783071596.454134:0:17065:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6b58994c2cbdd0cb 00000100:00100000:0.0:1783071596.454251:0:17065:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1783071596.454429:0:17065:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1783071596.454436:0:17065:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1783071596.455656:0:17065:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1783071596.455678:0:17065:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1783071596.457312:0:17065:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783071596.457633:0:17065:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1783071596.457640:0:17065:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1783071596.458797:0:17065:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1783071596.458811:0:17065:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1783071596.460495:0:17065:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1783071596.460527:0:17065:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1783071596.461653:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071596.461658:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071596.461660:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071596.462846:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071596.462851:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071596.462853:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071596.463898:0:17065:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1783071596.467986:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1783071596.470172:0:17065:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1783071596.471794:0:17077:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1783071596.475535:0:17065:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1783071596.475631:0:17065:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1783071596.476938:0:17065:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1783071596.477603:0:17065:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783071596.477824:0:17065:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1783071596.477832:0:17065:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1783071596.484979:0:17065:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1783071596.484998:0:17065:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1783071596.486711:0:17065:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1783071596.486730:0:17065:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1783071596.492554:0:17065:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1783071596.492578:0:17065:0:(obd_mount.c:402:lustre_start_mgc()) Start MGC 'MGC192.168.204.138@tcp' 00000020:01000004:0.0:1783071596.492580:0:17065:0:(obd_mount.c:411:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1783071596.492609:0:17065:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGC192.168.204.138@tcp (typ=mgc) 00000020:00000080:0.0:1783071596.492622:0:17065:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.138@tcp (ffff8f8b34e64d40) 00000020:00000080:0.0:1783071596.492637:0:17065:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1783071596.492718:0:17065:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f8b08ea7000@MGC192.168.204.138@tcp: add connection 192.168.204.138@tcp at head 00010000:00010000:0.0:1783071596.492865:0:17065:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.138@tcp-0 is initialized 00000040:01000000:0.0:1783071596.492872:0:17065:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.138@tcp ctxt 1 is initialized 00000100:00080000:3.0:1783071596.493196:0:17082:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1783071596.495586:0:17083:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1783071596.495680:0:17065:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.138@tcp (uuid 5ed14122-6273-4ec6-b260-6e79c239c375) 00000020:00000080:0.0:1783071596.495702:0:17065:0:(genops.c:1406:class_connect()) connect: client 5ed14122-6273-4ec6-b260-6e79c239c375, cookie 0x6b58994c2cbdd0d9 00000100:00080000:0.0:1783071596.495715:0:17065:0:(import.c:512:import_select_connection()) MGC192.168.204.138@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783071596.495722:0:17065:0:(import.c:626:import_select_connection()) MGC192.168.204.138@tcp: import ffff8f8b08ea7000 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:0.0:1783071596.495756:0:17065:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8a01765500 x1869685707669376/t0(0) o250->MGC192.168.204.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783071596.495786:0:17065:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import 5ed14122-6273-4ec6-b260-6e79c239c375->MGS 00000020:01000004:0.0:1783071596.495806:0:17065:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1783071596.495811:0:17065:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1783071596.495825:0:17065:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8f8b34e63380) 00000020:00000080:0.0:1783071596.495836:0:17065:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1783071596.498925:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5ed14122-6273-4ec6-b260-6e79c239c375:3644:1869685707669376:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1783071596.499028:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071596.499130:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707669376 00000100:00100000:3.0:1783071596.499139:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707669376 00000100:00100000:3.0:1783071596.499176:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783071596.499184:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3eb91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3644:x1869685707669376:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1783071596.499216:0:17078:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 5ed14122-6273-4ec6-b260-6e79c239c375@0@lo t0 exp 0000000000000000 cur 498 last 0 00000020:00000080:3.0:1783071596.499248:0:17078:0:(genops.c:1406:class_connect()) connect: client 5ed14122-6273-4ec6-b260-6e79c239c375, cookie 0x6b58994c2cbdd0e7 00000100:00080000:3.0:1783071596.499474:0:17078:0:(import.c:65:import_set_state_nolock()) ffff8f8b06ce8000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783071596.499528:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3eb91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+5:3644:x1869685707669376:12345-0@lo:250:mount.lustre.0 Request processed in 343us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071596.499537:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783071596.499593:0:3644:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.204.138@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1783071596.499602:0:3644:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.204.138@tcp: connect to target with instance 0 00000100:00080000:3.0:1783071596.499609:0:3644:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.204.138@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1783071596.499615:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1783071596.499619:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8f8b08ea7000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1783071596.499621:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1783071596.499632:0:3644:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1783071596.499646:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5ed14122-6273-4ec6-b260-6e79c239c375:3644:1869685707669376:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1783071596.508559:0:17065:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783071596.508751:0:17065:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1783071596.508757:0:17065:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1783071596.520145:0:17065:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1783071596.520247:0:17065:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1783071596.521749:0:17065:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1783071596.521765:0:17065:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1783071596.528571:0:17065:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783071596.529514:0:17065:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1783071596.529525:0:17065:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1783071596.536244:0:17065:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1783071596.536274:0:17065:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1783071596.617579:0:17065:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783071596.617776:0:17065:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1783071596.617783:0:17065:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1783071596.618986:0:17065:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1783071596.618998:0:17065:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1783071596.619576:0:17065:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783071596.619720:0:17065:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1783071596.619725:0:17065:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1783071596.621038:0:17065:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1783071596.621049:0:17065:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1783071596.621702:0:17065:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783071596.621854:0:17065:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1783071596.621859:0:17065:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1783071596.629978:0:17065:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1783071596.630000:0:17065:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1783071596.631190:0:17065:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783071596.631357:0:17065:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1783071596.631407:0:17065:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1783071596.631890:0:17065:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1783071596.631896:0:17065:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1783071596.653433:0:17065:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783071596.653665:0:17065:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1783071596.653672:0:17065:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1783071596.657505:0:17065:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1783071596.657526:0:17065:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1783071596.660745:0:17065:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1783071596.660762:0:17065:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1783071596.661696:0:17065:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1783071596.661723:0:17065:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1783071596.661729:0:17065:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.138@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1783071596.661826:0:17065:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.138@tcp ctxt 0 is initialized 00000020:01000004:0.0:1783071596.661863:0:17065:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.138@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1783071596.661867:0:17065:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1783071596.661869:0:17065:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783071596.661870:0:17065:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783071596.661871:0:17065:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783071596.661872:0:17065:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783071596.661873:0:17065:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783071596.661875:0:17065:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783071596.661876:0:17065:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783071596.661877:0:17065:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783071596.661879:0:17065:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783071596.661881:0:17065:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1783071596.661883:0:17065:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783071596.661885:0:17065:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783071596.661886:0:17065:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783071596.661887:0:17065:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783071596.661888:0:17065:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783071596.661889:0:17065:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783071596.661890:0:17065:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783071596.661891:0:17065:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783071596.661892:0:17065:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783071596.661894:0:17065:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783071596.661917:0:17065:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1783071596.661935:0:17065:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01766a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17065:1869685707669504:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1783071596.662017:0:17065:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071596.662250:0:17065:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b1edea240 going to sleep for 11 seconds 00000100:00100000:2.0:1783071596.663008:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707669504 00000100:00100000:2.0:1783071596.663016:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707669504 00000100:00100000:2.0:1783071596.663068:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783071596.663078:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3eb91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+5:17065:x1869685707669504:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783071596.663141:0:17081:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1783071596.663145:0:17081:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1783071596.663148:0:17081:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1783071596.663759:0:17101:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1783071596.664773:0:17081:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:0.0:1783071596.668119:0:17102:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1783071596.668128:0:17102:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1783071596.668131:0:17102:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1783071596.668134:0:17102:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1783071596.668442:0:17102:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1783071596.668662:0:17081:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1783071596.668676:0:17081:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1783071596.670389:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3eb91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+5:17065:x1869685707669504:12345-0@lo:253:mount.lustre.0 Request processed in 7274us (8333us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071596.670416:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783071596.670569:0:17065:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01766a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17065:1869685707669504:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1783071596.670583:0:17065:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1783071596.670586:0:17065:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783071596.670588:0:17065:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783071596.670590:0:17065:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783071596.670591:0:17065:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783071596.670592:0:17065:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783071596.670593:0:17065:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783071596.670595:0:17065:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783071596.670596:0:17065:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783071596.670598:0:17065:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783071596.670599:0:17065:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1783071596.670617:0:17065:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8f8a041ea000 from lustre-MDT0000 10000000:01000000:0.0:1783071596.670654:0:17065:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1783071596.670660:0:17065:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1783071596.670665:0:17065:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8f8b34e64d40 10000000:01000000:0.0:1783071596.670672:0:17065:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783071596.670680:0:17065:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff8f8b34e64d40 from 1 10000000:01000000:0.0:1783071596.670682:0:17065:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1783071596.670726:0:17065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8a03864600/0x6b58994c2cbdd0ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071596.670739:0:17065:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8a03864600/0x6b58994c2cbdd0ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071596.670748:0:17065:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8a03864600/0x6b58994c2cbdd0ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071596.670778:0:17065:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01766a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17065:1869685707669632:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783071596.670816:0:17065:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071596.671017:0:17065:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b1edea840 going to sleep for 11 seconds 00000100:00100000:1.0:1783071596.671337:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707669632 00000100:00100000:1.0:1783071596.671344:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707669632 00000100:00100000:1.0:1783071596.671640:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783071596.671651:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3eb93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+5:17065:x1869685707669632:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783071596.671665:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071596.671681:0:17079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8a03bd6a00/0x6b58994c2cbdd0f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdd0ee expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071596.671706:0:17079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8a03bd6a00/0x6b58994c2cbdd0f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdd0ee expref: 6 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071596.671717:0:17079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8a03bd6a00/0x6b58994c2cbdd0f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdd0ee expref: 6 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071596.671725:0:17079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a03bd6a00, rc 0) 00000100:00100000:1.0:1783071596.671875:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3eb93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+6:17065:x1869685707669632:12345-0@lo:101:mount.lustre.0 Request processed in 227us (1059us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071596.671880:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783071596.671996:0:17065:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01766a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17065:1869685707669632:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783071596.672012:0:17065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8a03864600/0x6b58994c2cbdd0ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd0f5 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071596.672021:0:17065:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8a03864600/0x6b58994c2cbdd0ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdd0f5 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071596.672087:0:17065:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01766a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17065:1869685707669760:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783071596.672180:0:17065:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071596.672210:0:17065:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b1edea840 going to sleep for 11 seconds 00000100:00100000:2.0:1783071596.672401:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707669760 00000100:00100000:2.0:1783071596.672406:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707669760 00000100:00100000:2.0:1783071596.672440:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783071596.672447:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3eb90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+6:17065:x1869685707669760:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783071596.672535:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3eb90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+6:17065:x1869685707669760:12345-0@lo:501:mount.lustre.0 Request processed in 89us (355us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783071596.672542:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783071596.672633:0:17065:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01766a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17065:1869685707669760:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1783071596.672659:0:17065:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1783071596.672716:0:17065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8a03864600/0x6b58994c2cbdd0ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd0f5 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071596.672726:0:17065:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8a03864600/0x6b58994c2cbdd0ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd0f5 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783071596.672734:0:17065:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f8a041ea000 10000000:01000000:0.0:1783071596.672739:0:17065:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1783071596.672744:0:17065:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8f8a041ea000 10000000:01000000:0.0:1783071596.672746:0:17065:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1783071596.672749:0:17065:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff8f8a041ea000 from 1 10000000:01000000:0.0:1783071596.672760:0:17065:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1783071596.672780:0:17065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8a03864e00/0x6b58994c2cbdd0fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071596.672787:0:17065:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8a03864e00/0x6b58994c2cbdd0fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071596.672796:0:17065:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8a03864e00/0x6b58994c2cbdd0fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071596.672809:0:17065:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01766a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17065:1869685707669888:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783071596.672838:0:17065:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071596.672866:0:17065:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b1edea840 going to sleep for 11 seconds 00000100:00100000:3.0:1783071596.672926:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707669888 00000100:00100000:3.0:1783071596.672932:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707669888 00000100:00100000:3.0:1783071596.672977:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783071596.672986:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3eb91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+6:17065:x1869685707669888:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783071596.672994:0:17078:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071596.673007:0:17078:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8a01748600/0x6b58994c2cbdd103 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdd0fc expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071596.673037:0:17078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8a01748600/0x6b58994c2cbdd103 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdd0fc expref: 7 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071596.673056:0:17078:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8a01748600/0x6b58994c2cbdd103 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdd0fc expref: 7 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071596.673063:0:17078:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a01748600, rc 0) 00000100:00100000:3.0:1783071596.673099:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3eb91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+7:17065:x1869685707669888:12345-0@lo:101:mount.lustre.0 Request processed in 115us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071596.673106:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783071596.673257:0:17065:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01766a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17065:1869685707669888:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783071596.673265:0:17065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8a03864e00/0x6b58994c2cbdd0fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd103 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071596.673270:0:17065:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8a03864e00/0x6b58994c2cbdd0fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdd103 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783071596.673278:0:17065:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1783071596.674691:0:17065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8a03864e00/0x6b58994c2cbdd0fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd103 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071596.674706:0:17065:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8a03864e00/0x6b58994c2cbdd0fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd103 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783071596.674715:0:17065:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1783071596.674722:0:17065:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783071596.674740:0:17065:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8f8a041ea000 10000000:01000000:0.0:1783071596.674743:0:17065:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1783071596.674746:0:17065:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1783071596.674748:0:17065:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1783071596.674778:0:17065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8a03865000/0x6b58994c2cbdd10a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071596.674786:0:17065:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8a03865000/0x6b58994c2cbdd10a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071596.674796:0:17065:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8a03865000/0x6b58994c2cbdd10a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071596.674816:0:17065:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01766a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17065:1869685707670016:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783071596.674872:0:17065:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071596.674911:0:17065:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b1edea840 going to sleep for 11 seconds 00000100:00100000:0.0:1783071596.674963:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707670016 00000100:00100000:0.0:1783071596.674970:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707670016 00000100:00100000:0.0:1783071596.675014:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783071596.675030:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3eb93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+7:17065:x1869685707670016:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783071596.675040:0:17081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071596.675051:0:17081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8a03864400/0x6b58994c2cbdd111 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdd10a expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071596.675071:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8a03864400/0x6b58994c2cbdd111 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdd10a expref: 8 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071596.675082:0:17081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8a03864400/0x6b58994c2cbdd111 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdd10a expref: 8 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071596.675100:0:17081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a03864400, rc 0) 00000100:00100000:0.0:1783071596.675357:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3eb93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+8:17065:x1869685707670016:12345-0@lo:101:mount.lustre.0 Request processed in 336us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071596.675384:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783071596.675629:0:17065:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01766a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17065:1869685707670016:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783071596.675643:0:17065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8a03865000/0x6b58994c2cbdd10a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd111 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071596.675651:0:17065:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8a03865000/0x6b58994c2cbdd10a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdd111 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071596.675712:0:17065:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02e41180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17065:1869685707670144:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783071596.675740:0:17065:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071596.675768:0:17065:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b2fd6c300 going to sleep for 11 seconds 00000100:00100000:0.0:1783071596.675815:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707670144 00000100:00100000:0.0:1783071596.675819:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707670144 00000100:00100000:0.0:1783071596.675852:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783071596.675859:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3eb92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+8:17065:x1869685707670144:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783071596.676066:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3eb92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+9:17065:x1869685707670144:12345-0@lo:501:mount.lustre.0 Request processed in 207us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071596.676073:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783071596.676798:0:17065:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02e41180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17065:1869685707670144:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783071596.677306:0:17065:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17065:1869685707670272:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783071596.677399:0:17065:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071596.677441:0:17065:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b180250c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783071596.677560:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707670272 00000100:00100000:1.0:1783071596.677567:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707670272 00000100:00100000:1.0:1783071596.677606:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783071596.677614:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3eb91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+9:17065:x1869685707670272:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783071596.678435:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3eb91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+9:17065:x1869685707670272:12345-0@lo:503:mount.lustre.0 Request processed in 818us (1033us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071596.678445:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783071596.678851:0:17065:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17065:1869685707670272:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783071596.679864:0:17103:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ed14122-6273-4ec6-b260-6e79c239c375:17103:1869685707670400:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783071596.679925:0:17103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071596.679967:0:17103:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b18025540 going to sleep for 11 seconds 00000100:00100000:1.0:1783071596.680227:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707670400 00000100:00100000:1.0:1783071596.680234:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707670400 00000100:00100000:1.0:1783071596.680281:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783071596.680290:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3eb92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+9:17103:x1869685707670400:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783071596.682786:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3eb92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+9:17103:x1869685707670400:12345-0@lo:502:llog_process_th.0 Request processed in 2488us (2851us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071596.682800:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783071596.682985:0:17103:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ed14122-6273-4ec6-b260-6e79c239c375:17103:1869685707670400:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783071596.683039:0:17103:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783071596.683053:0:17103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071596.683056:0:17103:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1783071596.683063:0:17103:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1783071596.683066:0:17103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783071596.683081:0:17103:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8f8a03360000) 00000020:00000080:3.0:1783071596.683099:0:17103:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1783071596.683124:0:17103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1783071596.683226:0:17103:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:3.0:1783071596.683233:0:17103:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6b58994c2cbdd11f 00000020:00000080:3.0:1783071596.683470:0:17103:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1783071596.683475:0:17103:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783071596.683478:0:17103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071596.683480:0:17103:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1783071596.683483:0:17103:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783071596.683486:0:17103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071596.683488:0:17103:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1783071596.683492:0:17103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783071596.683499:0:17103:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8f8a03363380) 00000020:00000080:3.0:1783071596.683509:0:17103:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1783071596.683513:0:17103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1783071596.683516:0:17103:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1783071596.683519:0:17103:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1783071596.683524:0:17103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1783071596.683566:0:17103:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f8a041ea000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1783071596.683578:0:17103:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8f8a03364d40) 00000020:00000080:3.0:1783071596.683587:0:17103:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1783071596.683644:0:17103:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1783071596.683650:0:17103:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6b58994c2cbdd134 00000020:00000080:3.0:1783071596.683740:0:17103:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1783071596.683746:0:17103:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1783071596.683751:0:17103:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x6b58994c2cbdd13b 00080000:01000000:3.0:1783071596.683756:0:17103:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:3.0:1783071596.683758:0:17103:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6b58994c2cbdd142 00010000:00010000:3.0:1783071596.762207:0:17103:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1783071596.764637:0:17103:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:3.0:1783071596.767757:0:17103:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1783071596.769262:0:17103:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8f8b3fedb380) 00000020:00000080:3.0:1783071596.769289:0:17103:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1783071596.769425:0:17103:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:3.0:1783071596.769439:0:17103:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6b58994c2cbdd150 00000020:00000080:3.0:1783071596.775083:0:17103:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1783071596.787929:0:17103:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x6b58994c2cbdd157 00000020:00000080:0.0:1783071596.792958:0:17103:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1783071596.792979:0:17103:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783071596.792990:0:17103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783071596.792993:0:17103:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1783071596.792997:0:17103:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1783071596.793001:0:17103:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1783071596.793002:0:17103:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783071596.793004:0:17103:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783071596.793005:0:17103:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1783071596.793008:0:17103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783071596.793010:0:17103:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1783071596.793013:0:17103:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783071596.793017:0:17103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783071596.793018:0:17103:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1783071596.793036:0:17103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1783071596.793096:0:17103:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1783071596.793113:0:17103:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783071596.793116:0:17103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783071596.793136:0:17103:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1783071596.793139:0:17103:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783071596.793142:0:17103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783071596.793143:0:17103:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1783071596.793146:0:17103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1783071596.793151:0:17103:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.138@tcp to nid 0x20000c0a8cc8a (192.168.204.138@tcp) 00000020:00000080:0.0:1783071596.793183:0:17103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783071596.793199:0:17103:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8f8b34e619c0) 00000020:00000080:0.0:1783071596.793218:0:17103:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1783071596.793224:0:17103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1783071596.793290:0:17103:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1783071596.793295:0:17103:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:0.0:1783071596.793301:0:17103:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6b58994c2cbdd165 00010000:00080000:0.0:1783071596.793346:0:17103:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f8b13d45800@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.138@tcp at head 00010000:00010000:0.0:1783071596.795014:0:17103:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:2.0:1783071596.796219:0:17103:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783071596.796234:0:17103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1783071596.796265:0:17103:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1783071596.796284:0:17103:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6b58994c2cbdd16c 00000100:00080000:2.0:1783071596.796294:0:17103:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783071596.796299:0:17103:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8f8b13d45800 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:2.0:1783071596.796332:0:17103:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8a032e4000 x1869685707670528/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783071596.796427:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869685707670528:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783071596.796495:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071596.796659:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707670528 00000100:00100000:0.0:1783071596.796666:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707670528 00000100:00100000:0.0:1783071596.796704:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783071596.796712:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02e43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1869685707670528:12345-0@lo:38:llog_process_th.0 00010000:00020000:0.0:1783071596.796726:0:17090:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:2.0:1783071596.802511:0:17103:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1783071596.802638:0:17103:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783071596.802656:0:17103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071596.802658:0:17103:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1783071596.802662:0:17103:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1783071596.802665:0:17103:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:2.0:1783071596.802667:0:17103:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783071596.802669:0:17103:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783071596.802670:0:17103:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1783071596.802673:0:17103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071596.802674:0:17103:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:2.0:1783071596.802676:0:17103:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783071596.802681:0:17103:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1783071596.802685:0:17103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071596.802686:0:17103:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1783071596.802688:0:17103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1783071596.802693:0:17103:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.138@tcp to nid 0x20000c0a8cc8a (192.168.204.138@tcp) 00000020:01000000:2.0:1783071596.802721:0:17103:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1783071596.802723:0:17103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783071596.802740:0:17103:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8f8b3c6cb380) 00000020:00000080:2.0:1783071596.802764:0:17103:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1783071596.802769:0:17103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1783071596.802874:0:17103:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1783071596.802881:0:17103:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:2.0:1783071596.802888:0:17103:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6b58994c2cbdd17a 00010000:00080000:2.0:1783071596.802924:0:17103:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f8a02c74000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.138@tcp at head 00010000:00010000:2.0:1783071596.803150:0:17103:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1783071596.811620:0:17103:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1783071596.812822:0:17103:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1783071596.818310:0:17103:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783071596.824837:0:17103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1783071596.825082:0:17103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1783071596.832313:0:17109:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1783071596.832325:0:17109:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1783071596.833832:0:17103:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783071596.833846:0:17103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1783071596.833885:0:17103:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1783071596.833907:0:17103:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6b58994c2cbdd181 00000100:00080000:1.0:1783071596.833918:0:17103:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783071596.833925:0:17103:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8f8a02c74000 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:1.0:1783071596.833978:0:17103:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8a03a9fb80 x1869685707670656/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783071596.834007:0:17103:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:3.0:1783071596.834290:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869685707670656:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1783071596.834398:0:3644:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869685707670656 offset 0 length 520: 4 00000020:01000000:1.0:1783071596.835156:0:17103:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783071596.835163:0:17103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783071596.835165:0:17103:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1783071596.835168:0:17103:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1783071596.835171:0:17103:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #27 00000020:01000000:1.0:1783071596.835173:0:17103:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783071596.835174:0:17103:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783071596.835176:0:17103:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1783071596.835178:0:17103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783071596.835180:0:17103:0:(obd_config.c:1561:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:1.0:1783071596.835182:0:17103:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783071596.835187:0:17103:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1783071596.835199:0:17103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783071596.835201:0:17103:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1783071596.835205:0:17103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783071596.835209:0:17103:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.138@tcp to nid 0x20000c0a8cc8a (192.168.204.138@tcp) 00000020:01000000:1.0:1783071596.835232:0:17103:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1783071596.835235:0:17103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783071596.835248:0:17103:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8f8a017dcd40) 00000020:00000080:1.0:1783071596.835266:0:17103:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1783071596.835271:0:17103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783071596.835355:0:17103:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1783071596.835380:0:17103:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:1.0:1783071596.835388:0:17103:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6b58994c2cbdd18f 00010000:00080000:1.0:1783071596.835418:0:17103:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f8a01e3f800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.138@tcp at head 00010000:00010000:1.0:1783071596.835701:0:17103:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1783071596.835770:0:17103:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1783071596.835786:0:17103:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1783071596.838712:0:17103:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783071596.839077:0:17103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1783071596.839260:0:17103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:0.0:1783071596.840189:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02e43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1869685707670528:12345-0@lo:38:llog_process_th.0 Request processed in 43469us (43687us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783071596.840204:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1783071596.840417:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8f8b13d45800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783071596.840423:0:3644:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783071596.840427:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869685707670528:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1783071596.846276:0:17111:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1783071596.846284:0:17111:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1783071596.853436:0:17103:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783071596.853453:0:17103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1783071596.853499:0:17103:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1783071596.853521:0:17103:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6b58994c2cbdd196 00000100:00080000:1.0:1783071596.853533:0:17103:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783071596.853540:0:17103:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8f8a01e3f800 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:1.0:1783071596.853673:0:17103:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8a03a9d500 x1869685707670784/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783071596.853766:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869685707670784:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1783071596.853825:0:3644:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869685707670784 offset 0 length 520: 4 00000100:00080000:1.0:1783071596.853884:0:17103:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1783071596.853966:0:17103:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783071596.853971:0:17103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783071596.853988:0:17103:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1783071596.853992:0:17103:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783071596.853995:0:17103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783071596.853997:0:17103:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1783071596.854001:0:17103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783071596.854003:0:17103:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1783071596.854005:0:17103:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783071596.854008:0:17103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783071596.854009:0:17103:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:1.0:1783071596.854011:0:17103:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783071596.854013:0:17103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783071596.854014:0:17103:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1783071596.854018:0:17103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1783071596.854201:0:17103:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ed14122-6273-4ec6-b260-6e79c239c375:17103:1869685707670912:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783071596.854258:0:17103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071596.854399:0:17103:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b34471180 going to sleep for 11 seconds 00000100:00100000:2.0:1783071596.854532:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707670912 00000100:00100000:2.0:1783071596.854540:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707670912 00000100:00100000:2.0:1783071596.854713:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783071596.854725:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03813050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+9:17103:x1869685707670912:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783071596.854902:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03813050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+9:17103:x1869685707670912:12345-0@lo:502:llog_process_th.0 Request processed in 179us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071596.854918:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783071596.855091:0:17103:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ed14122-6273-4ec6-b260-6e79c239c375:17103:1869685707670912:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783071596.855121:0:17103:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783071596.855126:0:17103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783071596.855128:0:17103:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1783071596.855132:0:17103:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1783071596.855349:0:17065:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1783071596.855483:0:17065:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1783071596.855534:0:17065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8a03865000/0x6b58994c2cbdd10a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd111 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071596.855557:0:17065:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8a03865000/0x6b58994c2cbdd10a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd111 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783071596.855565:0:17065:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8f8a041ea000 from 1 10000000:01000000:0.0:1783071596.855568:0:17065:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783071596.855609:0:17065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8a03864000/0x6b58994c2cbdd19d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071596.855617:0:17065:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8a03864000/0x6b58994c2cbdd19d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071596.855625:0:17065:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8a03864000/0x6b58994c2cbdd19d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071596.855642:0:17065:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01764700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17065:1869685707671040:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783071596.855678:0:17065:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071596.855711:0:17065:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b10d04000 going to sleep for 11 seconds 00000100:00100000:2.0:1783071596.856058:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707671040 00000100:00100000:2.0:1783071596.856065:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707671040 00000100:00100000:2.0:1783071596.856100:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783071596.856108:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03812450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+9:17065:x1869685707671040:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783071596.856119:0:17081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071596.856136:0:17081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b2fd66a00/0x6b58994c2cbdd1a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdd19d expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071596.856158:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b2fd66a00/0x6b58994c2cbdd1a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdd19d expref: 10 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071596.856168:0:17081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b2fd66a00/0x6b58994c2cbdd1a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdd19d expref: 10 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071596.856177:0:17081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b2fd66a00, rc 0) 00000100:00100000:2.0:1783071596.856221:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03812450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+10:17065:x1869685707671040:12345-0@lo:101:mount.lustre.0 Request processed in 114us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071596.856228:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783071596.856383:0:17065:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01764700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17065:1869685707671040:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783071596.856398:0:17065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8a03864000/0x6b58994c2cbdd19d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd1a4 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071596.856407:0:17065:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8a03864000/0x6b58994c2cbdd19d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdd1a4 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071596.856974:0:17065:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02e41f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17065:1869685707671168:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1783071596.857400:0:17065:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071596.857434:0:17065:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a01744900 going to sleep for 11 seconds 00000100:00100000:0.0:1783071596.857527:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707671168 00000100:00100000:0.0:1783071596.857533:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707671168 00000100:00100000:0.0:1783071596.857586:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783071596.857594:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03810850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+10:17065:x1869685707671168:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1783071596.857612:0:17078:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1783071596.857618:0:17078:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1783071596.857689:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03810850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+10:17065:x1869685707671168:12345-0@lo:256:mount.lustre.0 Request processed in 96us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071596.857696:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783071596.857843:0:17065:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02e41f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17065:1869685707671168:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1783071596.858461:0:17065:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783071596.858845:0:17065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8a03864000/0x6b58994c2cbdd19d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd1a4 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071596.858857:0:17065:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8a03864000/0x6b58994c2cbdd19d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd1a4 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071596.858921:0:17065:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8f8a041ea000 from 1 10000000:01000000:2.0:1783071596.858925:0:17065:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783071596.858969:0:17065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67c00/0x6b58994c2cbdd1ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071596.858977:0:17065:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67c00/0x6b58994c2cbdd1ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071596.858986:0:17065:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67c00/0x6b58994c2cbdd1ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071596.859028:0:17065:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17065:1869685707671296:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783071596.859076:0:17065:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071596.859155:0:17065:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b115af780 going to sleep for 11 seconds 00000100:00100000:0.0:1783071596.859270:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707671296 00000100:00100000:0.0:1783071596.859282:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707671296 00000100:00100000:0.0:1783071596.859359:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783071596.859390:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03812050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+10:17065:x1869685707671296:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783071596.859401:0:17078:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071596.859413:0:17078:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8a03865c00/0x6b58994c2cbdd1b2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdd1ab expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071596.859437:0:17078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8a03865c00/0x6b58994c2cbdd1b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdd1ab expref: 11 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071596.859447:0:17078:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8a03865c00/0x6b58994c2cbdd1b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdd1ab expref: 11 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071596.859456:0:17078:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a03865c00, rc 0) 00000100:00100000:0.0:1783071596.859497:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03812050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+11:17065:x1869685707671296:12345-0@lo:101:mount.lustre.0 Request processed in 109us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071596.859504:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783071596.859589:0:17065:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17065:1869685707671296:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783071596.859603:0:17065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67c00/0x6b58994c2cbdd1ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd1b2 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071596.859611:0:17065:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67c00/0x6b58994c2cbdd1ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdd1b2 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071596.859673:0:17065:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17065:1869685707671424:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783071596.859698:0:17065:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071596.860164:0:17065:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b115af780 going to sleep for 11 seconds 00000100:00100000:3.0:1783071596.860246:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707671424 00000100:00100000:3.0:1783071596.860252:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707671424 00000100:00100000:3.0:1783071596.860280:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783071596.860287:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03811450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+11:17065:x1869685707671424:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783071596.860493:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03811450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+11:17065:x1869685707671424:12345-0@lo:501:mount.lustre.0 Request processed in 205us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071596.860500:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783071596.860714:0:17065:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17065:1869685707671424:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783071596.860748:0:17065:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17065:1869685707671552:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783071596.860791:0:17065:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071596.860817:0:17065:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b115af780 going to sleep for 11 seconds 00000100:00100000:3.0:1783071596.860871:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707671552 00000100:00100000:3.0:1783071596.860875:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707671552 00000100:00100000:3.0:1783071596.860892:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783071596.860896:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03812850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+11:17065:x1869685707671552:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783071596.860983:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03812850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+11:17065:x1869685707671552:12345-0@lo:503:mount.lustre.0 Request processed in 86us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071596.860990:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783071596.861117:0:17065:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17065:1869685707671552:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783071596.861732:0:17113:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ed14122-6273-4ec6-b260-6e79c239c375:17113:1869685707671680:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783071596.861771:0:17113:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071596.861833:0:17113:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b115afcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071596.861872:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707671680 00000100:00100000:3.0:1783071596.861876:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707671680 00000100:00100000:3.0:1783071596.861935:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783071596.861942:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03811050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+11:17113:x1869685707671680:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783071596.862553:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03811050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+11:17113:x1869685707671680:12345-0@lo:502:llog_process_th.0 Request processed in 608us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071596.862699:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783071596.862792:0:17113:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ed14122-6273-4ec6-b260-6e79c239c375:17113:1869685707671680:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783071596.862821:0:17113:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783071596.862836:0:17113:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071596.862838:0:17113:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1783071596.862846:0:17113:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f8a041ea000 00000020:00000080:2.0:1783071596.862848:0:17113:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783071596.862857:0:17113:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783071596.862860:0:17113:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071596.862862:0:17113:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1783071596.862864:0:17113:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783071596.862867:0:17113:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071596.862868:0:17113:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1783071596.862871:0:17113:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f8a041ea000 00000020:00000080:2.0:1783071596.862873:0:17113:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783071596.862938:0:17113:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783071596.862942:0:17113:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071596.862944:0:17113:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1783071596.862958:0:17113:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783071596.862961:0:17113:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071596.862963:0:17113:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1783071596.862966:0:17113:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f8a041ea000 00000020:00000080:2.0:1783071596.862969:0:17113:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783071596.862987:0:17113:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783071596.862990:0:17113:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071596.862991:0:17113:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1783071596.862993:0:17113:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783071596.862995:0:17113:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071596.862996:0:17113:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1783071596.863000:0:17113:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f8a041ea000 00000020:00000080:2.0:1783071596.863002:0:17113:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1783071596.863051:0:17113:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ed14122-6273-4ec6-b260-6e79c239c375:17113:1869685707671808:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783071596.863093:0:17113:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071596.867217:0:17113:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b115afcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783071596.869893:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707671808 00000100:00100000:0.0:1783071596.869909:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707671808 00000100:00100000:0.0:1783071596.872818:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783071596.872833:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03810050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+11:17113:x1869685707671808:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783071596.873047:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03810050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+11:17113:x1869685707671808:12345-0@lo:502:llog_process_th.0 Request processed in 216us (9952us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071596.873055:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783071596.873226:0:17113:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ed14122-6273-4ec6-b260-6e79c239c375:17113:1869685707671808:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783071596.873265:0:17113:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783071596.873272:0:17113:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071596.873274:0:17113:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1783071596.873278:0:17113:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1783071596.887327:0:17065:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1783071596.887380:0:17065:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783071596.887410:0:17065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67c00/0x6b58994c2cbdd1ab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd1b2 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071596.887436:0:17065:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67c00/0x6b58994c2cbdd1ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd1b2 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783071596.887491:0:17065:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1783071596.887494:0:17065:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f8a041ea000 10000000:01000000:0.0:1783071596.887497:0:17065:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f8a041ea000 10000000:01000000:0.0:1783071596.887502:0:17065:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783071596.887508:0:17065:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8f8a041ea000 from 1 10000000:01000000:0.0:1783071596.887511:0:17065:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783071596.887546:0:17065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8a03865e00/0x6b58994c2cbdd1b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071596.887553:0:17065:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8a03865e00/0x6b58994c2cbdd1b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071596.887564:0:17065:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8a03865e00/0x6b58994c2cbdd1b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071596.887597:0:17065:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01766d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17065:1869685707671936:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783071596.887662:0:17065:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071596.887705:0:17065:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b10d04cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783071596.887737:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707671936 00000100:00100000:0.0:1783071596.887744:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707671936 00000100:00100000:0.0:1783071596.887786:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783071596.887794:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03810c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+11:17065:x1869685707671936:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783071596.887808:0:17078:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071596.887821:0:17078:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8a03865200/0x6b58994c2cbdd1c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdd1b9 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071596.887857:0:17078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8a03865200/0x6b58994c2cbdd1c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdd1b9 expref: 12 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071596.887866:0:17078:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8a03865200/0x6b58994c2cbdd1c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdd1b9 expref: 12 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071596.887876:0:17078:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a03865200, rc 0) 00000100:00100000:0.0:1783071596.887919:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03810c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+12:17065:x1869685707671936:12345-0@lo:101:mount.lustre.0 Request processed in 125us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071596.889114:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783071596.889195:0:17065:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01766d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17065:1869685707671936:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783071596.889215:0:17065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8a03865e00/0x6b58994c2cbdd1b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd1c0 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071596.889226:0:17065:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8a03865e00/0x6b58994c2cbdd1b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdd1c0 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071596.889294:0:17065:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01766d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17065:1869685707672064:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783071596.889336:0:17065:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071596.889376:0:17065:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b10d04cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071596.889747:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707672064 00000100:00100000:3.0:1783071596.889753:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707672064 00000100:00100000:3.0:1783071596.889787:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783071596.889795:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03813850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+12:17065:x1869685707672064:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783071596.889921:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03813850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+12:17065:x1869685707672064:12345-0@lo:501:mount.lustre.0 Request processed in 126us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071596.889927:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783071596.889969:0:17065:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01766d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17065:1869685707672064:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783071596.889997:0:17065:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02e41f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17065:1869685707672192:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783071596.890038:0:17065:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071596.890052:0:17065:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a01744480 going to sleep for 11 seconds 00000100:00100000:3.0:1783071596.890064:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707672192 00000100:00100000:3.0:1783071596.890068:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707672192 00000100:00100000:3.0:1783071596.890083:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783071596.890089:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03811850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+12:17065:x1869685707672192:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783071596.890155:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03811850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+12:17065:x1869685707672192:12345-0@lo:503:mount.lustre.0 Request processed in 66us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071596.890161:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783071596.890196:0:17065:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02e41f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17065:1869685707672192:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783071596.905632:0:17118:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ed14122-6273-4ec6-b260-6e79c239c375:17118:1869685707672320:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783071596.905729:0:17118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071596.905777:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707672320 00000100:00100000:2.0:1783071596.905784:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707672320 00000100:00100000:2.0:1783071596.905873:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783071596.905882:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03811c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+12:17118:x1869685707672320:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783071596.906018:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03811c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+12:17118:x1869685707672320:12345-0@lo:502:llog_process_th.0 Request processed in 136us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071596.906026:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783071596.910720:0:17118:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b115af780 going to sleep for 11 seconds 00000100:00100000:3.0:1783071596.910759:0:17118:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ed14122-6273-4ec6-b260-6e79c239c375:17118:1869685707672320:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1783071596.910831:0:17118:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1783071596.910846:0:17118:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8f8b3fedcd40) 00000020:00000080:3.0:1783071596.910870:0:17118:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1783071596.911062:0:17118:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f8a041ea000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1783071596.911066:0:17118:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f8a041ea000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1783071596.911069:0:17118:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8f8a041ea000 4 00010000:00080000:3.0:1783071596.911096:0:17118:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f8b3c6ea800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.138@tcp at head 00010000:00010000:3.0:1783071596.912680:0:17118:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1783071596.912783:0:17118:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1783071596.912826:0:17118:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783071596.912839:0:17118:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x6b58994c2cbdd1ce 00000100:00080000:3.0:1783071596.912849:0:17118:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783071596.912855:0:17118:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8f8b3c6ea800 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:3.0:1783071596.912898:0:17118:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8a02e41f80 x1869685707672448/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783071596.912932:0:17118:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1783071596.913407:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02e41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1869685707672448:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783071596.913475:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071596.913866:0:17085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707672448 00000100:00100000:3.0:1783071596.913873:0:17085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707672448 00000100:00100000:3.0:1783071596.913909:0:17085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783071596.913917:0:17085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1869685707672448:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783071596.915027:0:17085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1869685707672448:12345-0@lo:38:llog_process_th.0 Request processed in 1104us (1546us total) trans 0 rc -11/-11 00000100:00100000:3.0:1783071596.915038:0:17085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783071596.918437:0:17118:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02e41500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ed14122-6273-4ec6-b260-6e79c239c375:17118:1869685707672576:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783071596.918525:0:17118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071596.918566:0:17118:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b18d70b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783071596.918753:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707672576 00000100:00100000:1.0:1783071596.918760:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707672576 00000100:00100000:1.0:1783071596.918804:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783071596.918814:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03813450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+12:17118:x1869685707672576:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783071596.918961:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03813450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+12:17118:x1869685707672576:12345-0@lo:502:llog_process_th.0 Request processed in 147us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071596.918969:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783071596.919059:0:17118:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02e41500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ed14122-6273-4ec6-b260-6e79c239c375:17118:1869685707672576:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783071596.919106:0:17118:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02e41500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ed14122-6273-4ec6-b260-6e79c239c375:17118:1869685707672704:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783071596.919139:0:17118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071596.919165:0:17118:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b3b640cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783071596.919323:0:3644:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783071596.919331:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8f8b3c6ea800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783071596.919336:0:3644:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1783071596.919340:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02e41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1869685707672448:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783071596.920051:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707672704 00000100:00100000:2.0:1783071596.920060:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707672704 00000100:00100000:2.0:1783071596.920106:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783071596.920115:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03813c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+12:17118:x1869685707672704:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783071596.920252:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03813c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+12:17118:x1869685707672704:12345-0@lo:502:llog_process_th.0 Request processed in 137us (1112us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071596.920260:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783071596.922125:0:17118:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02e41500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ed14122-6273-4ec6-b260-6e79c239c375:17118:1869685707672704:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1783071596.922163:0:17118:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1783071596.922457:0:17065:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1783071596.922484:0:17065:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783071596.922503:0:17065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8a03865e00/0x6b58994c2cbdd1b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd1c0 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071596.922514:0:17065:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8a03865e00/0x6b58994c2cbdd1b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd1c0 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1783071596.922563:0:17065:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1783071596.922565:0:17065:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783071596.922566:0:17065:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783071596.922568:0:17065:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783071596.922569:0:17065:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783071596.922578:0:17065:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783071596.922580:0:17065:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783071596.922582:0:17065:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783071596.922583:0:17065:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783071596.922585:0:17065:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783071596.922589:0:17065:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1783071596.922591:0:17065:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783071596.922593:0:17065:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783071596.922594:0:17065:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783071596.922595:0:17065:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783071596.922596:0:17065:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783071596.922597:0:17065:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783071596.922598:0:17065:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783071596.922599:0:17065:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783071596.922600:0:17065:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783071596.922601:0:17065:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783071596.922624:0:17065:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1783071596.922641:0:17065:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01764e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17065:1869685707672832:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1783071596.922705:0:17065:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071596.922738:0:17065:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b10d040c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783071596.924759:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707672832 00000100:00100000:1.0:1783071596.924773:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707672832 00000100:00100000:1.0:1783071596.924839:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783071596.924849:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03812c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+12:17065:x1869685707672832:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783071596.924886:0:17079:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1783071596.924901:0:17079:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1783071596.928930:0:17079:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783071596.928979:0:17079:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1783071596.929285:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03812c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+12:17065:x1869685707672832:12345-0@lo:253:mount.lustre.0 Request processed in 4433us (6575us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071596.929298:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 20000000:01000000:0.0:1783071596.929691:0:17101:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783071596.929698:0:17101:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783071596.929727:0:17101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f8a03864800/0x6b58994c2cbdd1d5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071596.929743:0:17101:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8b2fd66a00/0x6b58994c2cbdd1a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdd19d expref: 11 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071596.929752:0:17101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f8a03864800/0x6b58994c2cbdd1d5 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071596.929787:0:17101:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8b2fd66a00/0x6b58994c2cbdd1a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6b58994c2cbdd19d expref: 11 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071596.929802:0:17101:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f8b2fd66a00/0x6b58994c2cbdd1a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6b58994c2cbdd19d expref: 11 pid: 17081 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071596.929817:0:17101:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01767100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17101:1869685707672960:0@lo:104: 00000100:00100000:0.0:1783071596.929853:0:17101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071596.929893:0:17101:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b2fd6c300 going to sleep for 11 seconds 00000100:00100000:3.0:1783071596.929980:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707672960 00000100:00100000:3.0:1783071596.929990:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707672960 00000100:00100000:3.0:1783071596.930043:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783071596.930052:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01766680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5ed14122-6273-4ec6-b260-6e79c239c375+3:17101:x1869685707672960:12345-0@lo:104: 00010000:00010000:3.0:1783071596.930067:0:17069:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8f8a03864000/0x6b58994c2cbdd19d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdd1a4 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071596.930123:0:17069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783071596.930128:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01766680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5ed14122-6273-4ec6-b260-6e79c239c375+3:17101:x1869685707672960:12345-0@lo:104: Request processed in 78us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071596.930134:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1783071596.930150:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783071596.930155:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8a03864000/0x6b58994c2cbdd19d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdd1a4 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071596.930162:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03864000 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:3.0:1783071596.930166:0:17075:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8a03864000/0x6b58994c2cbdd19d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6b58994c2cbdd1a4 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071596.930174:0:17075:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8a03864000/0x6b58994c2cbdd19d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6b58994c2cbdd1a4 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783071596.930181:0:17075:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8a03864000/0x6b58994c2cbdd19d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6b58994c2cbdd1a4 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783071596.930187:0:17075:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783071596.930222:0:17075:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8f8a03864000/0x6b58994c2cbdd19d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdd1a4 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071596.930229:0:17075:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783071596.930248:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8a03864000/0x6b58994c2cbdd19d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdd1a4 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071596.930255:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8a03864000/0x6b58994c2cbdd19d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdd1a4 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071596.930271:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071596.930273:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071596.930274:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071596.930299:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02e41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ed14122-6273-4ec6-b260-6e79c239c375:3648:1869685707673088:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783071596.930327:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071596.930425:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707673088 00000100:00100000:3.0:1783071596.930430:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707673088 00010000:00010000:3.0:1783071596.930445:0:17071:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8b2fd66a00/0x6b58994c2cbdd1a4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdd19d expref: 12 pid: 17081 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071596.930466:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783071596.930472:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02e42680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5ed14122-6273-4ec6-b260-6e79c239c375+12:3648:x1869685707673088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783071596.930482:0:17071:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071596.930487:0:17071:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8b2fd66a00/0x6b58994c2cbdd1a4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdd19d expref: 12 pid: 17081 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071596.930497:0:17071:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8b2fd66a00/0x6b58994c2cbdd1a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6b58994c2cbdd19d expref: 12 pid: 17081 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071596.930516:0:17071:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f8a03864800/0x6b58994c2cbdd1d5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071596.930529:0:17071:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8a03864800/0x6b58994c2cbdd1d5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783071596.930541:0:17071:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000845345s 00010000:00010000:3.0:1783071596.930546:0:17071:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f8a03864800/0x6b58994c2cbdd1d5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071596.930552:0:17071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f8a03864800/0x6b58994c2cbdd1d5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071596.930572:0:17071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f8a03864800/0x6b58994c2cbdd1d5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071596.930579:0:17071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f8a03864800/0x6b58994c2cbdd1d5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071596.930584:0:17071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03864800 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:3.0:1783071596.930588:0:17071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f8a03864800/0x6b58994c2cbdd1d5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071596.930595:0:17071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f8a03864800/0x6b58994c2cbdd1d5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071596.930604:0:17071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f8a03864800/0x6b58994c2cbdd1d5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071596.930613:0:17071:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783071596.930642:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02e42680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5ed14122-6273-4ec6-b260-6e79c239c375+12:3648:x1869685707673088:12345-0@lo:103:ldlm_bl.0 Request processed in 170us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071596.930648:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783071596.930696:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02e41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ed14122-6273-4ec6-b260-6e79c239c375:3648:1869685707673088:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783071596.931245:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b2fd66a00/0x6b58994c2cbdd1a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6b58994c2cbdd19d expref: 11 pid: 17081 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071596.931259:0:17101:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01767100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17101:1869685707672960:0@lo:104: 00010000:00010000:1.0:1783071596.931275:0:17101:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f8a03864800/0x6b58994c2cbdd1d5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071596.931284:0:17101:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f8a03864800/0x6b58994c2cbdd1d5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071596.931290:0:17101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f8a03864800/0x6b58994c2cbdd1d5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071596.931296:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8a03864800/0x6b58994c2cbdd1d5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071596.931643:0:17065:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01764e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17065:1869685707672832:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783071596.931656:0:17065:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1783071596.931659:0:17065:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783071596.931661:0:17065:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783071596.931663:0:17065:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783071596.931664:0:17065:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783071596.931665:0:17065:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783071596.931675:0:17065:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783071596.931676:0:17065:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783071596.931678:0:17065:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783071596.931680:0:17065:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783071596.931681:0:17065:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1783071596.931693:0:17065:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000020:00080000:3.0:1783071596.945337:0:17065:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1783071596.945688:0:17065:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1783071596.945934:0:17125:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1783071596.946246:0:17065:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:2.0:1783071596.946484:0:17125:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:3.0:1783071596.948024:0:17124:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1783071596.948031:0:17124:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:2.0:1783071596.948439:0:17125:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1783071596.948515:0:17125:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00080000:3.0:1783071596.949986:0:17126:0:(client.c:1831:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8f8a02e41500 x1869685707673216/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071596.950001:0:17126:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b02aa1180 going to sleep for 0 seconds 00000040:01000000:0.0:1783071596.950445:0:17065:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1783071596.950481:0:17065:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1783071596.950924:0:17065:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1783071596.950932:0:17065:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1783071596.950974:0:17065:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783071596.953251:0:17065:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1783071596.954071:0:17065:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1783071596.954117:0:17065:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1783071596.955503:0:17065:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:2.0:1783071596.956125:0:17065:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:2.0:1783071596.967092:0:17065:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1783071596.970100:0:17065:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1783071596.970146:0:17065:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9cbcc1c93988 00100000:10000000:2.0:1783071596.970154:0:17065:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1783071596.971141:0:17065:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1783071596.971167:0:17065:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.138@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1783071596.971190:0:17065:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1783071596.971228:0:17065:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1783071596.974442:0:17065:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783071596.975225:0:17065:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783071597.506800:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1783071597.893047:0:17083:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783071597.893056:0:17083:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8f8a041ea000 from 7 10000000:01000000:3.0:1783071597.893062:0:17083:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783071597.893115:0:17083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8a01749400/0x6b58994c2cbdd1dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071597.893128:0:17083:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8a01749400/0x6b58994c2cbdd1dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071597.893140:0:17083:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8a01749400/0x6b58994c2cbdd1dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071597.893171:0:17083:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02e41f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ed14122-6273-4ec6-b260-6e79c239c375:17083:1869685707673344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783071597.893250:0:17083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071597.893308:0:17083:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0394f180 going to sleep for 11 seconds 00000100:00100000:0.0:1783071597.893735:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707673344 00000100:00100000:0.0:1783071597.893743:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707673344 00000100:00100000:0.0:1783071597.893811:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783071597.893821:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+11:17083:x1869685707673344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783071597.893835:0:17078:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071597.893851:0:17078:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8a03865a00/0x6b58994c2cbdd1e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdd1dc expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071597.893876:0:17078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8a03865a00/0x6b58994c2cbdd1e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdd1dc expref: 12 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071597.893888:0:17078:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8a03865a00/0x6b58994c2cbdd1e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdd1dc expref: 12 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071597.893896:0:17078:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a03865a00, rc 0) 00000100:00100000:0.0:1783071597.893958:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+12:17083:x1869685707673344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071597.893966:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783071597.894018:0:17083:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02e41f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ed14122-6273-4ec6-b260-6e79c239c375:17083:1869685707673344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783071597.894034:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8a01749400/0x6b58994c2cbdd1dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd1e3 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071597.894042:0:17083:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8a01749400/0x6b58994c2cbdd1dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdd1e3 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071597.894106:0:17083:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02e41f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ed14122-6273-4ec6-b260-6e79c239c375:17083:1869685707673472:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1783071597.894144:0:17083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071597.894180:0:17083:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0394f180 going to sleep for 11 seconds 00000100:00100000:0.0:1783071597.894412:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707673472 00000100:00100000:0.0:1783071597.894418:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707673472 00000100:00100000:0.0:1783071597.894441:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783071597.894447:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+12:17083:x1869685707673472:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1783071597.894462:0:17079:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783071597.894478:0:17079:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783071597.894481:0:17079:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1783071597.894574:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+12:17083:x1869685707673472:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 127us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071597.894582:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783071597.894612:0:17083:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02e41f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ed14122-6273-4ec6-b260-6e79c239c375:17083:1869685707673472:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1783071597.894657:0:17083:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783071597.894668:0:17083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8a01749400/0x6b58994c2cbdd1dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd1e3 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071597.894676:0:17083:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8a01749400/0x6b58994c2cbdd1dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd1e3 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783071597.955506:0:17119:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783071597.955516:0:17119:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1783071597.956941:0:17126:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b02aa1180 going to sleep for 0 seconds 00000040:00080000:1.0:1783071597.964986:0:17119:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:1.0:1783071597.965005:0:17119:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1783071598.530898:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783071598.980263:0:17119:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783071598.980274:0:17119:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783071598.980820:0:17119:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1783071598.980855:0:17119:0:(llog_cat.c:1256:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1783071598.982771:0:17126:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b02aa1180 going to sleep for 0 seconds 00000040:00080000:0.0:1783071598.983388:0:17119:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00010000:00010000:2.0:1783071599.554576:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071600.002426:0:17126:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b02aa1180 going to sleep for 0 seconds 00010000:00010000:2.0:1783071600.579527:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071601.027230:0:17126:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b02aa1180 going to sleep for 0 seconds 00000001:02000400:3.0:1783071601.451242:0:17369:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg438-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1783071601.607139:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783071601.986876:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1783071601.986884:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1783071601.986888:0:37:0:(import.c:65:import_set_state_nolock()) ffff8f8b13d45800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783071601.986896:0:37:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 498 00000100:00080000:3.0:1783071601.986903:0:37:0:(import.c:591:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783071601.986909:0:37:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8f8b13d45800 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:3.0:1783071601.986942:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8a02e40e00 x1869685707673728/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783071601.986944:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02e41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ed14122-6273-4ec6-b260-6e79c239c375:3645:1869685707673600:0@lo:400:kworker.0 00000100:00080000:3.0:1783071601.986961:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783071601.986964:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783071601.986967:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783071601.986970:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783071601.986972:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1783071601.986975:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783071601.986977:0:37:0:(import.c:65:import_set_state_nolock()) ffff8f8b3c6ea800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783071601.986980:0:37:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8f8b3c6ea800 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:3.0:1783071601.986999:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8a02e42a00 x1869685707673856/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783071601.987017:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071601.987048:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02e40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869685707673728:0@lo:38:kworker.0 00000100:00100000:3.0:1783071601.987091:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071601.987116:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02e42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1869685707673856:0@lo:38:kworker.0 00000100:00100000:1.0:1783071601.987129:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707673600 00000100:00100000:1.0:1783071601.987136:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707673600 00000100:00100000:1.0:1783071601.987180:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783071601.987190:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+12:3645:x1869685707673600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071601.987246:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+12:3645:x1869685707673600:12345-0@lo:400:kworker.0 Request processed in 57us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071601.987254:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783071601.987303:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707673728 00000100:00100000:1.0:1783071601.987307:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707673728 00000100:00100000:1.0:1783071601.987327:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783071601.987333:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02e41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1869685707673728:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783071601.987351:0:17091:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783071601.988491:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071601.989216:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707673856 00000100:00100000:0.0:1783071601.989225:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707673856 00000100:00100000:0.0:1783071601.989255:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783071601.989262:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02e43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1869685707673856:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1783071601.989286:0:17087:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 503 last 0 00000020:00000080:0.0:1783071601.989399:0:17087:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x6b58994c2cbdd1ea 00000004:00100000:0.0:1783071601.989416:0:17087:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783071601.989526:0:17087:0:(import.c:65:import_set_state_nolock()) ffff8f8b34e4a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783071601.989586:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02e43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1869685707673856:12345-0@lo:38:kworker.0 Request processed in 323us (1099us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071601.989592:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1783071601.989788:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8f8a02e42a00 x1869685707673856/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783071611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783071601.989803:0:3644:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1783071601.989812:0:3644:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1783071601.989817:0:3644:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1783071601.989819:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8f8b3c6ea800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1783071601.989824:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02e42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1869685707673856:0@lo:38:kworker.0 00000100:00100000:0.0:1783071601.991065:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02e41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ed14122-6273-4ec6-b260-6e79c239c375:3645:1869685707673600:0@lo:400:kworker.0 00000100:00080000:3.0:1783071602.002157:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8f8b13d45800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783071602.002165:0:3644:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783071602.002170:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02e40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869685707673728:0@lo:38:kworker.0 00000100:00100000:1.0:1783071602.002218:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02e41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1869685707673728:12345-0@lo:38:kworker.0 Request processed in 14582us (14824us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783071602.002293:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783071602.050492:0:17126:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b02aa1180 going to sleep for 0 seconds 00000020:00000004:3.0:1783071602.340316:0:17421:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783071602.342741:0:17421:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783071602.626518:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071603.078715:0:17126:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b02aa1180 going to sleep for 0 seconds 00000020:00000004:3.0:1783071603.165324:0:17471:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783071603.166673:0:17471:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783071603.650715:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071604.098568:0:17126:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b02aa1180 going to sleep for 0 seconds 00010000:00010000:3.0:1783071604.677026:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071605.141296:0:17126:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b02aa1180 going to sleep for 0 seconds 00010000:00010000:2.0:1783071605.699397:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071606.087214:0:3644:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783071596/real 1783071596] req@ffff8f8a03a9d500 x1869685707670784/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783071606 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071606.087248:0:3644:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f8a03a9d500 x1869685707670784/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783071606 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071606.087273:0:3644:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783071596/real 1783071596] req@ffff8f8a03a9fb80 x1869685707670656/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783071606 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071606.087286:0:3644:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f8a03a9fb80 x1869685707670656/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783071606 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783071606.087304:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8f8a01e3f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783071606.087328:0:3644:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1783071606.087332:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869685707670784:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1783071606.087338:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8f8a02c74000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783071606.087342:0:3644:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1783071606.087345:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869685707670656:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1783071606.087458:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1783071606.087470:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1783071606.087474:0:8:0:(import.c:65:import_set_state_nolock()) ffff8f8b13d45800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783071606.087478:0:8:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 503 00000100:00080000:2.0:1783071606.087490:0:8:0:(import.c:591:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1783071606.087498:0:8:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8f8b13d45800 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:2.0:1783071606.087518:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8a032e4000 x1869685707674112/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783071606.087534:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783071606.087537:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1783071606.087539:0:8:0:(import.c:65:import_set_state_nolock()) ffff8f8a02c74000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783071606.087542:0:8:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 498 00000100:00080000:2.0:1783071606.087544:0:8:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00100000:0.0:1783071606.087549:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:2.0:1783071606.087557:0:8:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8f8a02c74000 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:0.0:1783071606.087563:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ed14122-6273-4ec6-b260-6e79c239c375:3645:1869685707673984:0@lo:400:kworker.0 00000100:00100000:2.0:1783071606.087568:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8a032e4e00 x1869685707674240/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783071606.087575:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783071606.087578:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1783071606.087579:0:8:0:(import.c:65:import_set_state_nolock()) ffff8f8a01e3f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783071606.087581:0:8:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 498 00000100:00080000:2.0:1783071606.087584:0:8:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783071606.087587:0:8:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8f8a01e3f800 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:2.0:1783071606.087595:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8a032e7100 x1869685707674368/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783071606.087632:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869685707674496:0@lo:400:kworker.0 00000100:00100000:0.0:1783071606.087638:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071606.087665:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071606.087694:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869685707674112:0@lo:38:kworker.0 00000100:00100000:2.0:1783071606.087724:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707674496 00000100:00100000:2.0:1783071606.087732:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707674496 00000100:00100000:0.0:1783071606.087764:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071606.087792:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869685707674240:0@lo:8:kworker.0 00000100:00100000:2.0:1783071606.087807:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000400:00000100:0.0:1783071606.087812:0:3644:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869685707674240 offset 0 length 520: 4 00000100:00100000:2.0:1783071606.087821:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869685707674496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071606.087822:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869685707674368:0@lo:8:kworker.0 00000400:00000100:0.0:1783071606.087837:0:3644:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869685707674368 offset 0 length 520: 4 00000100:00100000:0.0:1783071606.087857:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707674112 00000100:00100000:0.0:1783071606.087861:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707674112 00000100:00100000:2.0:1783071606.087870:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869685707674496:12345-0@lo:400:kworker.0 Request processed in 51us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071606.087877:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783071606.087892:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783071606.087897:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01764a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1869685707674112:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1783071606.087910:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8f8a032e4700 x1869685707674496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071622 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00020000:0.0:1783071606.087911:0:17090:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783071606.087920:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869685707674496:0@lo:400:kworker.0 00000100:00100000:3.0:1783071606.088052:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707673984 00000100:00100000:3.0:1783071606.088056:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707673984 00000100:00100000:3.0:1783071606.088094:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783071606.088101:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+12:3645:x1869685707673984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071606.088139:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+12:3645:x1869685707673984:12345-0@lo:400:kworker.0 Request processed in 39us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071606.088145:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783071606.093785:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ed14122-6273-4ec6-b260-6e79c239c375:3645:1869685707673984:0@lo:400:kworker.0 00000100:00100000:2.0:1783071606.112088:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01764a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1869685707674112:12345-0@lo:38:kworker.0 Request processed in 24179us (24312us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783071606.112107:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1783071606.112795:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8f8b13d45800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783071606.112802:0:3644:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783071606.112807:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869685707674112:0@lo:38:kworker.0 00000100:00100000:2.0:1783071606.147441:0:17126:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b02aa1180 going to sleep for 0 seconds 00010000:00010000:3.0:1783071606.727926:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071607.175403:0:17126:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b02aa1180 going to sleep for 0 seconds 00010000:00010000:2.0:1783071607.746969:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071608.196594:0:17126:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b02aa1180 going to sleep for 0 seconds 00000040:00080000:2.0:1783071608.197214:0:17119:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1783071608.771570:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071609.221056:0:17126:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b02aa1180 going to sleep for 0 seconds 00000020:01000004:3.0:1783071609.577858:0:17816:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:3.0:1783071609.577863:0:17816:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1783071609.577864:0:17816:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1783071609.577987:0:17816:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8f8b10f78000 00000020:01000004:3.0:1783071609.578006:0:17816:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:3.0:1783071609.578019:0:17816:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1783071609.578038:0:17816:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff8f8b3fed99c0) 00000020:00000080:3.0:1783071609.578055:0:17816:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1783071609.671005:0:17816:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1783071609.671887:0:17816:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1783071609.673184:0:17816:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1783071609.673785:0:17816:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1783071609.674005:0:17816:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1783071609.674205:0:17816:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1783071609.674444:0:17816:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1783071609.674816:0:17816:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1783071609.675048:0:17816:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:2.0:1783071609.675269:0:17816:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1783071609.675511:0:17816:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1783071609.675796:0:17816:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1783071609.676032:0:17816:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1783071609.676248:0:17816:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1783071609.677836:0:17816:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1783071609.678058:0:17816:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1783071609.678298:0:17816:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1783071609.678578:0:17816:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1783071609.679127:0:17816:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1783071609.679312:0:17816:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1783071609.679514:0:17816:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1783071609.679798:0:17816:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1783071609.680018:0:17816:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1783071609.680227:0:17816:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1783071609.680457:0:17816:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1783071609.680762:0:17816:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1783071609.681034:0:17816:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1783071609.681244:0:17816:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1783071609.681510:0:17816:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1783071609.681772:0:17816:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1783071609.682046:0:17816:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1783071609.682314:0:17816:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1783071609.682601:0:17816:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1783071609.682913:0:17816:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1783071609.683097:0:17816:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1783071609.683274:0:17816:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1783071609.683576:0:17816:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1783071609.683874:0:17816:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1783071609.684064:0:17816:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1783071609.684261:0:17816:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1783071609.684485:0:17816:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1783071609.684799:0:17816:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1783071609.685005:0:17816:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1783071609.685345:0:17816:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1783071609.685852:0:17816:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1783071609.686054:0:17816:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00080000:01000000:2.0:1783071609.686840:0:17816:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1783071609.687069:0:17816:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1783071609.687083:0:17816:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1783071609.687096:0:17816:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x6b58994c2cbdd1f8 00000020:01000004:2.0:1783071609.687104:0:17816:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1783071609.687128:0:17816:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.204.138@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1783071609.687132:0:17816:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.138@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1783071609.687139:0:17816:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1783071609.687167:0:17816:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1783071609.687171:0:17816:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.138@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1783071609.694184:0:17816:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.138@tcp ctxt 0 is initialized 00000020:01000004:3.0:1783071609.694229:0:17816:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.138@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1783071609.694234:0:17816:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1783071609.694236:0:17816:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1783071609.694238:0:17816:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783071609.694239:0:17816:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783071609.694240:0:17816:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783071609.694241:0:17816:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783071609.694243:0:17816:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783071609.694244:0:17816:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783071609.694246:0:17816:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783071609.694249:0:17816:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1783071609.694252:0:17816:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783071609.694253:0:17816:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1783071609.694254:0:17816:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783071609.694255:0:17816:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783071609.694256:0:17816:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783071609.694257:0:17816:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783071609.694258:0:17816:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783071609.694259:0:17816:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783071609.694260:0:17816:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783071609.694292:0:17816:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1783071609.694314:0:17816:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02e40e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17816:1869685707674624:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783071609.694551:0:17816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071609.694670:0:17816:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b076f7780 going to sleep for 11 seconds 00000100:00100000:0.0:1783071609.696522:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707674624 00000100:00100000:0.0:1783071609.696534:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707674624 00000100:00100000:0.0:1783071609.696721:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783071609.696733:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+12:17816:x1869685707674624:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783071609.696790:0:17079:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1783071609.696794:0:17079:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1783071609.696801:0:17079:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1783071609.697191:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+12:17816:x1869685707674624:12345-0@lo:253:mount.lustre.0 Request processed in 459us (2640us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071609.697200:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783071609.697285:0:17816:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02e40e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17816:1869685707674624:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783071609.697297:0:17816:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1783071609.697301:0:17816:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783071609.697302:0:17816:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1783071609.697304:0:17816:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783071609.697305:0:17816:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783071609.697306:0:17816:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783071609.697307:0:17816:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783071609.697308:0:17816:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783071609.697310:0:17816:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783071609.697325:0:17816:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1783071609.697346:0:17816:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8f8b10f78000 from lustre-MDT0001 10000000:01000000:2.0:1783071609.697426:0:17816:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1783071609.697429:0:17816:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1783071609.697437:0:17816:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8f8b34e64d40 local copy 00010000:00010000:2.0:1783071609.697450:0:17816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8a03864600/0x6b58994c2cbdd0ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd0f5 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071609.697566:0:17816:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17816:1869685707674752:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783071609.697602:0:17816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071609.697987:0:17816:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b419cd000 going to sleep for 11 seconds 00000100:00100000:3.0:1783071609.698019:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707674752 00000100:00100000:3.0:1783071609.698025:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707674752 00000100:00100000:3.0:1783071609.698056:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783071609.698063:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+12:17816:x1869685707674752:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783071609.698135:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+12:17816:x1869685707674752:12345-0@lo:501:mount.lustre.0 Request processed in 72us (532us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783071609.698143:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783071609.698256:0:17816:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17816:1869685707674752:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1783071609.698270:0:17816:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.138@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1783071609.698289:0:17816:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.138@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1783071609.698296:0:17816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8a03864600/0x6b58994c2cbdd0ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd0f5 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071609.698305:0:17816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8a03864600/0x6b58994c2cbdd0ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd0f5 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071609.698332:0:17816:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f8b10f78000 10000000:01000000:2.0:1783071609.698336:0:17816:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1783071609.698341:0:17816:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8f8b34e64d40 10000000:01000000:2.0:1783071609.698343:0:17816:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1783071609.698346:0:17816:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8f8b34e64d40 from 1 10000000:01000000:2.0:1783071609.698348:0:17816:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1783071609.698455:0:17816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67e00/0x6b58994c2cbdd1ff lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071609.698465:0:17816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67e00/0x6b58994c2cbdd1ff lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071609.698483:0:17816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67e00/0x6b58994c2cbdd1ff lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071609.698496:0:17816:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17816:1869685707674880:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783071609.698524:0:17816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071609.698551:0:17816:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b419cd000 going to sleep for 11 seconds 00000100:00100000:3.0:1783071609.698587:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707674880 00000100:00100000:3.0:1783071609.698591:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707674880 00000100:00100000:3.0:1783071609.698629:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783071609.698636:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+12:17816:x1869685707674880:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783071609.698645:0:17081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071609.698657:0:17081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8a01748800/0x6b58994c2cbdd206 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdd1ff expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071609.698677:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8a01748800/0x6b58994c2cbdd206 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdd1ff expref: 13 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071609.698686:0:17081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8a01748800/0x6b58994c2cbdd206 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdd1ff expref: 13 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071609.698695:0:17081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a01748800, rc 0) 00000100:00100000:3.0:1783071609.698735:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+13:17816:x1869685707674880:12345-0@lo:101:mount.lustre.0 Request processed in 100us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071609.698741:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783071609.698943:0:17816:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17816:1869685707674880:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783071609.698956:0:17816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67e00/0x6b58994c2cbdd1ff lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd206 expref: -99 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071609.698965:0:17816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67e00/0x6b58994c2cbdd1ff lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdd206 expref: -99 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071609.698979:0:17816:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1783071609.698998:0:17816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67e00/0x6b58994c2cbdd1ff lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd206 expref: -99 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071609.699005:0:17816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67e00/0x6b58994c2cbdd1ff lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd206 expref: -99 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071609.699012:0:17816:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8f8b10f78000 10000000:01000000:2.0:1783071609.699016:0:17816:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1783071609.699019:0:17816:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff8f8b10f78000 from 1 10000000:01000000:2.0:1783071609.699021:0:17816:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1783071609.699035:0:17816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66000/0x6b58994c2cbdd20d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071609.699042:0:17816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66000/0x6b58994c2cbdd20d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071609.699056:0:17816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66000/0x6b58994c2cbdd20d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071609.699068:0:17816:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17816:1869685707675008:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783071609.699093:0:17816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071609.699113:0:17816:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b419cd000 going to sleep for 11 seconds 00000100:00100000:3.0:1783071609.699150:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707675008 00000100:00100000:3.0:1783071609.699155:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707675008 00000100:00100000:3.0:1783071609.699220:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783071609.699227:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+13:17816:x1869685707675008:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783071609.699235:0:17081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071609.699243:0:17081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8a01748a00/0x6b58994c2cbdd214 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdd20d expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071609.699257:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8a01748a00/0x6b58994c2cbdd214 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdd20d expref: 14 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071609.699265:0:17081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8a01748a00/0x6b58994c2cbdd214 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdd20d expref: 14 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071609.699277:0:17081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a01748a00, rc 0) 00000100:00100000:3.0:1783071609.699311:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+14:17816:x1869685707675008:12345-0@lo:101:mount.lustre.0 Request processed in 84us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071609.699317:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783071609.699578:0:17816:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17816:1869685707675008:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783071609.699589:0:17816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66000/0x6b58994c2cbdd20d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd214 expref: -99 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071609.699597:0:17816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66000/0x6b58994c2cbdd20d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdd214 expref: -99 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071609.699607:0:17816:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1783071609.699612:0:17816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66000/0x6b58994c2cbdd20d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd214 expref: -99 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071609.699618:0:17816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66000/0x6b58994c2cbdd20d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd214 expref: -99 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071609.699636:0:17816:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1783071609.699640:0:17816:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783071609.699644:0:17816:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8f8b10f78000 10000000:01000000:2.0:1783071609.699647:0:17816:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1783071609.699650:0:17816:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1783071609.699651:0:17816:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1783071609.699664:0:17816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67a00/0x6b58994c2cbdd21b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071609.699676:0:17816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67a00/0x6b58994c2cbdd21b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071609.699682:0:17816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67a00/0x6b58994c2cbdd21b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071609.699694:0:17816:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17816:1869685707675136:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783071609.699731:0:17816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071609.700148:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707675136 00000100:00100000:1.0:1783071609.700155:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707675136 00000100:00100000:2.0:1783071609.700170:0:17816:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b419cd000 going to sleep for 11 seconds 00000100:00100000:1.0:1783071609.700189:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783071609.700211:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+14:17816:x1869685707675136:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783071609.700221:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071609.700233:0:17079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8a03bd7c00/0x6b58994c2cbdd222 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdd21b expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071609.700465:0:17079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8a03bd7c00/0x6b58994c2cbdd222 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdd21b expref: 15 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071609.700477:0:17079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8a03bd7c00/0x6b58994c2cbdd222 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdd21b expref: 15 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071609.700485:0:17079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a03bd7c00, rc 0) 00000100:00100000:1.0:1783071609.700531:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+15:17816:x1869685707675136:12345-0@lo:101:mount.lustre.0 Request processed in 334us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071609.700538:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783071609.700606:0:17816:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17816:1869685707675136:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783071609.700716:0:17816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67a00/0x6b58994c2cbdd21b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd222 expref: -99 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071609.700726:0:17816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67a00/0x6b58994c2cbdd21b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdd222 expref: -99 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783071609.702013:0:17816:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:2.0:1783071609.702954:0:17816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783071609.710228:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1783071609.710283:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:2.0:1783071609.710298:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:2.0:1783071609.710310:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:2.0:1783071609.710322:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:2.0:1783071609.710336:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:2.0:1783071609.710351:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:2.0:1783071609.710554:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:2.0:1783071609.710701:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:2.0:1783071609.710727:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:2.0:1783071609.710751:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:2.0:1783071609.710765:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:2.0:1783071609.710777:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:2.0:1783071609.710858:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:2.0:1783071609.710871:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:2.0:1783071609.710883:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:2.0:1783071609.710895:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:2.0:1783071609.710909:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:2.0:1783071609.710923:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:2.0:1783071609.710936:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:2.0:1783071609.710952:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:2.0:1783071609.710964:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:2.0:1783071609.710977:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:2.0:1783071609.711005:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:2.0:1783071609.711011:0:17816:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:2.0:1783071609.711118:0:17816:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17816:1869685707675264:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783071609.711187:0:17816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071609.715545:0:17816:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b419cd840 going to sleep for 11 seconds 00000100:00100000:0.0:1783071609.719090:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707675264 00000100:00100000:0.0:1783071609.719106:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707675264 00000100:00100000:0.0:1783071609.719204:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783071609.719214:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+15:17816:x1869685707675264:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783071609.720645:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+15:17816:x1869685707675264:12345-0@lo:501:mount.lustre.0 Request processed in 1426us (9451us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071609.720657:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783071609.721102:0:17816:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17816:1869685707675264:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783071609.721167:0:17816:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17816:1869685707675392:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783071609.721228:0:17816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071609.721256:0:17816:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b419cd840 going to sleep for 11 seconds 00000100:00100000:1.0:1783071609.721305:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707675392 00000100:00100000:1.0:1783071609.721311:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707675392 00000100:00100000:1.0:1783071609.721392:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783071609.721403:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+15:17816:x1869685707675392:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783071609.722483:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+15:17816:x1869685707675392:12345-0@lo:503:mount.lustre.0 Request processed in 1077us (1249us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071609.722493:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783071609.723457:0:17816:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17816:1869685707675392:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1783071609.724633:0:17816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783071609.724730:0:17816:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17816:1869685707675520:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783071609.724803:0:17816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071609.724854:0:17816:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b419cd000 going to sleep for 11 seconds 00000100:00100000:0.0:1783071609.725387:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707675520 00000100:00100000:0.0:1783071609.725397:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707675520 00000100:00100000:0.0:1783071609.725459:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783071609.725470:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+15:17816:x1869685707675520:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783071609.731548:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+15:17816:x1869685707675520:12345-0@lo:502:mount.lustre.0 Request processed in 6070us (6734us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071609.731565:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783071609.732129:0:17816:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17816:1869685707675520:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783071609.732474:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1783071609.732506:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:3.0:1783071609.732520:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:3.0:1783071609.732533:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:3.0:1783071609.732545:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:3.0:1783071609.732558:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:3.0:1783071609.732573:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:3.0:1783071609.732586:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:3.0:1783071609.732600:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:3.0:1783071609.732615:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:3.0:1783071609.732627:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:3.0:1783071609.732637:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:3.0:1783071609.732648:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:3.0:1783071609.732660:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:3.0:1783071609.732670:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:3.0:1783071609.732682:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:3.0:1783071609.732717:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:3.0:1783071609.732735:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:3.0:1783071609.732747:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:3.0:1783071609.732758:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:3.0:1783071609.732771:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:3.0:1783071609.732796:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:3.0:1783071609.732812:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:3.0:1783071609.732826:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:3.0:1783071609.732852:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:3.0:1783071609.732865:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:3.0:1783071609.732877:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:3.0:1783071609.732889:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:3.0:1783071609.732901:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:3.0:1783071609.732914:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:3.0:1783071609.732927:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:3.0:1783071609.732939:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:3.0:1783071609.732950:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:3.0:1783071609.732964:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:3.0:1783071609.732975:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:3.0:1783071609.732985:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:3.0:1783071609.732995:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:3.0:1783071609.733009:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:3.0:1783071609.733021:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:3.0:1783071609.733031:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:3.0:1783071609.733042:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:3.0:1783071609.733053:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:3.0:1783071609.733064:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:3.0:1783071609.733075:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:3.0:1783071609.733115:0:17816:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02e42a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17816:1869685707675648:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783071609.733180:0:17816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071609.733232:0:17816:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b06962000 going to sleep for 11 seconds 00000100:00100000:1.0:1783071609.737050:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707675648 00000100:00100000:1.0:1783071609.737069:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707675648 00000100:00100000:1.0:1783071609.737141:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783071609.737152:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+15:17816:x1869685707675648:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783071609.737416:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+15:17816:x1869685707675648:12345-0@lo:502:mount.lustre.0 Request processed in 265us (4235us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071609.737424:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783071609.739616:0:17816:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02e42a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17816:1869685707675648:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783071609.739748:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:2.0:1783071609.739766:0:17816:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:2.0:1783071609.740569:0:17820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783071609.740580:0:17820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071609.740583:0:17820:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1783071609.740589:0:17820:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1783071609.740592:0:17820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783071609.740607:0:17820:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff8f8b3c6ccd40) 00000020:00000080:2.0:1783071609.740627:0:17820:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:2.0:1783071609.740633:0:17820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1783071609.740728:0:17820:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1783071609.740735:0:17820:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x6b58994c2cbdd230 00000020:00000080:2.0:1783071609.740962:0:17820:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1783071609.740966:0:17820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783071609.740969:0:17820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071609.740970:0:17820:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1783071609.740973:0:17820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783071609.740976:0:17820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071609.740978:0:17820:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1783071609.740981:0:17820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783071609.740988:0:17820:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff8f8b3c6c99c0) 00000020:00000080:2.0:1783071609.740998:0:17820:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:2.0:1783071609.741002:0:17820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1783071609.741005:0:17820:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1783071609.741008:0:17820:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1783071609.741013:0:17820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1783071609.741074:0:17820:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f8b10f78000 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1783071609.741086:0:17820:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff8f8b3c6c8000) 00000020:00000080:2.0:1783071609.741096:0:17820:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:2.0:1783071609.741155:0:17820:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1783071609.741162:0:17820:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x6b58994c2cbdd245 00000020:00000080:2.0:1783071609.741266:0:17820:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1783071609.741278:0:17820:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1783071609.741282:0:17820:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x6b58994c2cbdd24c 00080000:01000000:2.0:1783071609.741288:0:17820:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:2.0:1783071609.741292:0:17820:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x6b58994c2cbdd253 00010000:00010000:2.0:1783071609.794632:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071609.856235:0:17820:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:1.0:1783071609.857907:0:17820:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:1.0:1783071609.858762:0:17820:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1783071609.860326:0:17820:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1783071609.860340:0:17820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783071609.860346:0:17820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071609.860348:0:17820:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1783071609.860353:0:17820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783071609.860360:0:17820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071609.860377:0:17820:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1783071609.860382:0:17820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783071609.860388:0:17820:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.138@tcp to nid 0x20000c0a8cc8a (192.168.204.138@tcp) 00000020:00000080:3.0:1783071609.860425:0:17820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783071609.860440:0:17820:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff8f8b3fed8000) 00000020:00000080:3.0:1783071609.860462:0:17820:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1783071609.860468:0:17820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1783071609.860561:0:17820:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1783071609.860569:0:17820:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:3.0:1783071609.860577:0:17820:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x6b58994c2cbdd261 00010000:00080000:3.0:1783071609.860627:0:17820:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f8b3b4b6000@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.138@tcp at head 00010000:00010000:3.0:1783071609.873748:0:17820:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:0.0:1783071609.878673:0:17820:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1783071609.878693:0:17820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1783071609.878745:0:17820:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1783071609.878770:0:17820:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x6b58994c2cbdd268 00000100:00080000:0.0:1783071609.878781:0:17820:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783071609.878788:0:17820:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8f8b3b4b6000 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:0.0:1783071609.878829:0:17820:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8a01767b80 x1869685707675776/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783071609.878863:0:17820:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:0.0:1783071609.878999:0:17820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783071609.879003:0:17820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783071609.879005:0:17820:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1783071609.879008:0:17820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1783071609.879011:0:17820:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1783071609.879013:0:17820:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783071609.879014:0:17820:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783071609.879026:0:17820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1783071609.879028:0:17820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783071609.879030:0:17820:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1783071609.879033:0:17820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783071609.879038:0:17820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783071609.879040:0:17820:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1783071609.879044:0:17820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1783071609.879082:0:17820:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1783071609.879095:0:17820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783071609.879099:0:17820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783071609.879100:0:17820:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1783071609.879103:0:17820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1783071609.879104:0:17820:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #19 00000020:01000000:0.0:1783071609.879105:0:17820:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783071609.879107:0:17820:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783071609.879108:0:17820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1783071609.879111:0:17820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783071609.879112:0:17820:0:(obd_config.c:1561:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:0.0:1783071609.879114:0:17820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783071609.879118:0:17820:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1783071609.879121:0:17820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783071609.879122:0:17820:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1783071609.879125:0:17820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1783071609.879129:0:17820:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.138@tcp to nid 0x20000c0a8cc8a (192.168.204.138@tcp) 00000020:01000000:0.0:1783071609.879155:0:17820:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1783071609.879158:0:17820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783071609.879184:0:17820:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8f8b3d5cb380) 00000020:00000080:0.0:1783071609.879198:0:17820:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1783071609.879204:0:17820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1783071609.879276:0:17820:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1783071609.879284:0:17820:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:0.0:1783071609.879291:0:17820:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x6b58994c2cbdd276 00010000:00080000:0.0:1783071609.879325:0:17820:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f8a01e4e800@lustre-OST0000-osc-MDT0001: add connection 192.168.204.138@tcp at head 00000100:00100000:1.0:1783071609.879429:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01767b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1869685707675776:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783071609.879517:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783071609.879595:0:17820:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:2.0:1783071609.879943:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707675776 00000100:00100000:2.0:1783071609.879952:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707675776 00000100:00100000:2.0:1783071609.879993:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783071609.880002:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1869685707675776:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1783071609.880029:0:17091:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 511 last 0 00000020:00000080:2.0:1783071609.880061:0:17091:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x6b58994c2cbdd27d 00000004:00100000:2.0:1783071609.880079:0:17091:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1783071609.880085:0:17091:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000040:01000000:1.0:1783071609.881175:0:17820:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00080000:3.0:1783071609.888565:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1783071609.888578:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1783071609.888583:0:38:0:(import.c:65:import_set_state_nolock()) ffff8f8b13d45800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783071609.888592:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 507 00000100:00080000:3.0:1783071609.888597:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1783071609.888606:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8f8b13d45800 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:3.0:1783071609.888650:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8a02e41880 x1869685707675904/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783071609.888681:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783071609.888685:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783071609.888688:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783071609.888691:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783071609.888755:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783071609.888772:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02e42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869685707676032:0@lo:400:kworker.0 00000100:00100000:3.0:1783071609.888863:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071609.888931:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707676032 00000100:00100000:0.0:1783071609.888940:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707676032 00000100:00100000:0.0:1783071609.888999:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783071609.889010:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02e43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869685707676032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071609.889069:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02e43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869685707676032:12345-0@lo:400:kworker.0 Request processed in 61us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071609.889076:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783071609.890500:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02e41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869685707675904:0@lo:38:kworker.0 00000100:00100000:1.0:1783071609.890647:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071609.890954:0:17090:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1783071609.890965:0:17090:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00010000:00080000:3.0:1783071609.891059:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8f8a02e42300 x1869685707676032/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071625 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071609.891090:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02e42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869685707676032:0@lo:400:kworker.0 00000100:00100000:3.0:1783071609.891943:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707675904 00000100:00100000:3.0:1783071609.891953:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707675904 00000100:00100000:0.0:1783071609.892457:0:17825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783071609.892467:0:17825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3644:x1869685707675904:12345-0@lo:38:kworker.0 00000040:01000000:2.0:1783071609.892569:0:17820:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:0.0:1783071609.892570:0:17825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3644:x1869685707675904:12345-0@lo:38:kworker.0 Request processed in 103us (1922us total) trans 0 rc -11/-11 00000100:00100000:0.0:1783071609.892580:0:17825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783071609.892954:0:3644:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783071609.892964:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8f8b13d45800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783071609.892970:0:3644:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783071609.892974:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02e41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869685707675904:0@lo:38:kworker.0 00000100:00080000:3.0:1783071609.895255:0:17091:0:(import.c:65:import_set_state_nolock()) ffff8f8b34e2d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783071609.895580:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3644:x1869685707675776:12345-0@lo:38:llog_process_th.0 Request processed in 15575us (16060us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071609.895600:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000040:00080000:2.0:1783071609.895894:0:17820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783071609.896230:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1783071609.896390:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:2.0:1783071609.896874:0:17826:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1783071609.896879:0:17826:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00100000:0.0:1783071609.897309:0:3644:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783071609.897321:0:3644:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1783071609.897330:0:3644:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1783071609.897336:0:3644:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1783071609.897341:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8f8b3b4b6000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783071609.897428:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01767b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1869685707675776:0@lo:38:llog_process_th.0 00000020:00000080:2.0:1783071609.897920:0:17820:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1783071609.897933:0:17820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1783071609.897976:0:17820:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1783071609.897997:0:17820:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x6b58994c2cbdd284 00000100:00080000:2.0:1783071609.898005:0:17820:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783071609.898011:0:17820:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8f8a01e4e800 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:2.0:1783071609.898050:0:17820:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8a032e4700 x1869685707676160/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783071609.898083:0:17820:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1783071609.898147:0:17820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783071609.898160:0:17820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071609.898162:0:17820:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1783071609.898165:0:17820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1783071609.898168:0:17820:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #26 00000020:01000000:2.0:1783071609.898170:0:17820:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783071609.898172:0:17820:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783071609.898173:0:17820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1783071609.898176:0:17820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071609.898177:0:17820:0:(obd_config.c:1561:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:2.0:1783071609.898181:0:17820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783071609.898186:0:17820:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1783071609.898189:0:17820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071609.898191:0:17820:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1783071609.898194:0:17820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1783071609.898197:0:17820:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.138@tcp to nid 0x20000c0a8cc8a (192.168.204.138@tcp) 00000020:01000000:2.0:1783071609.898221:0:17820:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1783071609.898224:0:17820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783071609.898237:0:17820:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8f8b3b5c3380) 00000020:00000080:2.0:1783071609.898249:0:17820:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:2.0:1783071609.898254:0:17820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1783071609.898313:0:17820:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1783071609.898320:0:17820:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:2.0:1783071609.898325:0:17820:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x6b58994c2cbdd292 00010000:00080000:2.0:1783071609.898355:0:17820:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f8b3b4b0800@lustre-OST0001-osc-MDT0001: add connection 192.168.204.138@tcp at head 00010000:00010000:2.0:1783071609.898566:0:17820:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1783071609.898626:0:17820:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1783071609.898641:0:17820:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:3.0:1783071609.899047:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783071609.899053:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783071609.899056:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783071609.899059:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783071609.899166:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1869685707676160:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1783071609.899223:0:3644:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869685707676160 offset 0 length 520: 4 00000100:00100000:3.0:1783071609.899830:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01767b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707676288:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783071609.899885:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071609.899936:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707676288 00000100:00100000:0.0:1783071609.899943:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707676288 00000100:00100000:0.0:1783071609.900040:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783071609.900050:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02e42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1869685707676288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783071609.900097:0:17090:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1783071609.900202:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02e42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1869685707676288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 153us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071609.900210:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000040:00080000:2.0:1783071609.901049:0:17820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783071609.901243:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000100:00100000:3.0:1783071609.901318:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01767b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707676288:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1783071609.901384:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000020:00000080:2.0:1783071609.902679:0:17820:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1783071609.902692:0:17820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1783071609.902755:0:17820:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1783071609.902853:0:17820:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x6b58994c2cbdd299 00000100:00080000:2.0:1783071609.902865:0:17820:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783071609.902871:0:17820:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8f8b3b4b0800 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:2.0:1783071609.902923:0:17820:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8a032e7b80 x1869685707676416/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783071609.902996:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1869685707676416:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1783071609.903057:0:3644:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869685707676416 offset 0 length 520: 4 00000100:00080000:2.0:1783071609.903111:0:17820:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1783071609.903178:0:17820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783071609.903183:0:17820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071609.903185:0:17820:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1783071609.903189:0:17820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783071609.903193:0:17820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071609.903194:0:17820:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783071609.903197:0:17820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783071609.903199:0:17820:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1783071609.903201:0:17820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783071609.903203:0:17820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071609.903205:0:17820:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:2.0:1783071609.903207:0:17820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783071609.903209:0:17820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071609.903211:0:17820:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1783071609.903214:0:17820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1783071609.903248:0:17820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783071609.903252:0:17820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071609.903253:0:17820:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1783071609.903257:0:17820:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000100:00080000:3.0:1783071609.903485:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783071609.903490:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783071609.903493:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783071609.903496:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:3.0:1783071609.903515:0:17816:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:3.0:1783071609.903546:0:17816:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1783071609.903573:0:17816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67a00/0x6b58994c2cbdd21b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd222 expref: -99 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071609.903599:0:17816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67a00/0x6b58994c2cbdd21b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd222 expref: -99 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783071609.903607:0:17816:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8f8b10f78000 from 1 10000000:01000000:3.0:1783071609.903610:0:17816:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783071609.903639:0:17816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8a01749c00/0x6b58994c2cbdd2a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071609.903647:0:17816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8a01749c00/0x6b58994c2cbdd2a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071609.903658:0:17816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8a01749c00/0x6b58994c2cbdd2a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071609.903676:0:17816:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02e42d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17816:1869685707676544:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783071609.903729:0:17816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071609.903758:0:17816:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b069623c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783071609.905054:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707676544 00000100:00100000:1.0:1783071609.905068:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707676544 00000100:00100000:1.0:1783071609.905137:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783071609.905147:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+15:17816:x1869685707676544:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783071609.905165:0:17078:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071609.905180:0:17078:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8a03bd6400/0x6b58994c2cbdd2a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdd2a0 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071609.905208:0:17078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8a03bd6400/0x6b58994c2cbdd2a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdd2a0 expref: 16 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071609.905218:0:17078:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8a03bd6400/0x6b58994c2cbdd2a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdd2a0 expref: 16 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071609.905227:0:17078:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a03bd6400, rc 0) 00000040:00080000:0.0:1783071609.905241:0:17828:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1783071609.905246:0:17828:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000100:00100000:1.0:1783071609.905308:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+16:17816:x1869685707676544:12345-0@lo:101:mount.lustre.0 Request processed in 162us (1579us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071609.905315:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783071609.905337:0:17816:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02e42d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17816:1869685707676544:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783071609.905355:0:17816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8a01749c00/0x6b58994c2cbdd2a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd2a7 expref: -99 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071609.905381:0:17816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8a01749c00/0x6b58994c2cbdd2a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdd2a7 expref: -99 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071609.906640:0:17816:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01767480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17816:1869685707676672:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1783071609.906710:0:17816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071609.906754:0:17816:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b076863c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071609.906794:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707676672 00000100:00100000:3.0:1783071609.906801:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707676672 00000100:00100000:3.0:1783071609.906849:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783071609.906854:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+16:17816:x1869685707676672:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1783071609.906873:0:17081:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1783071609.906888:0:17081:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1783071609.906891:0:17081:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1783071609.906993:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+16:17816:x1869685707676672:12345-0@lo:256:mount.lustre.0 Request processed in 137us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071609.907000:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783071609.907255:0:17816:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01767480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17816:1869685707676672:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1783071609.909600:0:17816:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783071609.909868:0:17816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8a01749c00/0x6b58994c2cbdd2a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd2a7 expref: -99 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071609.909878:0:17816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8a01749c00/0x6b58994c2cbdd2a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd2a7 expref: -99 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783071609.909885:0:17816:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8f8b10f78000 from 1 10000000:01000000:0.0:1783071609.909887:0:17816:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783071609.909920:0:17816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8a03865800/0x6b58994c2cbdd2ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071609.910018:0:17816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8a03865800/0x6b58994c2cbdd2ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071609.910030:0:17816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8a03865800/0x6b58994c2cbdd2ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071609.910055:0:17816:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01767480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17816:1869685707676800:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783071609.910132:0:17816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071609.910178:0:17816:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b076863c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071609.910833:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707676800 00000100:00100000:3.0:1783071609.910842:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707676800 00000100:00100000:3.0:1783071609.910906:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783071609.910915:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+16:17816:x1869685707676800:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783071609.910928:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071609.910955:0:17079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8a01749e00/0x6b58994c2cbdd2b5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdd2ae expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071609.910984:0:17079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8a01749e00/0x6b58994c2cbdd2b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdd2ae expref: 17 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071609.910994:0:17079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8a01749e00/0x6b58994c2cbdd2b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdd2ae expref: 17 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071609.911002:0:17079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a01749e00, rc 0) 00000100:00100000:3.0:1783071609.911073:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+17:17816:x1869685707676800:12345-0@lo:101:mount.lustre.0 Request processed in 158us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071609.911080:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783071609.911240:0:17816:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01767480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17816:1869685707676800:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783071609.911256:0:17816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8a03865800/0x6b58994c2cbdd2ae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd2b5 expref: -99 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071609.911265:0:17816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8a03865800/0x6b58994c2cbdd2ae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdd2b5 expref: -99 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783071609.911445:0:17816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783071609.911481:0:17816:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17816:1869685707676928:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783071609.911516:0:17816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071609.911550:0:17816:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b06c44000 going to sleep for 11 seconds 00000100:00100000:0.0:1783071609.911616:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707676928 00000100:00100000:0.0:1783071609.911620:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707676928 00000100:00100000:0.0:1783071609.911654:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783071609.911662:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+17:17816:x1869685707676928:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783071609.911923:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+17:17816:x1869685707676928:12345-0@lo:501:mount.lustre.0 Request processed in 260us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071609.911930:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783071609.912829:0:17816:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17816:1869685707676928:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783071609.912874:0:17816:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17816:1869685707677056:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783071609.912927:0:17816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071609.912969:0:17816:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b06c44000 going to sleep for 11 seconds 00000100:00100000:2.0:1783071609.913009:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707677056 00000100:00100000:2.0:1783071609.913017:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707677056 00000100:00100000:2.0:1783071609.917891:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783071609.917921:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+17:17816:x1869685707677056:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783071609.918934:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+17:17816:x1869685707677056:12345-0@lo:503:mount.lustre.0 Request processed in 1026us (6001us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071609.918957:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783071609.919781:0:17816:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17816:1869685707677056:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1783071609.920212:0:17816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783071609.920310:0:17816:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17816:1869685707677184:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783071609.920402:0:17816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071609.920451:0:17816:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b06c44300 going to sleep for 11 seconds 00000100:00100000:3.0:1783071609.920734:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707677184 00000100:00100000:3.0:1783071609.920741:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707677184 00000100:00100000:3.0:1783071609.920788:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783071609.920797:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+17:17816:x1869685707677184:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783071609.921284:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+17:17816:x1869685707677184:12345-0@lo:502:mount.lustre.0 Request processed in 487us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071609.921292:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783071609.921431:0:17816:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17816:1869685707677184:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783071609.921693:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1783071609.921742:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:1.0:1783071609.921758:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:1.0:1783071609.921772:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:1.0:1783071609.921786:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:1.0:1783071609.921799:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:1.0:1783071609.921813:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:1.0:1783071609.921827:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:1.0:1783071609.921842:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1783071609.921855:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:1.0:1783071609.921869:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:1.0:1783071609.921898:0:17816:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17816:1869685707677312:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783071609.921941:0:17816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071609.921980:0:17816:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b06c44300 going to sleep for 11 seconds 00000100:00100000:2.0:1783071609.922953:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707677312 00000100:00100000:2.0:1783071609.922962:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707677312 00000100:00100000:2.0:1783071609.923020:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783071609.923031:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+17:17816:x1869685707677312:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783071609.923205:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+17:17816:x1869685707677312:12345-0@lo:502:mount.lustre.0 Request processed in 176us (1263us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071609.923212:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783071609.923272:0:17816:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17816:1869685707677312:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783071609.923341:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:1.0:1783071609.923352:0:17816:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1783071609.924817:0:17830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783071609.924833:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071609.924836:0:17830:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1783071609.924845:0:17830:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f8b10f78000 00000020:00000080:2.0:1783071609.924848:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783071609.924857:0:17830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783071609.924859:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071609.924861:0:17830:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1783071609.924864:0:17830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783071609.924866:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071609.924867:0:17830:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1783071609.924871:0:17830:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f8b10f78000 00000020:00000080:2.0:1783071609.924873:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783071609.924949:0:17830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783071609.924953:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071609.924954:0:17830:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1783071609.924957:0:17830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783071609.924960:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071609.924961:0:17830:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1783071609.924965:0:17830:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f8b10f78000 00000020:00000080:2.0:1783071609.924968:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783071609.924987:0:17830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783071609.925018:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071609.925019:0:17830:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1783071609.925023:0:17830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783071609.925025:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071609.925027:0:17830:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1783071609.925031:0:17830:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f8b10f78000 00000020:00000080:2.0:1783071609.925033:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783071609.925057:0:17830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783071609.925060:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071609.925061:0:17830:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1783071609.925064:0:17830:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:0.0:1783071609.925236:0:17816:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1783071609.925270:0:17816:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783071609.925299:0:17816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8a03865800/0x6b58994c2cbdd2ae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd2b5 expref: -99 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071609.925312:0:17816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8a03865800/0x6b58994c2cbdd2ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd2b5 expref: -99 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783071609.925403:0:17816:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1783071609.925406:0:17816:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f8b10f78000 10000000:01000000:0.0:1783071609.925410:0:17816:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f8b10f78000 10000000:01000000:0.0:1783071609.925420:0:17816:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783071609.925427:0:17816:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8f8b10f78000 from 1 10000000:01000000:0.0:1783071609.925441:0:17816:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783071609.925854:0:17816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8a03865400/0x6b58994c2cbdd2bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071609.925866:0:17816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8a03865400/0x6b58994c2cbdd2bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071609.925878:0:17816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8a03865400/0x6b58994c2cbdd2bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071609.925905:0:17816:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01767480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17816:1869685707677440:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783071609.925973:0:17816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071609.926072:0:17816:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b076863c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071609.933599:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707677440 00000100:00100000:3.0:1783071609.933621:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707677440 00000100:00100000:3.0:1783071609.933687:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1783071609.933711:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+17:17816:x1869685707677440:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783071609.933738:0:17081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071609.933756:0:17081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8a01748000/0x6b58994c2cbdd2c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdd2bc expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071609.933799:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8a01748000/0x6b58994c2cbdd2c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdd2bc expref: 18 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071609.933811:0:17081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8a01748000/0x6b58994c2cbdd2c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdd2bc expref: 18 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071609.933821:0:17081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a01748000, rc 0) 00000100:00100000:3.0:1783071609.933908:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+18:17816:x1869685707677440:12345-0@lo:101:mount.lustre.0 Request processed in 211us (7934us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071609.933915:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1783071609.934024:0:17816:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01767480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17816:1869685707677440:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783071609.934048:0:17816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8a03865400/0x6b58994c2cbdd2bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd2c3 expref: -99 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071609.934059:0:17816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8a03865400/0x6b58994c2cbdd2bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdd2c3 expref: -99 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783071609.950392:0:17816:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1783071609.950796:0:17816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783071609.952229:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1783071609.952343:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:3.0:1783071609.952386:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:3.0:1783071609.952405:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:3.0:1783071609.952422:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:3.0:1783071609.952454:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:3.0:1783071609.952479:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:3.0:1783071609.952494:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:3.0:1783071609.952508:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:3.0:1783071609.952523:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:3.0:1783071609.952537:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:3.0:1783071609.952552:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:3.0:1783071609.952565:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:3.0:1783071609.952578:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:3.0:1783071609.952592:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:3.0:1783071609.952604:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:3.0:1783071609.952615:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:3.0:1783071609.952628:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:3.0:1783071609.952643:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:3.0:1783071609.952657:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:3.0:1783071609.952671:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:3.0:1783071609.952777:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:3.0:1783071609.952795:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:3.0:1783071609.952809:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:3.0:1783071609.952822:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:3.0:1783071609.952910:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:3.0:1783071609.952928:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:3.0:1783071609.952943:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:3.0:1783071609.952964:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:3.0:1783071609.952970:0:17816:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1783071609.953243:0:17816:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02e40700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17816:1869685707677568:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783071609.953625:0:17816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071609.953681:0:17816:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b06962d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783071609.953743:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707677568 00000100:00100000:0.0:1783071609.953751:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707677568 00000100:00100000:0.0:1783071609.954697:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783071609.954723:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+18:17816:x1869685707677568:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783071609.954899:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+18:17816:x1869685707677568:12345-0@lo:501:mount.lustre.0 Request processed in 179us (1274us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071609.954907:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783071609.954940:0:17816:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02e40700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17816:1869685707677568:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783071609.954993:0:17816:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02e40700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17816:1869685707677696:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783071609.955044:0:17816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071609.955088:0:17816:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b06962d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783071609.961610:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707677696 00000100:00100000:0.0:1783071609.961626:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707677696 00000100:00100000:0.0:1783071609.961691:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783071609.961715:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+18:17816:x1869685707677696:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783071609.961913:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+18:17816:x1869685707677696:12345-0@lo:503:mount.lustre.0 Request processed in 210us (6867us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071609.961931:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783071609.962006:0:17816:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02e40700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17816:1869685707677696:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1783071609.962573:0:17816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783071609.962659:0:17816:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17816:1869685707677824:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783071609.962724:0:17816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071609.962756:0:17816:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b186cbcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783071609.962892:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707677824 00000100:00100000:0.0:1783071609.962907:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707677824 00000100:00100000:0.0:1783071609.962944:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783071609.962952:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+18:17816:x1869685707677824:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783071609.963050:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+18:17816:x1869685707677824:12345-0@lo:502:mount.lustre.0 Request processed in 97us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071609.963057:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783071609.963221:0:17816:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17816:1869685707677824:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783071609.963780:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1783071609.963815:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:2.0:1783071609.963833:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:2.0:1783071609.963851:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:2.0:1783071609.963871:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:2.0:1783071609.963981:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:2.0:1783071609.963997:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:2.0:1783071609.964008:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:2.0:1783071609.964019:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:2.0:1783071609.964030:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:2.0:1783071609.964042:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:2.0:1783071609.964053:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:2.0:1783071609.964064:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:2.0:1783071609.964084:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:2.0:1783071609.964096:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:2.0:1783071609.964108:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:2.0:1783071609.964119:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:2.0:1783071609.964130:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:2.0:1783071609.964143:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:2.0:1783071609.964156:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:2.0:1783071609.964167:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:2.0:1783071609.964191:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:2.0:1783071609.964204:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:2.0:1783071609.964215:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:2.0:1783071609.964226:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:2.0:1783071609.964238:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:2.0:1783071609.964249:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:2.0:1783071609.964261:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:2.0:1783071609.964273:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:2.0:1783071609.964284:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:2.0:1783071609.964295:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:2.0:1783071609.964307:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:2.0:1783071609.964318:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:2.0:1783071609.964330:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:2.0:1783071609.964341:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:2.0:1783071609.964352:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:2.0:1783071609.964968:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:2.0:1783071609.965020:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:2.0:1783071609.965037:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:2.0:1783071609.965052:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:2.0:1783071609.965066:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:2.0:1783071609.965082:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:2.0:1783071609.965099:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:2.0:1783071609.965115:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:2.0:1783071609.965128:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:2.0:1783071609.965143:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:2.0:1783071609.965169:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:2.0:1783071609.965182:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:2.0:1783071609.965242:0:17816:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17816:1869685707677952:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783071609.965323:0:17816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071609.965465:0:17816:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b186cbcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783071609.974302:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707677952 00000100:00100000:0.0:1783071609.974319:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707677952 00000100:00100000:1.0:1783071609.975974:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783071609.975989:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+18:17816:x1869685707677952:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783071609.976188:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+18:17816:x1869685707677952:12345-0@lo:502:mount.lustre.0 Request processed in 203us (10865us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071609.976198:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783071609.977067:0:17816:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17816:1869685707677952:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783071609.977353:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:2.0:1783071609.977453:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:2.0:1783071609.977495:0:17816:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17816:1869685707678080:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783071609.977562:0:17816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071609.977618:0:17816:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b186cbcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783071609.977845:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707678080 00000100:00100000:0.0:1783071609.977852:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707678080 00000100:00100000:0.0:1783071609.977916:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783071609.977927:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+18:17816:x1869685707678080:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783071609.978045:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+18:17816:x1869685707678080:12345-0@lo:502:mount.lustre.0 Request processed in 119us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071609.978053:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783071609.978227:0:17816:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17816:1869685707678080:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783071609.978282:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:2.0:1783071609.978292:0:17816:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1783071609.980721:0:17837:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1783071609.980739:0:17837:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff8f8b3b5c19c0) 00000020:00000080:2.0:1783071609.980763:0:17837:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1783071609.984663:0:17837:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f8b10f78000 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1783071609.984676:0:17837:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f8b10f78000 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1783071609.984679:0:17837:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8f8b10f78000 3 00010000:00080000:0.0:1783071609.984778:0:17837:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f8a0300d800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.138@tcp at head 00010000:00010000:0.0:1783071609.989203:0:17837:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:0.0:1783071609.989303:0:17837:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1783071609.989347:0:17837:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1783071609.989358:0:17837:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x6b58994c2cbdd2d1 00000100:00080000:0.0:1783071609.989386:0:17837:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783071609.989541:0:17837:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8f8a0300d800 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:1.0:1783071609.989777:0:17837:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8a03a9f800 x1869685707678208/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783071609.989807:0:17837:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1783071609.990005:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783071609.990011:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783071609.990013:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783071609.990016:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783071609.990080:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1869685707678208:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783071609.990166:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071609.990263:0:17085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707678208 00000100:00100000:2.0:1783071609.990270:0:17085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707678208 00000100:00100000:2.0:1783071609.990346:0:17085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783071609.990354:0:17085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01767b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1869685707678208:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1783071609.990417:0:17085:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 511 last 0 00000020:00000080:2.0:1783071609.990461:0:17085:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x6b58994c2cbdd2d8 00000004:00100000:2.0:1783071609.990476:0:17085:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783071609.990506:0:17085:0:(import.c:65:import_set_state_nolock()) ffff8f8b07897800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783071609.990572:0:17085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01767b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1869685707678208:12345-0@lo:38:llog_process_th.0 Request processed in 218us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071609.990579:0:17085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1783071609.990658:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8f8a03a9f800 x1869685707678208/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783071619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071609.990668:0:3644:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783071609.990682:0:3644:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1783071609.990689:0:3644:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1783071609.990693:0:3644:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1783071609.990696:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8f8a0300d800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783071609.990712:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1869685707678208:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1783071609.992065:0:17837:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:3.0:1783071609.992120:0:17816:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1783071609.992231:0:17816:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783071609.992254:0:17816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8a03865400/0x6b58994c2cbdd2bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd2c3 expref: -99 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071609.992266:0:17816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8a03865400/0x6b58994c2cbdd2bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd2c3 expref: -99 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1783071609.992319:0:17816:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1783071609.992321:0:17816:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1783071609.992323:0:17816:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783071609.992324:0:17816:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783071609.992325:0:17816:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783071609.992326:0:17816:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783071609.992328:0:17816:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783071609.992330:0:17816:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783071609.992331:0:17816:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783071609.992335:0:17816:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:3.0:1783071609.992338:0:17816:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783071609.992339:0:17816:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1783071609.992340:0:17816:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783071609.992341:0:17816:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783071609.992342:0:17816:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783071609.992344:0:17816:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783071609.992345:0:17816:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783071609.992346:0:17816:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783071609.992347:0:17816:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783071609.992758:0:17816:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1783071609.992834:0:17816:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02e40a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17816:1869685707678336:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783071609.992901:0:17816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071609.992985:0:17816:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b06962300 going to sleep for 11 seconds 00000100:00100000:2.0:1783071609.993025:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707678336 00000100:00100000:2.0:1783071609.993032:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707678336 00000100:00100000:2.0:1783071609.993209:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783071609.993219:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+18:17816:x1869685707678336:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783071609.993245:0:17079:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1783071609.993258:0:17079:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:2.0:1783071609.996690:0:17066:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1783071609.996774:0:17079:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1783071609.996792:0:17079:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1783071609.996889:0:17101:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783071609.996902:0:17101:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783071609.996922:0:17101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f8b2fd67800/0x6b58994c2cbdd2df lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071609.996942:0:17101:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8a03865a00/0x6b58994c2cbdd1e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdd1dc expref: 18 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071609.996950:0:17101:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8a03bd6400/0x6b58994c2cbdd2a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdd2a0 expref: 18 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071609.996957:0:17101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f8b2fd67800/0x6b58994c2cbdd2df lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071609.996998:0:17101:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8a03bd6400/0x6b58994c2cbdd2a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6b58994c2cbdd2a0 expref: 18 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071609.997022:0:17101:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f8a03bd6400/0x6b58994c2cbdd2a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6b58994c2cbdd2a0 expref: 18 pid: 17078 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071609.997039:0:17101:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e5880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17101:1869685707678464:0@lo:104: 00000100:00100000:2.0:1783071609.997110:0:17101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783071609.997162:0:17101:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8a03865a00/0x6b58994c2cbdd1e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6b58994c2cbdd1dc expref: 18 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071609.997170:0:17101:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f8a03865a00/0x6b58994c2cbdd1e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6b58994c2cbdd1dc expref: 18 pid: 17078 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071609.997179:0:17101:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e6300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17101:1869685707678592:0@lo:104: 00000100:00100000:2.0:1783071609.997200:0:17101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071609.997219:0:17101:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0208bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1783071609.997244:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707678464 00000100:00100000:2.0:1783071609.997251:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707678464 00000100:00100000:2.0:1783071609.997286:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707678592 00000100:00100000:2.0:1783071609.997289:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707678592 00000100:00100000:2.0:1783071609.997303:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783071609.997310:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5ed14122-6273-4ec6-b260-6e79c239c375+4:17101:x1869685707678464:12345-0@lo:104: 00010000:00010000:2.0:1783071609.997322:0:17069:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8f8a01749c00/0x6b58994c2cbdd2a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdd2a7 expref: -99 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071609.997393:0:17069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783071609.997525:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5ed14122-6273-4ec6-b260-6e79c239c375+4:17101:x1869685707678464:12345-0@lo:104: Request processed in 214us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071609.997533:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783071609.997550:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783071609.997564:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5ed14122-6273-4ec6-b260-6e79c239c375+3:17101:x1869685707678592:12345-0@lo:104: 00010000:00010000:2.0:1783071609.997572:0:17069:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8f8a01749400/0x6b58994c2cbdd1dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdd1e3 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071609.997606:0:17069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783071609.997610:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5ed14122-6273-4ec6-b260-6e79c239c375+3:17101:x1869685707678592:12345-0@lo:104: Request processed in 49us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071609.997615:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1783071609.997631:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783071609.997636:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8a01749c00/0x6b58994c2cbdd2a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdd2a7 expref: -99 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071609.997643:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01749c00 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:2.0:1783071609.997647:0:17075:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8a01749c00/0x6b58994c2cbdd2a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6b58994c2cbdd2a7 expref: -99 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071609.997656:0:17075:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8a01749c00/0x6b58994c2cbdd2a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6b58994c2cbdd2a7 expref: -99 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783071609.997663:0:17075:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8a01749c00/0x6b58994c2cbdd2a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6b58994c2cbdd2a7 expref: -99 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071609.997669:0:17075:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783071609.997697:0:17075:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8f8a01749c00/0x6b58994c2cbdd2a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdd2a7 expref: -99 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071609.997715:0:17075:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783071609.997738:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8a01749c00/0x6b58994c2cbdd2a0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdd2a7 expref: -99 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071609.997756:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8a01749c00/0x6b58994c2cbdd2a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdd2a7 expref: -99 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071609.997767:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783071609.997770:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8a01749400/0x6b58994c2cbdd1dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdd1e3 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071609.997776:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01749400 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:2.0:1783071609.997779:0:17075:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8a01749400/0x6b58994c2cbdd1dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6b58994c2cbdd1e3 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071609.997786:0:17075:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8a01749400/0x6b58994c2cbdd1dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6b58994c2cbdd1e3 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783071609.997791:0:17075:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8a01749400/0x6b58994c2cbdd1dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6b58994c2cbdd1e3 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071609.997797:0:17075:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783071609.997811:0:17075:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8f8a01749400/0x6b58994c2cbdd1dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdd1e3 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071609.997817:0:17075:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783071609.997833:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8a01749400/0x6b58994c2cbdd1dc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdd1e3 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071609.997840:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8a01749400/0x6b58994c2cbdd1dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdd1e3 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071609.997851:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071609.997857:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071609.997858:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071609.997864:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071609.997871:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783071609.997882:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ed14122-6273-4ec6-b260-6e79c239c375:3645:1869685707678720:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783071609.997976:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071609.998008:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707678720 00000100:00100000:0.0:1783071609.998013:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707678720 00000100:00100000:2.0:1783071609.998014:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ed14122-6273-4ec6-b260-6e79c239c375:3647:1869685707678848:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783071609.998034:0:17071:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8a03bd6400/0x6b58994c2cbdd2a7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdd2a0 expref: 19 pid: 17078 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071609.998035:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071609.998052:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707678848 00000100:00100000:0.0:1783071609.998055:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707678848 00010000:00010000:0.0:1783071609.998065:0:17071:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8a03865a00/0x6b58994c2cbdd1e3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdd1dc expref: 20 pid: 17078 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071609.998076:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783071609.998081:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783071609.998082:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5ed14122-6273-4ec6-b260-6e79c239c375+20:3645:x1869685707678720:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783071609.998086:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ed14122-6273-4ec6-b260-6e79c239c375+20:3647:x1869685707678848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783071609.998092:0:17072:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071609.998092:0:17071:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071609.998097:0:17071:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8a03bd6400/0x6b58994c2cbdd2a7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdd2a0 expref: 20 pid: 17078 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071609.998098:0:17072:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8a03865a00/0x6b58994c2cbdd1e3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdd1dc expref: 20 pid: 17078 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071609.998108:0:17071:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8a03bd6400/0x6b58994c2cbdd2a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6b58994c2cbdd2a0 expref: 20 pid: 17078 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071609.999001:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+20:17816:x1869685707678336:12345-0@lo:253:mount.lustre.0 Request processed in 5780us (6096us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071609.999023:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783071609.999184:0:17816:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02e40a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:17816:1869685707678336:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1783071609.999199:0:17816:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1783071609.999202:0:17816:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783071609.999204:0:17816:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1783071609.999206:0:17816:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783071609.999207:0:17816:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783071609.999208:0:17816:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783071609.999210:0:17816:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783071609.999211:0:17816:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783071609.999213:0:17816:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783071609.999214:0:17816:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1783071609.999246:0:17816:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1783071609.999301:0:17072:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8a03865a00/0x6b58994c2cbdd1e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6b58994c2cbdd1dc expref: 19 pid: 17078 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071609.999342:0:17071:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071609.999399:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5ed14122-6273-4ec6-b260-6e79c239c375+19:3645:x1869685707678720:12345-0@lo:103:ldlm_bl.0 Request processed in 1316us (1422us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071609.999406:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783071609.999585:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ed14122-6273-4ec6-b260-6e79c239c375:3645:1869685707678720:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783071609.999622:0:17072:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f8b2fd67800/0x6b58994c2cbdd2df lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071609.999632:0:17072:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b2fd67800/0x6b58994c2cbdd2df lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783071609.999648:0:17072:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002755277s 00010000:00010000:2.0:1783071609.999739:0:17072:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f8b2fd67800/0x6b58994c2cbdd2df lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071609.999748:0:17072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f8b2fd67800/0x6b58994c2cbdd2df lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071609.999767:0:17072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f8b2fd67800/0x6b58994c2cbdd2df lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071609.999842:0:17072:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f8b2fd67800/0x6b58994c2cbdd2df lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071609.999850:0:17072:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd67800 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:2.0:1783071609.999855:0:17072:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f8b2fd67800/0x6b58994c2cbdd2df lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071609.999864:0:17072:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f8b2fd67800/0x6b58994c2cbdd2df lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071609.999874:0:17072:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f8b2fd67800/0x6b58994c2cbdd2df lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071609.999885:0:17072:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071609.999928:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ed14122-6273-4ec6-b260-6e79c239c375+18:3647:x1869685707678848:12345-0@lo:103:ldlm_bl.0 Request processed in 1840us (1891us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071609.999935:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783071609.999989:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ed14122-6273-4ec6-b260-6e79c239c375:3647:1869685707678848:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783071609.999991:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8a03bd6400/0x6b58994c2cbdd2a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6b58994c2cbdd2a0 expref: 17 pid: 17078 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071610.000001:0:17101:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e5880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17101:1869685707678464:0@lo:104: 00010000:00010000:2.0:1783071610.000012:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8a03865a00/0x6b58994c2cbdd1e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6b58994c2cbdd1dc expref: 16 pid: 17078 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071610.000020:0:17101:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e6300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17101:1869685707678592:0@lo:104: 00010000:00010000:2.0:1783071610.000033:0:17101:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f8b2fd67800/0x6b58994c2cbdd2df lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071610.000049:0:17101:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f8b2fd67800/0x6b58994c2cbdd2df lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071610.000055:0:17101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f8b2fd67800/0x6b58994c2cbdd2df lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071610.000061:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b2fd67800/0x6b58994c2cbdd2df lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:3.0:1783071610.007691:0:17816:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:1.0:1783071610.007711:0:17842:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1783071610.007716:0:17842:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:1.0:1783071610.008124:0:17843:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1783071610.008214:0:17816:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:0.0:1783071610.009077:0:17844:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01764e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17844:1869685707678976:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1783071610.009264:0:17843:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1783071610.009312:0:17816:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1783071610.009345:0:17816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783071610.009534:0:17844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071610.009564:0:17844:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b2fc82540 going to sleep for 11 seconds 00000004:00000080:3.0:1783071610.010195:0:17816:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1783071610.010206:0:17816:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1783071610.010262:0:17816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783071610.012597:0:17843:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1783071610.012669:0:17843:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:00080000:3.0:1783071610.012988:0:17816:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:2.0:1783071610.013099:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707678976 00000100:00100000:2.0:1783071610.013109:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707678976 00000100:00100000:2.0:1783071610.013166:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783071610.013177:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17844:x1869685707678976:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1783071610.013306:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17844:x1869685707678976:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 130us (3772us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071610.013314:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783071610.014304:0:17844:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01764e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17844:1869685707678976:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1783071610.014360:0:17844:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1783071610.014441:0:17844:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01764e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17844:1869685707679104:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1783071610.014496:0:17844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071610.014532:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707679104 00000100:00100000:0.0:1783071610.014536:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707679104 00000100:00100000:0.0:1783071610.014581:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783071610.014588:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01766d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17844:x1869685707679104:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1783071610.014707:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01766d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17844:x1869685707679104:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 108us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071610.014716:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783071610.014738:0:17844:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b2fc82540 going to sleep for 11 seconds 00000100:00100000:0.0:1783071610.014752:0:17844:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01764e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17844:1869685707679104:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1783071610.014808:0:17844:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01764e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17844:1869685707679232:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1783071610.014833:0:17844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071610.014859:0:17844:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b2fc82600 going to sleep for 11 seconds 00000040:00080000:3.0:1783071610.015515:0:17816:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1783071610.015589:0:17816:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1783071610.015887:0:17816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783071610.016623:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707679232 00000100:00100000:1.0:1783071610.016633:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707679232 00080000:10000000:3.0:1783071610.016651:0:17816:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000100:00100000:1.0:1783071610.016902:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783071610.016912:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17844:x1869685707679232:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1783071610.017004:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17844:x1869685707679232:12345-0@lo:900:lod0001_rec0000.0 Request processed in 94us (2169us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071610.017012:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1783071610.017026:0:17844:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8f8a01764e00 x1869685707679232/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783071626 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071610.017041:0:17844:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01764e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17844:1869685707679232:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1783071610.017115:0:17844:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01764e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17844:1869685707679360:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1783071610.017234:0:17844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071610.017265:0:17844:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b2fc82540 going to sleep for 11 seconds 00000100:00100000:2.0:1783071610.017283:0:17825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707679360 00000100:00100000:2.0:1783071610.017288:0:17825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707679360 00000100:00100000:2.0:1783071610.017325:0:17825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783071610.017332:0:17825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01766a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17844:x1869685707679360:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1783071610.017422:0:17825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01766a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17844:x1869685707679360:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 90us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071610.017428:0:17825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783071610.017588:0:17844:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01764e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17844:1869685707679360:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1783071610.017636:0:17844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00000004:2.0:1783071610.020963:0:17816:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000040:00080000:0.0:1783071610.025116:0:17844:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1783071610.025217:0:17844:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1783071610.025222:0:17844:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:1.0:1783071610.026851:0:17816:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1783071610.026888:0:17816:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffff9cbcc14eb988 00100000:10000000:1.0:1783071610.026897:0:17816:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1783071610.028264:0:17816:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1783071610.028301:0:17816:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.138@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1783071610.028321:0:17816:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1783071610.028349:0:17816:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1783071610.035259:0:17816:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783071610.035674:0:17816:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1783071610.243427:0:17126:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b02aa1180 going to sleep for 0 seconds 00010000:00010000:2.0:1783071610.818531:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783071611.011175:0:17836:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1783071611.138561:0:17083:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783071611.138585:0:17083:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8f8b10f78000 from 8 10000000:01000000:2.0:1783071611.138591:0:17083:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783071611.138637:0:17083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67800/0x6b58994c2cbdd2e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071611.138659:0:17083:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67800/0x6b58994c2cbdd2e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071611.138670:0:17083:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67800/0x6b58994c2cbdd2e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071611.138703:0:17083:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ed14122-6273-4ec6-b260-6e79c239c375:17083:1869685707679488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783071611.138787:0:17083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071611.138881:0:17083:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a038bc600 going to sleep for 11 seconds 00000100:00100000:1.0:1783071611.140928:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707679488 00000100:00100000:1.0:1783071611.140941:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707679488 00000100:00100000:1.0:1783071611.140992:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783071611.141000:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+16:17083:x1869685707679488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783071611.141017:0:17078:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071611.141035:0:17078:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8a03bd7800/0x6b58994c2cbdd2ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdd2e6 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071611.141071:0:17078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8a03bd7800/0x6b58994c2cbdd2ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdd2e6 expref: 17 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071611.141082:0:17078:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8a03bd7800/0x6b58994c2cbdd2ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdd2e6 expref: 17 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071611.141091:0:17078:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a03bd7800, rc 0) 00000100:00100000:1.0:1783071611.141161:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+17:17083:x1869685707679488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (2373us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071611.141167:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783071611.141542:0:17083:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ed14122-6273-4ec6-b260-6e79c239c375:17083:1869685707679488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783071611.141562:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67800/0x6b58994c2cbdd2e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd2ed expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071611.141572:0:17083:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67800/0x6b58994c2cbdd2e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdd2ed expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071611.141647:0:17083:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ed14122-6273-4ec6-b260-6e79c239c375:17083:1869685707679616:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1783071611.141698:0:17083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071611.141736:0:17083:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a038bc600 going to sleep for 11 seconds 00000100:00100000:0.0:1783071611.141842:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707679616 00000100:00100000:0.0:1783071611.141847:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707679616 00000100:00100000:0.0:1783071611.141879:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783071611.141886:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+17:17083:x1869685707679616:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1783071611.141901:0:17079:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783071611.141918:0:17079:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783071611.141921:0:17079:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1783071611.142003:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+17:17083:x1869685707679616:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 117us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071611.142011:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783071611.142264:0:17083:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ed14122-6273-4ec6-b260-6e79c239c375:17083:1869685707679616:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1783071611.142315:0:17083:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783071611.142323:0:17083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67800/0x6b58994c2cbdd2e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd2ed expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071611.142341:0:17083:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67800/0x6b58994c2cbdd2e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd2ed expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071611.142349:0:17083:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783071611.142352:0:17083:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8f8a041ea000 from 8 10000000:01000000:2.0:1783071611.142354:0:17083:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783071611.142403:0:17083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66800/0x6b58994c2cbdd2f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071611.142411:0:17083:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66800/0x6b58994c2cbdd2f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071611.142419:0:17083:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66800/0x6b58994c2cbdd2f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071611.142432:0:17083:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ed14122-6273-4ec6-b260-6e79c239c375:17083:1869685707679744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783071611.142460:0:17083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071611.142483:0:17083:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a038bc600 going to sleep for 11 seconds 00000100:00100000:0.0:1783071611.142536:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707679744 00000100:00100000:0.0:1783071611.142540:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707679744 00000100:00100000:0.0:1783071611.142566:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783071611.142572:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+17:17083:x1869685707679744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783071611.142580:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071611.142590:0:17079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8a03864000/0x6b58994c2cbdd2fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdd2f4 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071611.142607:0:17079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8a03864000/0x6b58994c2cbdd2fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdd2f4 expref: 18 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071611.142616:0:17079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8a03864000/0x6b58994c2cbdd2fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdd2f4 expref: 18 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071611.142623:0:17079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a03864000, rc 0) 00000100:00100000:0.0:1783071611.142668:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+18:17083:x1869685707679744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071611.142674:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783071611.142743:0:17083:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ed14122-6273-4ec6-b260-6e79c239c375:17083:1869685707679744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783071611.142819:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66800/0x6b58994c2cbdd2f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd2fb expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071611.142827:0:17083:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66800/0x6b58994c2cbdd2f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdd2fb expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071611.142866:0:17083:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ed14122-6273-4ec6-b260-6e79c239c375:17083:1869685707679872:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1783071611.142894:0:17083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071611.142922:0:17083:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a038bc600 going to sleep for 11 seconds 00000100:00100000:3.0:1783071611.142977:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707679872 00000100:00100000:3.0:1783071611.142981:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707679872 00000100:00100000:3.0:1783071611.143016:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783071611.143023:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+18:17083:x1869685707679872:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1783071611.143034:0:17081:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783071611.143046:0:17081:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783071611.143049:0:17081:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1783071611.143136:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+18:17083:x1869685707679872:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 113us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071611.143143:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783071611.143298:0:17083:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ed14122-6273-4ec6-b260-6e79c239c375:17083:1869685707679872:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1783071611.143334:0:17083:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783071611.143341:0:17083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66800/0x6b58994c2cbdd2f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd2fb expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071611.143349:0:17083:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66800/0x6b58994c2cbdd2f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd2fb expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071611.266571:0:17126:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b02aa1180 going to sleep for 0 seconds 00010000:00010000:2.0:1783071611.847620:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783071612.035172:0:17836:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1783071612.291857:0:17126:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b02aa1180 going to sleep for 0 seconds 00010000:00010000:2.0:1783071612.866874:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071613.314449:0:17126:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b02aa1180 going to sleep for 0 seconds 00010000:00010000:2.0:1783071613.890990:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783071613.973065:0:18086:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg438-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1783071614.338593:0:17126:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b02aa1180 going to sleep for 0 seconds 00000020:00000004:2.0:1783071614.857561:0:18138:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783071614.857851:0:18138:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783071614.914684:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783071615.299665:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1783071615.299672:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1783071615.299676:0:8:0:(import.c:65:import_set_state_nolock()) ffff8f8b13d45800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783071615.299690:0:8:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8f8b13d45800 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:2.0:1783071615.299879:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8a032e5880 x1869685707680128/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783071615.299909:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783071615.299913:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783071615.299916:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783071615.299920:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783071615.299962:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783071615.299966:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783071615.299969:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783071615.299972:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783071615.300139:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ed14122-6273-4ec6-b260-6e79c239c375:3648:1869685707680000:0@lo:400:kworker.0 00000100:00100000:0.0:1783071615.300231:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071615.300624:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783071615.300632:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869685707680512:0@lo:400:kworker.0 00000100:00100000:0.0:1783071615.300667:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071615.300699:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707680000 00000100:00100000:0.0:1783071615.300706:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707680000 00000100:00100000:0.0:1783071615.300753:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783071615.300762:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+18:3648:x1869685707680000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071615.300818:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+18:3648:x1869685707680000:12345-0@lo:400:kworker.0 Request processed in 57us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071615.300827:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783071615.300890:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707680512 00000100:00100000:0.0:1783071615.300894:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707680512 00000100:00100000:0.0:1783071615.300924:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783071615.300932:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869685707680512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071615.300966:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869685707680512:12345-0@lo:400:kworker.0 Request processed in 36us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071615.300974:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783071615.301004:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707680640:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783071615.301219:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869685707680128:0@lo:38:kworker.0 00000100:00100000:3.0:1783071615.301262:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707680384:0@lo:400:kworker.0 00000100:00100000:3.0:1783071615.301304:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869685707680256:0@lo:400:kworker.0 00000100:00100000:3.0:1783071615.301322:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071615.301436:0:17085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707680256 00000100:00100000:2.0:1783071615.301441:0:17085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707680256 00000100:00100000:2.0:1783071615.301479:0:17085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783071615.301489:0:17085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02e43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1869685707680256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071615.301538:0:17085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02e43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1869685707680256:12345-0@lo:400:kworker.0 Request processed in 51us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071615.301545:0:17085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1783071615.301616:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f8a032e4380 x1869685707680256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071631 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071615.301631:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869685707680256:0@lo:400:kworker.0 00000100:00100000:0.0:1783071615.302550:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071615.302695:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707680640 00000100:00100000:2.0:1783071615.302702:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707680640 00000100:00100000:2.0:1783071615.302812:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783071615.302823:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707680640:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783071615.302863:0:17091:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1783071615.305405:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1783071615.305459:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f8a032e6d80 x1869685707680512/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071631 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071615.305491:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869685707680512:0@lo:400:kworker.0 00000100:00100000:0.0:1783071615.305508:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ed14122-6273-4ec6-b260-6e79c239c375:3648:1869685707680000:0@lo:400:kworker.0 00000100:00100000:0.0:1783071615.305641:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071615.305686:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707680128 00000100:00100000:0.0:1783071615.305694:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707680128 00000100:00100000:2.0:1783071615.305698:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707680640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2874us (4659us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071615.305723:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707680384 00000100:00100000:0.0:1783071615.305728:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707680384 00000100:00100000:0.0:1783071615.305750:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783071615.305931:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1869685707680128:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1783071615.305963:0:17090:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 517 last 0 00000020:00000080:0.0:1783071615.306006:0:17090:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6b58994c2cbdd302 00000004:00100000:0.0:1783071615.306023:0:17090:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1783071615.306030:0:17090:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:2.0:1783071615.306094:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783071615.306122:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783071615.306132:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707680384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071615.306139:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707680640:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783071615.306192:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707680384:12345-0@lo:400:kworker.0 Request processed in 63us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071615.306210:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783071615.306329:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707680384:0@lo:400:kworker.0 00000100:00080000:1.0:1783071615.313754:0:17090:0:(import.c:65:import_set_state_nolock()) ffff8f8b18305000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783071615.313853:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1869685707680128:12345-0@lo:38:kworker.0 Request processed in 8093us (8457us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071615.313866:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1783071615.314107:0:3644:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1783071615.314117:0:3644:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1783071615.314123:0:3644:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1783071615.314126:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8f8b13d45800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1783071615.314149:0:3644:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000074a7f8fd): req@ffff8f8a02e41500 x1869685707673216/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071615.314166:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869685707680128:0@lo:38:kworker.0 00000100:00100000:2.0:1783071615.314273:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707680768:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783071615.314308:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071615.314402:0:17126:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071615.314417:0:17126:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b02aa1180 going to sleep for 11 seconds 00000100:00100000:1.0:1783071615.314435:0:17825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707680768 00000100:00100000:1.0:1783071615.314440:0:17825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707680768 00000100:00100000:1.0:1783071615.314480:0:17825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707673216 00000100:00100000:1.0:1783071615.314484:0:17825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707673216 00000100:00100000:1.0:1783071615.314500:0:17825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783071615.314507:0:17825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:3645:x1869685707680768:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783071615.314540:0:17825:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1783071615.318200:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783071615.318227:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17126:x1869685707673216:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783071615.318653:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17126:x1869685707673216:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 437us (4249us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071615.318662:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783071615.323099:0:17825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1869685707680768:12345-0@lo:41:osp-pre-1-0.0 Request processed in 8578us (8776us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071615.323119:0:17825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783071615.323453:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707680768:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783071615.323475:0:17126:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02e41500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17126:1869685707673216:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1783071615.323527:0:17126:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1783071615.323592:0:17126:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02e41500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17126:1869685707680896:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783071615.323722:0:17126:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071615.323803:0:17126:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b180273c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783071615.323849:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707680896 00000100:00100000:2.0:1783071615.323856:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707680896 00000100:00100000:2.0:1783071615.324273:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783071615.324283:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02e40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17126:x1869685707680896:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1783071615.324477:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02e40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17126:x1869685707680896:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 195us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071615.324484:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783071615.324656:0:17126:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02e41500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17126:1869685707680896:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783071615.324842:0:17126:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02e41500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17126:1869685707681024:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783071615.324870:0:17126:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071615.324898:0:17126:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b180273c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783071615.324918:0:17825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707681024 00000100:00100000:1.0:1783071615.324924:0:17825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707681024 00000100:00100000:1.0:1783071615.324957:0:17825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783071615.324964:0:17825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02e40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17126:x1869685707681024:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1783071615.325030:0:17825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02e40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17126:x1869685707681024:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 67us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071615.325038:0:17825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783071615.325055:0:17126:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02e41500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17126:1869685707681024:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1783071615.325097:0:17126:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783071615.330239:0:17126:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1783071615.330316:0:17126:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 19, retries 0 00000004:00080000:3.0:1783071615.330326:0:17126:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:1.0:1783071615.666273:0:18189:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783071615.666717:0:18189:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783071615.938652:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783071616.575741:0:18237:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff25d7dba0 20000000:00000080:1.0:1783071616.575759:0:18237:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f8b3d5c7400 uarg=0000000000000000 20000000:01000000:1.0:1783071616.575810:0:18237:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1783071616.575817:0:18237:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1783071616.575829:0:18237:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1783071616.576439:0:18238:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:1.0:1783071616.578477:0:18237:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1783071616.585613:0:18237:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1783071616.585649:0:18237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f8a03bd6c00/0x6b58994c2cbdd309 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071616.585670:0:18237:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8a03865c00/0x6b58994c2cbdd1b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdd1ab expref: 17 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071616.585678:0:18237:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8a01749e00/0x6b58994c2cbdd2b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdd2ae expref: 17 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071616.585686:0:18237:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f8a03bd6c00/0x6b58994c2cbdd309 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071616.585736:0:18237:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8a01749e00/0x6b58994c2cbdd2b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6b58994c2cbdd2ae expref: 17 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071616.585755:0:18237:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f8a01749e00/0x6b58994c2cbdd2b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6b58994c2cbdd2ae expref: 17 pid: 17079 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071616.585771:0:18237:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18237:1869685707681152:0@lo:104: 00000100:00100000:1.0:1783071616.585841:0:18237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783071616.585898:0:18237:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8a03865c00/0x6b58994c2cbdd1b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6b58994c2cbdd1ab expref: 17 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071616.585907:0:18237:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f8a03865c00/0x6b58994c2cbdd1b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6b58994c2cbdd1ab expref: 17 pid: 17078 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071616.585916:0:18237:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18237:1869685707681280:0@lo:104: 00000100:00100000:1.0:1783071616.585939:0:18237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071616.585976:0:18237:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b101076c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071616.586199:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707681152 00000100:00100000:2.0:1783071616.586203:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707681280 00000100:00100000:3.0:1783071616.586207:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707681152 00000100:00100000:2.0:1783071616.586210:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707681280 00000100:00100000:3.0:1783071616.586256:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783071616.586266:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a9c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5ed14122-6273-4ec6-b260-6e79c239c375+4:18237:x1869685707681152:12345-0@lo:104: 00010000:00010000:3.0:1783071616.586280:0:17070:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8f8a03865800/0x6b58994c2cbdd2ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdd2b5 expref: -99 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071616.586394:0:17070:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783071616.586401:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a9c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5ed14122-6273-4ec6-b260-6e79c239c375+4:18237:x1869685707681152:12345-0@lo:104: Request processed in 137us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071616.586492:0:18237:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18237:1869685707681152:0@lo:104: 00010000:00010000:0.0:1783071616.586540:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783071616.586548:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8a03865800/0x6b58994c2cbdd2ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdd2b5 expref: -99 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071616.586561:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03865800 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:0.0:1783071616.586565:0:17075:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8a03865800/0x6b58994c2cbdd2ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6b58994c2cbdd2b5 expref: -99 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071616.586587:0:17075:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8a03865800/0x6b58994c2cbdd2ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6b58994c2cbdd2b5 expref: -99 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783071616.586603:0:17075:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8a03865800/0x6b58994c2cbdd2ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6b58994c2cbdd2b5 expref: -99 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783071616.586608:0:17075:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783071616.586644:0:17075:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8f8a03865800/0x6b58994c2cbdd2ae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdd2b5 expref: -99 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071616.586662:0:17075:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783071616.586684:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8a03865800/0x6b58994c2cbdd2ae lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdd2b5 expref: -99 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071616.586690:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8a03865800/0x6b58994c2cbdd2ae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdd2b5 expref: -99 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071616.586701:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071616.586703:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071616.586705:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071616.587006:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ed14122-6273-4ec6-b260-6e79c239c375:3646:1869685707681408:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783071616.587057:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071616.587992:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707681408 00000100:00100000:0.0:1783071616.588002:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707681408 00010000:00010000:0.0:1783071616.588035:0:17072:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8a01749e00/0x6b58994c2cbdd2b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdd2ae expref: 18 pid: 17079 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071616.588066:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783071616.588076:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01765880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ed14122-6273-4ec6-b260-6e79c239c375+18:3646:x1869685707681408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783071616.588090:0:17072:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071616.588095:0:17072:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8a01749e00/0x6b58994c2cbdd2b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdd2ae expref: 18 pid: 17079 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071616.588116:0:17072:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8a01749e00/0x6b58994c2cbdd2b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6b58994c2cbdd2ae expref: 18 pid: 17079 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071616.588134:0:17072:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8a01749e00/0x6b58994c2cbdd2b5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6b58994c2cbdd2ae expref: 18 pid: 17079 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071616.588150:0:17072:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071616.588203:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01765880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ed14122-6273-4ec6-b260-6e79c239c375+17:3646:x1869685707681408:12345-0@lo:103:ldlm_bl.0 Request processed in 128us (1145us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071616.588210:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783071616.588252:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ed14122-6273-4ec6-b260-6e79c239c375:3646:1869685707681408:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783071616.593934:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783071616.593991:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783071616.594016:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5ed14122-6273-4ec6-b260-6e79c239c375+3:18237:x1869685707681280:12345-0@lo:104: 00010000:00010000:3.0:1783071616.594038:0:17070:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67c00/0x6b58994c2cbdd1ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdd1b2 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071616.594208:0:17070:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783071616.594215:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5ed14122-6273-4ec6-b260-6e79c239c375+3:18237:x1869685707681280:12345-0@lo:104: Request processed in 215us (8275us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071616.594222:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783071616.594397:0:18237:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18237:1869685707681280:0@lo:104: 00010000:00010000:1.0:1783071616.594430:0:18237:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f8a03bd6c00/0x6b58994c2cbdd309 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071616.600759:0:17074:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783071616.600778:0:17074:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67c00/0x6b58994c2cbdd1ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdd1b2 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071616.600791:0:17074:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd67c00 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:2.0:1783071616.600815:0:17074:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67c00/0x6b58994c2cbdd1ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6b58994c2cbdd1b2 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071616.600827:0:17074:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67c00/0x6b58994c2cbdd1ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6b58994c2cbdd1b2 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783071616.600835:0:17074:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67c00/0x6b58994c2cbdd1ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6b58994c2cbdd1b2 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071616.600842:0:17074:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783071616.601092:0:17074:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67c00/0x6b58994c2cbdd1ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdd1b2 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071616.601102:0:17074:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783071616.601138:0:17074:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67c00/0x6b58994c2cbdd1ab lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdd1b2 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071616.601147:0:17074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67c00/0x6b58994c2cbdd1ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdd1b2 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071616.601171:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071616.601173:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071616.601175:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071616.601184:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783071616.601204:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ed14122-6273-4ec6-b260-6e79c239c375:3648:1869685707681536:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783071616.601277:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071616.601342:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707681536 00000100:00100000:0.0:1783071616.601357:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707681536 00010000:00010000:0.0:1783071616.601408:0:17071:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8a03865c00/0x6b58994c2cbdd1b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdd1ab expref: 17 pid: 17078 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071616.601439:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783071616.601448:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01765f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5ed14122-6273-4ec6-b260-6e79c239c375+17:3648:x1869685707681536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783071616.601466:0:17071:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071616.601471:0:17071:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8a03865c00/0x6b58994c2cbdd1b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdd1ab expref: 17 pid: 17078 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071616.601482:0:17071:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8a03865c00/0x6b58994c2cbdd1b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6b58994c2cbdd1ab expref: 17 pid: 17078 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071616.601497:0:17071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8a03865c00/0x6b58994c2cbdd1b2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6b58994c2cbdd1ab expref: 17 pid: 17078 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071616.601514:0:17071:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f8a03bd6c00/0x6b58994c2cbdd309 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071616.601525:0:17071:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8a03bd6c00/0x6b58994c2cbdd309 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071616.601542:0:17071:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f8a03bd6c00/0x6b58994c2cbdd309 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071616.601550:0:17071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f8a03bd6c00/0x6b58994c2cbdd309 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071616.601557:0:17071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f8a03bd6c00/0x6b58994c2cbdd309 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071616.601563:0:17071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f8a03bd6c00/0x6b58994c2cbdd309 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071616.601590:0:17071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03bd6c00 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:0.0:1783071616.601595:0:17071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f8a03bd6c00/0x6b58994c2cbdd309 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071616.601604:0:17071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f8a03bd6c00/0x6b58994c2cbdd309 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071616.601628:0:17071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f8a03bd6c00/0x6b58994c2cbdd309 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071616.601639:0:17071:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783071616.601709:0:18237:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f8a03bd6c00/0x6b58994c2cbdd309 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071616.601720:0:18237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f8a03bd6c00/0x6b58994c2cbdd309 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071616.601727:0:18237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8a03bd6c00/0x6b58994c2cbdd309 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071616.602155:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01765f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5ed14122-6273-4ec6-b260-6e79c239c375+16:3648:x1869685707681536:12345-0@lo:103:ldlm_bl.0 Request processed in 705us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071616.602165:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783071616.602359:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ed14122-6273-4ec6-b260-6e79c239c375:3648:1869685707681536:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783071616.962523:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1783071617.922725:0:17083:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783071617.922734:0:17083:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8f8b10f78000 from 13 10000000:01000000:1.0:1783071617.922740:0:17083:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783071617.922795:0:17083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd6000/0x6b58994c2cbdd310 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071617.922807:0:17083:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd6000/0x6b58994c2cbdd310 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071617.922817:0:17083:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd6000/0x6b58994c2cbdd310 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071617.922845:0:17083:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ed14122-6273-4ec6-b260-6e79c239c375:17083:1869685707681664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783071617.923891:0:17083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071617.923951:0:17083:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a038bca80 going to sleep for 11 seconds 00000100:00100000:2.0:1783071617.924051:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707681664 00000100:00100000:2.0:1783071617.924061:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707681664 00000100:00100000:2.0:1783071617.924134:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783071617.924146:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3eb85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+16:17083:x1869685707681664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783071617.924162:0:17078:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071617.924182:0:17078:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b2fd67400/0x6b58994c2cbdd317 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdd310 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071617.924208:0:17078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b2fd67400/0x6b58994c2cbdd317 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdd310 expref: 17 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071617.924219:0:17078:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b2fd67400/0x6b58994c2cbdd317 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdd310 expref: 17 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071617.924239:0:17078:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b2fd67400, rc 0) 00000100:00100000:2.0:1783071617.924297:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3eb85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+17:17083:x1869685707681664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071617.924304:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783071617.927929:0:17083:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ed14122-6273-4ec6-b260-6e79c239c375:17083:1869685707681664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783071617.927962:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd6000/0x6b58994c2cbdd310 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd317 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071617.927975:0:17083:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd6000/0x6b58994c2cbdd310 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdd317 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071617.928090:0:17083:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ed14122-6273-4ec6-b260-6e79c239c375:17083:1869685707681792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783071617.928163:0:17083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071617.928207:0:17083:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a038bca80 going to sleep for 11 seconds 00000100:00100000:0.0:1783071617.929980:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707681792 00000100:00100000:0.0:1783071617.929991:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707681792 00000100:00100000:0.0:1783071617.930058:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783071617.930068:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3eb86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+17:17083:x1869685707681792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783071617.930258:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3eb86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+17:17083:x1869685707681792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 191us (2095us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071617.930267:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1783071617.931444:0:17083:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ed14122-6273-4ec6-b260-6e79c239c375:17083:1869685707681792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783071617.931517:0:17083:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02e41500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ed14122-6273-4ec6-b260-6e79c239c375:17083:1869685707681920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783071617.931597:0:17083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071617.933065:0:17083:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b18027c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783071617.933240:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707681920 00000100:00100000:0.0:1783071617.933249:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707681920 00000100:00100000:0.0:1783071617.933312:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783071617.933323:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3eb87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+17:17083:x1869685707681920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783071617.933522:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3eb87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+17:17083:x1869685707681920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 200us (1924us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071617.933536:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1783071617.934005:0:17083:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02e41500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ed14122-6273-4ec6-b260-6e79c239c375:17083:1869685707681920:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783071617.938795:0:18300:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1783071617.942816:0:17083:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1783071617.943471:0:17083:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783071617.943486:0:17083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd6000/0x6b58994c2cbdd310 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd317 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071617.943500:0:17083:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd6000/0x6b58994c2cbdd310 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd317 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783071617.943512:0:17083:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783071617.943516:0:17083:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8f8a041ea000 from 13 10000000:01000000:0.0:1783071617.943518:0:17083:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783071617.943572:0:17083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8a03865c00/0x6b58994c2cbdd31e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071617.943581:0:17083:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8a03865c00/0x6b58994c2cbdd31e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071617.943593:0:17083:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8a03865c00/0x6b58994c2cbdd31e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071617.943620:0:17083:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01767800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ed14122-6273-4ec6-b260-6e79c239c375:17083:1869685707682048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783071617.943912:0:17083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071617.944035:0:17083:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a038cae40 going to sleep for 11 seconds 00000100:00100000:1.0:1783071617.948080:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707682048 00000100:00100000:1.0:1783071617.948097:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707682048 00000100:00100000:1.0:1783071617.948172:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783071617.948183:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3eb85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+17:17083:x1869685707682048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783071617.948200:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071617.948219:0:17079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8a03bd7a00/0x6b58994c2cbdd325 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdd31e expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071617.948661:0:17079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8a03bd7a00/0x6b58994c2cbdd325 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdd31e expref: 18 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071617.948672:0:17079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8a03bd7a00/0x6b58994c2cbdd325 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdd31e expref: 18 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071617.948681:0:17079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a03bd7a00, rc 0) 00000100:00100000:1.0:1783071617.949703:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3eb85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+18:17083:x1869685707682048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1516us (5785us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071617.949740:0:17083:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01767800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ed14122-6273-4ec6-b260-6e79c239c375:17083:1869685707682048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783071617.949765:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8a03865c00/0x6b58994c2cbdd31e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd325 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071617.949778:0:17083:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8a03865c00/0x6b58994c2cbdd31e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdd325 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071617.949804:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1783071617.949862:0:17083:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02e41500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ed14122-6273-4ec6-b260-6e79c239c375:17083:1869685707682176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783071617.949904:0:17083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071617.949997:0:17083:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b18027c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783071617.950044:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707682176 00000100:00100000:0.0:1783071617.950051:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707682176 00000100:00100000:0.0:1783071617.950096:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783071617.950105:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3eb87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+18:17083:x1869685707682176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783071617.950288:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3eb87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+18:17083:x1869685707682176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 183us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071617.950312:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783071617.950489:0:17083:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02e41500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ed14122-6273-4ec6-b260-6e79c239c375:17083:1869685707682176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783071617.950525:0:17083:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02e41500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ed14122-6273-4ec6-b260-6e79c239c375:17083:1869685707682304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783071617.950574:0:17083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071617.950624:0:17083:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b18027c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783071617.950662:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707682304 00000100:00100000:1.0:1783071617.950667:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707682304 00000100:00100000:1.0:1783071617.950737:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1783071617.950745:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3eb87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+18:17083:x1869685707682304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783071617.950842:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3eb87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+18:17083:x1869685707682304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 97us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071617.950849:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1783071617.950917:0:17083:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02e41500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ed14122-6273-4ec6-b260-6e79c239c375:17083:1869685707682304:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783071617.956036:0:18301:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1783071617.956734:0:17083:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1783071617.956764:0:17083:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783071617.956777:0:17083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8a03865c00/0x6b58994c2cbdd31e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd325 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071617.956789:0:17083:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8a03865c00/0x6b58994c2cbdd31e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd325 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071617.987598:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783071618.435056:0:17119:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1783071619.011400:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071619.395715:0:3644:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783071609/real 1783071609] req@ffff8f8a032e7b80 x1869685707676416/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783071619 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071619.395751:0:3644:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f8a032e7b80 x1869685707676416/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783071619 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071619.395760:0:3644:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783071609/real 1783071609] req@ffff8f8a032e4700 x1869685707676160/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783071619 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071619.395770:0:3644:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f8a032e4700 x1869685707676160/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783071619 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783071619.395789:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8f8b3b4b0800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783071619.395814:0:3644:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783071619.395818:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1869685707676416:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1783071619.395823:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8f8a01e4e800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783071619.395836:0:3644:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783071619.395839:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1869685707676160:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1783071619.395954:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783071619.395959:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783071619.395962:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783071619.395965:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783071619.395980:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783071619.395982:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1783071619.395985:0:37:0:(import.c:65:import_set_state_nolock()) ffff8f8a01e4e800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783071619.395990:0:37:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 511 00000100:00080000:1.0:1783071619.395995:0:37:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783071619.396001:0:37:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8f8a01e4e800 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:1.0:1783071619.396019:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8a03a9ca80 x1869685707682944/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783071619.396030:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783071619.396033:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1783071619.396035:0:37:0:(import.c:65:import_set_state_nolock()) ffff8f8b3b4b0800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783071619.396037:0:37:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 511 00000100:00080000:1.0:1783071619.396040:0:37:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783071619.396043:0:37:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8f8b3b4b0800 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:1.0:1783071619.396053:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8a03a9f100 x1869685707683072/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783071619.396791:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ed14122-6273-4ec6-b260-6e79c239c375:3648:1869685707682432:0@lo:400:kworker.0 00000100:00100000:2.0:1783071619.396875:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071619.396923:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869685707683200:0@lo:400:kworker.0 00000100:00100000:2.0:1783071619.396954:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071619.396978:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783071619.396983:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707682816:0@lo:400:kworker.0 00000100:00100000:2.0:1783071619.397009:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071619.397045:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707683200 00000100:00100000:2.0:1783071619.397052:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707683200 00000100:00100000:2.0:1783071619.397100:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783071619.397109:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869685707683200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071619.397171:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869685707683200:12345-0@lo:400:kworker.0 Request processed in 62us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071619.397179:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783071619.397207:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1869685707682944:0@lo:8:kworker.0 00000400:00000100:2.0:1783071619.397230:0:3644:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869685707682944 offset 0 length 520: 4 00000100:00100000:2.0:1783071619.397243:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1869685707683072:0@lo:8:kworker.0 00000400:00000100:2.0:1783071619.397261:0:3644:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869685707683072 offset 0 length 520: 4 00010000:00080000:2.0:1783071619.397296:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f8a03a9df80 x1869685707683200/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071635 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071619.397309:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869685707683200:0@lo:400:kworker.0 00000100:00100000:1.0:1783071619.397437:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707682432 00000100:00100000:1.0:1783071619.397443:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707682432 00000100:00100000:1.0:1783071619.397478:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783071619.397485:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3eb85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+18:3648:x1869685707682432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071619.397531:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3eb85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+18:3648:x1869685707682432:12345-0@lo:400:kworker.0 Request processed in 36us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071619.397538:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1783071619.397680:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ed14122-6273-4ec6-b260-6e79c239c375:3648:1869685707682432:0@lo:400:kworker.0 00000100:00100000:3.0:1783071619.398564:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707682816 00000100:00100000:3.0:1783071619.398583:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707682816 00000100:00100000:3.0:1783071619.398624:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783071619.398632:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707682816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071619.398689:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707682816:12345-0@lo:400:kworker.0 Request processed in 58us (1678us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071619.398695:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783071619.399203:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707682816:0@lo:400:kworker.0 00000100:00100000:1.0:1783071619.399432:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707682560:0@lo:400:kworker.0 00000100:00100000:1.0:1783071619.399476:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071619.399503:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783071619.399510:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869685707682688:0@lo:400:kworker.0 00000100:00100000:1.0:1783071619.399550:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071619.399717:0:17825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707682560 00000100:00100000:2.0:1783071619.399722:0:17825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707682560 00000100:00100000:2.0:1783071619.399754:0:17825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783071619.399761:0:17825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1869685707682560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071619.399810:0:17825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1869685707682560:12345-0@lo:400:kworker.0 Request processed in 49us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071619.399817:0:17825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783071619.399859:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707682560:0@lo:400:kworker.0 00000100:00100000:3.0:1783071619.400100:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707682688 00000100:00100000:3.0:1783071619.400104:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707682688 00000100:00100000:3.0:1783071619.400166:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783071619.400174:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1869685707682688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071619.400222:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1869685707682688:12345-0@lo:400:kworker.0 Request processed in 49us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071619.400228:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1783071619.400277:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f8a03a9ce00 x1869685707682688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071635 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071619.400289:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869685707682688:0@lo:400:kworker.0 00010000:00010000:0.0:1783071620.035467:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071620.418863:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01766300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707683328:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783071620.418933:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071620.420862:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707683328 00000100:00100000:0.0:1783071620.420881:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707683328 00000100:00100000:0.0:1783071620.420950:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783071620.420961:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01764380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707683328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783071620.421006:0:17090:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1783071620.421080:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01764380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707683328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 121us (2150us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071620.421087:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783071620.421144:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01766300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707683328:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783071620.421245:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707683456:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783071620.421290:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071620.421529:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707683456 00000100:00100000:0.0:1783071620.421533:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707683456 00000100:00100000:0.0:1783071620.421569:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783071620.421633:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1869685707683456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783071620.421662:0:17091:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1783071620.421706:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1869685707683456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 131us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071620.421838:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707683456:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783071620.422642:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000001:00100000:1.0:1783071620.940904:0:17817:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1783071621.058809:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071621.444534:0:3644:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783071606/real 1783071606] req@ffff8f8a032e4e00 x1869685707674240/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783071621 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071621.444576:0:3644:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f8a032e4e00 x1869685707674240/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783071621 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071621.444586:0:3644:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783071606/real 1783071606] req@ffff8f8a032e7100 x1869685707674368/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783071621 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071621.444598:0:3644:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f8a032e7100 x1869685707674368/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783071621 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783071621.444621:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8f8a02c74000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783071621.444649:0:3644:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1783071621.444654:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869685707674240:0@lo:8:kworker.0 00000100:00080000:0.0:1783071621.444661:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8f8a01e3f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783071621.444667:0:3644:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1783071621.444670:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869685707674368:0@lo:8:kworker.0 00000100:00080000:3.0:1783071621.444904:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783071621.444908:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1783071621.444911:0:38:0:(import.c:65:import_set_state_nolock()) ffff8f8a02c74000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783071621.444917:0:38:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 507 00000100:00080000:3.0:1783071621.444921:0:38:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1783071621.444928:0:38:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8f8a02c74000 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:3.0:1783071621.444945:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8a02e40700 x1869685707683840/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783071621.444967:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783071621.444970:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1783071621.444987:0:38:0:(import.c:65:import_set_state_nolock()) ffff8f8a01e3f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783071621.444991:0:38:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 507 00000100:00080000:3.0:1783071621.444994:0:38:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1783071621.444998:0:38:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8f8a01e3f800 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:3.0:1783071621.445010:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8a02e42d80 x1869685707683968/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783071621.445043:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783071621.445046:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783071621.445048:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783071621.445051:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783071621.445076:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02e42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707684224:0@lo:400:kworker.0 00000100:00100000:3.0:1783071621.445143:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071621.445177:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783071621.445183:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02e41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869685707684096:0@lo:400:kworker.0 00000100:00100000:3.0:1783071621.445207:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071621.445236:0:17825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707684224 00000100:00100000:3.0:1783071621.445243:0:17825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707684224 00000100:00100000:3.0:1783071621.445289:0:17825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783071621.445299:0:17825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02e41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707684224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071621.445358:0:17825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02e41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707684224:12345-0@lo:400:kworker.0 Request processed in 60us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071621.445398:0:17825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783071621.445440:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02e42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707684224:0@lo:400:kworker.0 00000100:00100000:1.0:1783071621.445518:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02e40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869685707683840:0@lo:8:kworker.0 00000400:00000100:1.0:1783071621.445546:0:3644:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869685707683840 offset 0 length 520: 4 00000100:00100000:1.0:1783071621.445567:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02e42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869685707683968:0@lo:8:kworker.0 00000400:00000100:1.0:1783071621.445582:0:3644:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869685707683968 offset 0 length 520: 4 00000100:00100000:2.0:1783071621.445680:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02e41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ed14122-6273-4ec6-b260-6e79c239c375:3647:1869685707683584:0@lo:400:kworker.0 00000100:00100000:2.0:1783071621.445714:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071621.445740:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02e40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869685707684352:0@lo:400:kworker.0 00000100:00100000:2.0:1783071621.445759:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071621.445775:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783071621.445780:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02e40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707683712:0@lo:400:kworker.0 00000100:00100000:2.0:1783071621.445798:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071621.445826:0:17085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707684096 00000100:00100000:2.0:1783071621.445829:0:17085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707684096 00000100:00100000:2.0:1783071621.445853:0:17085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707684352 00000100:00100000:2.0:1783071621.445855:0:17085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707684352 00000100:00100000:2.0:1783071621.445867:0:17085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783071621.445872:0:17085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02e41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869685707684096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071621.445906:0:17085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02e41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869685707684096:12345-0@lo:400:kworker.0 Request processed in 33us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071621.445912:0:17085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783071621.445922:0:17085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783071621.445926:0:17085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869685707684352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071621.445950:0:17085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869685707684352:12345-0@lo:400:kworker.0 Request processed in 23us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071621.445956:0:17085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783071621.445970:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707683712 00000100:00100000:2.0:1783071621.445973:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707683712 00000100:00100000:2.0:1783071621.445990:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783071621.445996:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707683712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071621.446023:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707683712:12345-0@lo:400:kworker.0 Request processed in 27us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071621.446039:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783071621.446086:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02e40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707683712:0@lo:400:kworker.0 00010000:00080000:2.0:1783071621.446096:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f8a02e40e00 x1869685707684352/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071621.446104:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02e40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869685707684352:0@lo:400:kworker.0 00010000:00080000:2.0:1783071621.446128:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f8a02e41880 x1869685707684096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071621.446135:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02e41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869685707684096:0@lo:400:kworker.0 00000100:00100000:1.0:1783071621.446204:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707683584 00000100:00100000:1.0:1783071621.446208:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707683584 00000100:00100000:1.0:1783071621.446246:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783071621.446253:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3eb84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+18:3647:x1869685707683584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071621.446297:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3eb84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+18:3647:x1869685707683584:12345-0@lo:400:kworker.0 Request processed in 45us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071621.446304:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783071621.446339:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02e41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ed14122-6273-4ec6-b260-6e79c239c375:3647:1869685707683584:0@lo:400:kworker.0 00010000:00010000:0.0:1783071622.082768:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783071622.279128:0:17836:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:2.0:1783071622.340512:0:18585:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1783071622.340516:0:18585:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1783071622.340518:0:18585:0:(obd_mount.c:920:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1783071622.340691:0:18585:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8f8a038e5000 00000020:01000004:2.0:1783071622.340709:0:18585:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1783071622.340723:0:18585:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1783071622.340736:0:18585:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8f8b3b5c4d40) 00000020:00000080:2.0:1783071622.340753:0:18585:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1783071622.392310:0:18585:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1783071622.393040:0:18585:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1783071622.393694:0:18585:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1783071622.394038:0:18585:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1783071622.394405:0:18585:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1783071622.394801:0:18585:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1783071622.395000:0:18585:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:2.0:1783071622.398014:0:18585:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1783071622.398240:0:18585:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1783071622.398261:0:18585:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1783071622.398274:0:18585:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x6b58994c2cbdd333 00000020:01000004:2.0:1783071622.398281:0:18585:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1783071622.398302:0:18585:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.204.138@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1783071622.398306:0:18585:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.138@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1783071622.398311:0:18585:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1783071622.398316:0:18585:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1783071622.398327:0:18585:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8f8b3b5c0000) 00000020:00000080:2.0:1783071622.398339:0:18585:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1783071622.403056:0:18585:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783071622.403222:0:18585:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1783071622.403229:0:18585:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1783071622.406739:0:18585:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1783071622.406756:0:18585:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1783071622.413295:0:18585:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1783071622.413314:0:18585:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1783071622.415052:0:18585:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783071622.415245:0:18585:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1783071622.415251:0:18585:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1783071622.416055:0:18585:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1783071622.416062:0:18585:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1783071622.445075:0:18585:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783071622.445339:0:18585:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1783071622.445347:0:18585:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1783071622.454046:0:18585:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1783071622.454068:0:18585:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1783071622.456039:0:18585:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1783071622.456138:0:18585:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1783071622.458441:0:18585:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783071622.458654:0:18585:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1783071622.458660:0:18585:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1783071622.460138:0:18585:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1783071622.460151:0:18585:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1783071622.512487:0:18585:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783071622.512865:0:18585:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1783071622.512871:0:18585:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1783071622.514077:0:18585:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1783071622.514085:0:18585:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1783071622.514555:0:18585:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1783071622.514589:0:18585:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1783071622.514597:0:18585:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.138@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1783071622.526455:0:18585:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.138@tcp ctxt 0 is initialized 00000020:01000004:0.0:1783071622.526504:0:18585:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.138@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1783071622.526509:0:18585:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1783071622.526511:0:18585:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783071622.526512:0:18585:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783071622.526513:0:18585:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783071622.526514:0:18585:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783071622.526516:0:18585:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783071622.526518:0:18585:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783071622.526520:0:18585:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783071622.526522:0:18585:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783071622.526526:0:18585:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1783071622.526528:0:18585:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783071622.526529:0:18585:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783071622.526531:0:18585:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783071622.526532:0:18585:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783071622.526533:0:18585:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783071622.526534:0:18585:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783071622.526535:0:18585:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783071622.526536:0:18585:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783071622.526741:0:18585:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783071622.526780:0:18585:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1783071622.526802:0:18585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01766300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:18585:1869685707684480:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1783071622.526897:0:18585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071622.527016:0:18585:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0394f240 going to sleep for 11 seconds 00000100:00100000:2.0:1783071622.530518:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707684480 00000100:00100000:2.0:1783071622.530749:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707684480 00000100:00100000:2.0:1783071622.530869:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1783071622.530880:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3eb91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+18:18585:x1869685707684480:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783071622.530919:0:17081:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1783071622.530922:0:17081:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1783071622.530926:0:17081:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1783071622.531345:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3eb91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+18:18585:x1869685707684480:12345-0@lo:253:mount.lustre.0 Request processed in 466us (4449us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071622.531353:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783071622.531585:0:18585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01766300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:18585:1869685707684480:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1783071622.531598:0:18585:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1783071622.531601:0:18585:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783071622.531603:0:18585:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783071622.531604:0:18585:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783071622.531606:0:18585:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783071622.531607:0:18585:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783071622.531608:0:18585:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783071622.531610:0:18585:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783071622.531611:0:18585:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783071622.531612:0:18585:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1783071622.531664:0:18585:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8f8a038e5000 from lustre-OST0000 10000000:01000000:0.0:1783071622.531726:0:18585:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1783071622.531730:0:18585:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1783071622.531742:0:18585:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8f8b34e64d40 local copy 00010000:00010000:0.0:1783071622.531755:0:18585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8a03864600/0x6b58994c2cbdd0ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd0f5 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071622.531872:0:18585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01766300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:18585:1869685707684608:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783071622.531915:0:18585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071622.531962:0:18585:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0394f780 going to sleep for 11 seconds 00000100:00100000:1.0:1783071622.532154:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707684608 00000100:00100000:1.0:1783071622.532161:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707684608 00000100:00100000:1.0:1783071622.532202:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783071622.532212:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3eb91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+18:18585:x1869685707684608:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783071622.532288:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3eb91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+18:18585:x1869685707684608:12345-0@lo:501:mount.lustre.0 Request processed in 77us (373us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783071622.532295:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783071622.532406:0:18585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01766300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:18585:1869685707684608:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1783071622.532419:0:18585:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.138@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1783071622.532437:0:18585:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.138@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1783071622.532444:0:18585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8a03864600/0x6b58994c2cbdd0ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd0f5 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071622.532454:0:18585:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8a03864600/0x6b58994c2cbdd0ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd0f5 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783071622.532492:0:18585:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f8a038e5000 10000000:01000000:0.0:1783071622.532497:0:18585:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1783071622.532502:0:18585:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1783071622.532504:0:18585:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783071622.532508:0:18585:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1783071622.532511:0:18585:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1783071622.532537:0:18585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8a03865800/0x6b58994c2cbdd341 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071622.532546:0:18585:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8a03865800/0x6b58994c2cbdd341 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071622.532564:0:18585:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8a03865800/0x6b58994c2cbdd341 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071622.532579:0:18585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01766300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:18585:1869685707684736:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783071622.532606:0:18585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071622.532636:0:18585:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0394f780 going to sleep for 11 seconds 00000100:00100000:1.0:1783071622.532923:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707684736 00000100:00100000:1.0:1783071622.532928:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707684736 00000100:00100000:1.0:1783071622.532959:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783071622.532965:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3eb93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+18:18585:x1869685707684736:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783071622.532975:0:17078:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071622.532988:0:17078:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8a03bd6c00/0x6b58994c2cbdd348 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdd341 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071622.533008:0:17078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8a03bd6c00/0x6b58994c2cbdd348 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdd341 expref: 19 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071622.533017:0:17078:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8a03bd6c00/0x6b58994c2cbdd348 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdd341 expref: 19 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071622.533025:0:17078:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a03bd6c00, rc 0) 00000100:00100000:1.0:1783071622.533052:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3eb93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+19:18585:x1869685707684736:12345-0@lo:101:mount.lustre.0 Request processed in 87us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071622.533064:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783071622.533154:0:18585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01766300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:18585:1869685707684736:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783071622.533169:0:18585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8a03865800/0x6b58994c2cbdd341 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd348 expref: -99 pid: 18585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071622.533177:0:18585:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8a03865800/0x6b58994c2cbdd341 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdd348 expref: -99 pid: 18585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783071622.535208:0:18585:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1783071622.536163:0:18585:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783071622.536481:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1783071622.536509:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1783071622.536523:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1783071622.536773:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1783071622.536793:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1783071622.536809:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1783071622.536828:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1783071622.536833:0:18585:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1783071622.536921:0:18585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:18585:1869685707684864:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783071622.537002:0:18585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071622.537117:0:18585:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b186cbcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783071622.537171:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707684864 00000100:00100000:2.0:1783071622.537178:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707684864 00000100:00100000:2.0:1783071622.537270:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1783071622.537279:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3eb90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+19:18585:x1869685707684864:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783071622.537501:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3eb90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+19:18585:x1869685707684864:12345-0@lo:501:mount.lustre.0 Request processed in 222us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071622.537510:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783071622.537606:0:18585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:18585:1869685707684864:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783071622.537653:0:18585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:18585:1869685707684992:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783071622.537699:0:18585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071622.538318:0:18585:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b186cbcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783071622.538509:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707684992 00000100:00100000:0.0:1783071622.538516:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707684992 00000100:00100000:0.0:1783071622.538563:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1783071622.538571:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3eb91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+19:18585:x1869685707684992:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783071622.539818:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3eb91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+19:18585:x1869685707684992:12345-0@lo:503:mount.lustre.0 Request processed in 1241us (2111us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071622.539830:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1783071622.540053:0:18585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:18585:1869685707684992:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1783071622.540802:0:18585:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783071622.540888:0:18585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:18585:1869685707685120:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783071622.540952:0:18585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071622.540992:0:18585:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b186cbcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783071622.541145:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707685120 00000100:00100000:0.0:1783071622.541151:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707685120 00000100:00100000:0.0:1783071622.541187:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1783071622.541195:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3eb93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+19:18585:x1869685707685120:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783071622.542935:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3eb93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+19:18585:x1869685707685120:12345-0@lo:502:mount.lustre.0 Request processed in 1732us (1973us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071622.542963:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1783071622.543082:0:18585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:18585:1869685707685120:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783071622.543321:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1783071622.543398:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1783071622.543428:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1783071622.543445:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1783071622.543460:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1783071622.543490:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1783071622.543505:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1783071622.543518:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1783071622.543531:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1783071622.543831:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1783071622.543848:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1783071622.543862:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1783071622.543899:0:18585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:18585:1869685707685248:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783071622.543961:0:18585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071622.544067:0:18585:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b186cbcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071622.546735:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707685248 00000100:00100000:3.0:1783071622.546753:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707685248 00000100:00100000:2.0:1783071622.548291:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1783071622.548317:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3eb92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+19:18585:x1869685707685248:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783071622.549344:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3eb92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+19:18585:x1869685707685248:12345-0@lo:502:mount.lustre.0 Request processed in 1035us (5377us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071622.549355:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783071622.549500:0:18585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:18585:1869685707685248:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783071622.549610:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1783071622.549624:0:18585:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:2.0:1783071622.550975:0:18603:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783071622.550986:0:18603:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1783071622.550993:0:18603:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071622.550995:0:18603:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1783071622.551003:0:18603:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783071622.551021:0:18603:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8f8b06c74d40) 00000020:00000080:2.0:1783071622.551050:0:18603:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:2.0:1783071622.551056:0:18603:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1783071622.551137:0:18603:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f8a038e5000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1783071622.551146:0:18603:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1783071622.551154:0:18603:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x6b58994c2cbdd356 00010000:00010000:2.0:1783071622.555054:0:18603:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1783071622.556299:0:18603:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:2.0:1783071622.558760:0:18603:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:2.0:1783071622.562049:0:18603:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1783071622.562063:0:18603:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783071622.562068:0:18603:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071622.562070:0:18603:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1783071622.562074:0:18603:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1783071622.562084:0:18603:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:2.0:1783071622.562086:0:18603:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783071622.562088:0:18603:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783071622.562090:0:18603:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1783071622.562093:0:18603:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071622.562094:0:18603:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:2.0:1783071622.562096:0:18603:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783071622.562099:0:18603:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071622.562100:0:18603:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783071622.562103:0:18603:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783071622.562106:0:18603:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1783071622.562108:0:18603:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783071622.562110:0:18603:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071622.562111:0:18603:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:2.0:1783071622.562113:0:18603:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783071622.562115:0:18603:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071622.562116:0:18603:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1783071622.562120:0:18603:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1783071622.562150:0:18603:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783071622.562152:0:18603:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071622.562154:0:18603:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1783071622.562157:0:18603:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1783071622.562409:0:18585:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1783071622.562443:0:18585:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1783071622.564067:0:18585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8a03865800/0x6b58994c2cbdd341 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd348 expref: -99 pid: 18585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071622.564086:0:18585:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8a03865800/0x6b58994c2cbdd341 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd348 expref: -99 pid: 18585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783071622.564096:0:18585:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8f8a038e5000 from 1 10000000:01000000:1.0:1783071622.564099:0:18585:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783071622.564138:0:18585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd7400/0x6b58994c2cbdd35d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071622.564146:0:18585:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd7400/0x6b58994c2cbdd35d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071622.564169:0:18585:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd7400/0x6b58994c2cbdd35d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071622.564197:0:18585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:18585:1869685707685376:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783071622.564278:0:18585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071622.564326:0:18585:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b186cb480 going to sleep for 11 seconds 00000100:00100000:0.0:1783071622.564535:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707685376 00000100:00100000:0.0:1783071622.564543:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707685376 00000100:00100000:0.0:1783071622.564631:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1783071622.564642:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3eb91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+19:18585:x1869685707685376:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783071622.564660:0:17078:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071622.564675:0:17078:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8a03865600/0x6b58994c2cbdd364 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdd35d expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071622.564702:0:17078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8a03865600/0x6b58994c2cbdd364 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdd35d expref: 20 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071622.564713:0:17078:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8a03865600/0x6b58994c2cbdd364 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdd35d expref: 20 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071622.564722:0:17078:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a03865600, rc 0) 00000100:00100000:0.0:1783071622.564785:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3eb91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+20:18585:x1869685707685376:12345-0@lo:101:mount.lustre.0 Request processed in 144us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071622.564793:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783071622.565062:0:18585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:18585:1869685707685376:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783071622.565084:0:18585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd7400/0x6b58994c2cbdd35d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd364 expref: -99 pid: 18585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071622.565093:0:18585:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd7400/0x6b58994c2cbdd35d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdd364 expref: -99 pid: 18585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783071622.566606:0:18585:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1783071622.566957:0:18585:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783071622.567149:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1783071622.567174:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1783071622.567189:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1783071622.567194:0:18585:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1783071622.567255:0:18585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02e42a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:18585:1869685707685504:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783071622.567318:0:18585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071622.567400:0:18585:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b10030cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783071622.568846:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707685504 00000100:00100000:0.0:1783071622.568864:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707685504 00000100:00100000:0.0:1783071622.568933:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1783071622.568944:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3eb92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+20:18585:x1869685707685504:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783071622.569146:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3eb92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+20:18585:x1869685707685504:12345-0@lo:501:mount.lustre.0 Request processed in 203us (1827us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071622.569155:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1783071622.569320:0:18585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02e42a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:18585:1869685707685504:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783071622.569414:0:18585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02e42a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:18585:1869685707685632:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783071622.569482:0:18585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071622.569517:0:18585:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b10030cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783071622.569776:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707685632 00000100:00100000:0.0:1783071622.569788:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707685632 00000100:00100000:0.0:1783071622.569835:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1783071622.569842:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03813050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+20:18585:x1869685707685632:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783071622.570519:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03813050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+20:18585:x1869685707685632:12345-0@lo:503:mount.lustre.0 Request processed in 672us (1032us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071622.570528:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1783071622.573211:0:18585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02e42a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:18585:1869685707685632:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1783071622.574102:0:18585:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783071622.574215:0:18585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:18585:1869685707685760:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783071622.574321:0:18585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071622.574427:0:18585:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b186cbb40 going to sleep for 11 seconds 00000100:00100000:2.0:1783071622.574566:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707685760 00000100:00100000:2.0:1783071622.574574:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707685760 00000100:00100000:2.0:1783071622.574621:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783071622.574633:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03812450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+20:18585:x1869685707685760:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783071622.574917:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03812450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+20:18585:x1869685707685760:12345-0@lo:502:mount.lustre.0 Request processed in 285us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071622.574925:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783071622.575089:0:18585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:18585:1869685707685760:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783071622.575297:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1783071622.575323:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1783071622.575335:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1783071622.575493:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1783071622.575512:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1783071622.575527:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1783071622.575610:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1783071622.575629:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:1.0:1783071622.575641:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1783071622.575653:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:1.0:1783071622.575666:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:1.0:1783071622.575780:0:18585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:18585:1869685707685888:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783071622.575835:0:18585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071622.575911:0:18585:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b186cbb40 going to sleep for 11 seconds 00000100:00100000:2.0:1783071622.576621:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707685888 00000100:00100000:2.0:1783071622.576631:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707685888 00000100:00100000:2.0:1783071622.576786:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783071622.576797:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03810850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+20:18585:x1869685707685888:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783071622.576945:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03810850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+20:18585:x1869685707685888:12345-0@lo:502:mount.lustre.0 Request processed in 150us (1109us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071622.576953:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1783071622.577053:0:18585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:18585:1869685707685888:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783071622.577129:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1783071622.577141:0:18585:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1783071622.578051:0:18607:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783071622.578061:0:18607:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071622.578064:0:18607:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1783071622.578070:0:18607:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f8a038e5000 00000020:00000080:3.0:1783071622.578073:0:18607:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783071622.578080:0:18607:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783071622.578082:0:18607:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071622.578084:0:18607:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1783071622.578086:0:18607:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783071622.578088:0:18607:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071622.578090:0:18607:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1783071622.578093:0:18607:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f8a038e5000 00000020:00000080:3.0:1783071622.578095:0:18607:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783071622.578154:0:18607:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783071622.578158:0:18607:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071622.578159:0:18607:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1783071622.578162:0:18607:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783071622.578165:0:18607:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071622.578166:0:18607:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783071622.578170:0:18607:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f8a038e5000 00000020:00000080:3.0:1783071622.578172:0:18607:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783071622.578190:0:18607:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783071622.578192:0:18607:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071622.578200:0:18607:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783071622.578204:0:18607:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783071622.578206:0:18607:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071622.578208:0:18607:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1783071622.578212:0:18607:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f8a038e5000 00000020:00000080:3.0:1783071622.578213:0:18607:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783071622.578236:0:18607:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783071622.578239:0:18607:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071622.578240:0:18607:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1783071622.578243:0:18607:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1783071622.579575:0:18585:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1783071622.579620:0:18585:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783071622.579640:0:18585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd7400/0x6b58994c2cbdd35d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd364 expref: -99 pid: 18585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071622.579653:0:18585:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd7400/0x6b58994c2cbdd35d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd364 expref: -99 pid: 18585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071622.579898:0:18585:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1783071622.579901:0:18585:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f8a038e5000 10000000:01000000:2.0:1783071622.579905:0:18585:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f8a038e5000 10000000:01000000:2.0:1783071622.579909:0:18585:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783071622.579917:0:18585:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8f8a038e5000 from 1 10000000:01000000:2.0:1783071622.579920:0:18585:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783071622.579963:0:18585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66200/0x6b58994c2cbdd36b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071622.579973:0:18585:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66200/0x6b58994c2cbdd36b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071622.579985:0:18585:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66200/0x6b58994c2cbdd36b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071622.580014:0:18585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:18585:1869685707686016:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783071622.580097:0:18585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071622.580149:0:18585:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b18027540 going to sleep for 11 seconds 00000100:00100000:3.0:1783071622.580216:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707686016 00000100:00100000:3.0:1783071622.580224:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707686016 00000100:00100000:3.0:1783071622.580277:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1783071622.580287:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03812050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+20:18585:x1869685707686016:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783071622.580303:0:17081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071622.580317:0:17081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8a01749400/0x6b58994c2cbdd372 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdd36b expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071622.580342:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8a01749400/0x6b58994c2cbdd372 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdd36b expref: 21 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071622.580352:0:17081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8a01749400/0x6b58994c2cbdd372 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdd36b expref: 21 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071622.580384:0:17081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a01749400, rc 0) 00000100:00100000:3.0:1783071622.580426:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03812050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+21:18585:x1869685707686016:12345-0@lo:101:mount.lustre.0 Request processed in 140us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071622.580434:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1783071622.580799:0:18585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:18585:1869685707686016:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783071622.580816:0:18585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66200/0x6b58994c2cbdd36b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd372 expref: -99 pid: 18585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071622.580825:0:18585:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66200/0x6b58994c2cbdd36b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdd372 expref: -99 pid: 18585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783071622.582188:0:18585:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1783071622.582851:0:18585:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783071622.583052:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1783071622.583079:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1783071622.583095:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1783071622.583108:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1783071622.583135:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1783071622.583149:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1783071622.583160:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1783071622.583171:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1783071622.583183:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1783071622.583194:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1783071622.583207:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1783071622.583219:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1783071622.583234:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1783071622.583248:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1783071622.583260:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1783071622.583270:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1783071622.583284:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1783071622.583297:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1783071622.583309:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1783071622.583322:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1783071622.583348:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1783071622.586838:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1783071622.586914:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1783071622.586931:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1783071622.586946:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1783071622.586961:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1783071622.586975:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1783071622.586988:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1783071622.587002:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1783071622.587016:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1783071622.587030:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1783071622.587044:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1783071622.587056:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1783071622.587081:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1783071622.587095:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1783071622.587109:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1783071622.587144:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1783071622.587175:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1783071622.587182:0:18585:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1783071622.587314:0:18585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02e42a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:18585:1869685707686144:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783071622.587421:0:18585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071622.587486:0:18585:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b115afa80 going to sleep for 11 seconds 00000100:00100000:1.0:1783071622.589494:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707686144 00000100:00100000:1.0:1783071622.589513:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707686144 00000100:00100000:1.0:1783071622.589839:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1783071622.589852:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03811450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+21:18585:x1869685707686144:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783071622.590065:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03811450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+21:18585:x1869685707686144:12345-0@lo:501:mount.lustre.0 Request processed in 214us (2644us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071622.590075:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1783071622.593990:0:18585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02e42a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:18585:1869685707686144:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783071622.594063:0:18585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02e42a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:18585:1869685707686272:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783071622.594145:0:18585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071622.594196:0:18585:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b115afa80 going to sleep for 11 seconds 00000100:00100000:2.0:1783071622.594261:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707686272 00000100:00100000:2.0:1783071622.594268:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707686272 00000100:00100000:2.0:1783071622.594385:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1783071622.594395:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03812850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+21:18585:x1869685707686272:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783071622.594603:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03812850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+21:18585:x1869685707686272:12345-0@lo:503:mount.lustre.0 Request processed in 144us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071622.594613:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1783071622.596707:0:18585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02e42a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:18585:1869685707686272:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1783071622.597206:0:18585:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783071622.597321:0:18585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:18585:1869685707686400:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783071622.597434:0:18585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071622.597490:0:18585:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b186cb240 going to sleep for 11 seconds 00000100:00100000:2.0:1783071622.597909:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707686400 00000100:00100000:2.0:1783071622.597916:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707686400 00000100:00100000:2.0:1783071622.597970:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1783071622.597980:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03811050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+21:18585:x1869685707686400:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783071622.598098:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03811050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+21:18585:x1869685707686400:12345-0@lo:502:mount.lustre.0 Request processed in 119us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071622.598106:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1783071622.599269:0:18585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:18585:1869685707686400:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783071622.600528:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1783071622.600654:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1783071622.600670:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1783071622.600771:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1783071622.600788:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1783071622.600803:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1783071622.600816:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1783071622.600830:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1783071622.600844:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1783071622.600857:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1783071622.600887:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1783071622.600903:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1783071622.600916:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1783071622.600928:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1783071622.600940:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1783071622.600964:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1783071622.600977:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1783071622.600989:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1783071622.601001:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1783071622.601013:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1783071622.601025:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1783071622.601037:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1783071622.601048:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1783071622.601062:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1783071622.601074:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:1.0:1783071622.601087:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:1.0:1783071622.601114:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:1.0:1783071622.601129:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:1.0:1783071622.601142:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:1.0:1783071622.601152:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:1.0:1783071622.601164:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:1.0:1783071622.601175:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:1.0:1783071622.601188:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:1.0:1783071622.601202:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:1.0:1783071622.601216:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:1.0:1783071622.601228:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:1.0:1783071622.601242:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:1.0:1783071622.601257:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:1.0:1783071622.601271:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:1.0:1783071622.601284:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:1.0:1783071622.601297:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:1.0:1783071622.601309:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:1.0:1783071622.601340:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:1.0:1783071622.601357:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:1.0:1783071622.601398:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:1.0:1783071622.601413:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:1.0:1783071622.601426:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:1.0:1783071622.601440:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:1.0:1783071622.601531:0:18585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:18585:1869685707686528:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783071622.601997:0:18585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071622.602085:0:18585:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b186cb240 going to sleep for 11 seconds 00000100:00100000:2.0:1783071622.602132:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707686528 00000100:00100000:2.0:1783071622.602141:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707686528 00000100:00100000:2.0:1783071622.602225:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1783071622.602235:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03810050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+21:18585:x1869685707686528:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783071622.602396:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03810050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+21:18585:x1869685707686528:12345-0@lo:502:mount.lustre.0 Request processed in 161us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071622.602415:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1783071622.602872:0:18585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:18585:1869685707686528:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783071622.603085:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1783071622.603114:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:3.0:1783071622.603152:0:18585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02e41500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:18585:1869685707686656:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783071622.603199:0:18585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071622.603228:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707686656 00000100:00100000:3.0:1783071622.603233:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707686656 00000100:00100000:3.0:1783071622.603273:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1783071622.603280:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03810c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+21:18585:x1869685707686656:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783071622.603358:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03810c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+21:18585:x1869685707686656:12345-0@lo:502:mount.lustre.0 Request processed in 78us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071622.603391:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1783071622.603433:0:18585:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b0511bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1783071622.603452:0:18585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02e41500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:18585:1869685707686656:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783071622.603504:0:18585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:3.0:1783071622.603512:0:18585:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1783071622.605113:0:18612:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1783071622.605141:0:18612:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8f8a022999c0) 00000020:00000080:3.0:1783071622.605171:0:18612:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:3.0:1783071622.606658:0:18612:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f8a038e5000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1783071622.606668:0:18612:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f8a038e5000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1783071622.606743:0:18612:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8f8a038e5000 3 00010000:00080000:3.0:1783071622.606789:0:18612:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f8a02c13800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.138@tcp at head 00010000:00010000:3.0:1783071622.610009:0:18612:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:3.0:1783071622.610116:0:18612:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1783071622.610163:0:18612:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783071622.610176:0:18612:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x6b58994c2cbdd380 00000100:00080000:3.0:1783071622.610187:0:18612:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783071622.610194:0:18612:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8f8a02c13800 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:3.0:1783071622.610230:0:18612:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8a02e41500 x1869685707686784/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783071622.610399:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02e41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1869685707686784:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783071622.610484:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783071622.610567:0:18612:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1783071622.610621:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783071622.610626:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783071622.610629:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783071622.610632:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783071622.610655:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783071622.610658:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783071622.610660:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783071622.610669:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783071622.610703:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02e41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707686912:0@lo:400:kworker.0 00000100:00100000:3.0:1783071622.610740:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071622.610762:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783071622.610769:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02e42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869685707687296:0@lo:400:kworker.0 00000100:00100000:3.0:1783071622.610794:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071622.610924:0:17085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707686784 00000100:00100000:2.0:1783071622.610935:0:17085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707686784 00000100:00100000:2.0:1783071622.610974:0:17085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707687296 00000100:00100000:2.0:1783071622.610978:0:17085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707687296 00000100:00100000:2.0:1783071622.611010:0:17085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783071622.611022:0:17085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03bd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869685707687296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071622.611093:0:17085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03bd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869685707687296:12345-0@lo:400:kworker.0 Request processed in 73us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071622.611101:0:17085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783071622.611117:0:17085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783071622.611121:0:17085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01766300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1869685707686784:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1783071622.611146:0:17085:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 524 last 0 00000020:00000080:2.0:1783071622.611185:0:17085:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x6b58994c2cbdd387 00000004:00100000:2.0:1783071622.611207:0:17085:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783071622.611244:0:17085:0:(import.c:65:import_set_state_nolock()) ffff8f8a01f5a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783071622.611808:0:17085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01766300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1869685707686784:12345-0@lo:38:llog_process_th.0 Request processed in 683us (1322us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071622.611815:0:17085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783071622.611842:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02e40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869685707687040:0@lo:400:kworker.0 00000100:00100000:2.0:1783071622.611873:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071622.611935:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783071622.611942:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02e40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707687168:0@lo:400:kworker.0 00000100:00100000:2.0:1783071622.611967:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071622.612019:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707686912 00000100:00100000:2.0:1783071622.612025:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707686912 00000100:00100000:2.0:1783071622.612059:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707687168 00000100:00100000:2.0:1783071622.612062:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707687168 00000100:00100000:2.0:1783071622.612076:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783071622.612082:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03bd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707686912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071622.612121:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03bd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707686912:12345-0@lo:400:kworker.0 Request processed in 38us (1381us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071622.612126:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783071622.612136:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783071622.612141:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707687168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071622.612171:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707687168:12345-0@lo:400:kworker.0 Request processed in 29us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071622.612176:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1783071622.612227:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f8a02e41500 x1869685707686784/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783071632 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071622.612240:0:3644:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783071622.612260:0:3644:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1783071622.612269:0:3644:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1783071622.612273:0:3644:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1783071622.612276:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8f8a02c13800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783071622.612283:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02e41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1869685707686784:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783071622.612478:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707687040 00000100:00100000:3.0:1783071622.612483:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707687040 00000100:00100000:3.0:1783071622.612518:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783071622.612525:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1869685707687040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071622.612558:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1869685707687040:12345-0@lo:400:kworker.0 Request processed in 34us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071622.612564:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783071622.612668:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02e40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707687168:0@lo:400:kworker.0 00010000:00080000:2.0:1783071622.612679:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f8a02e40e00 x1869685707687040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071638 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071622.612687:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02e40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869685707687040:0@lo:400:kworker.0 00010000:00080000:2.0:1783071622.612821:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f8a02e42a00 x1869685707687296/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071638 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071622.612831:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02e42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869685707687296:0@lo:400:kworker.0 00000100:00100000:2.0:1783071622.612842:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02e41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707686912:0@lo:400:kworker.0 00000020:01000004:2.0:1783071622.613027:0:18612:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1783071622.613041:0:18612:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8f8b06c719c0) 00000020:00000080:2.0:1783071622.613060:0:18612:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:2.0:1783071622.613264:0:18612:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f8a038e5000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1783071622.613269:0:18612:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f8a038e5000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1783071622.613276:0:18612:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8f8a038e5000 3 00010000:00080000:2.0:1783071622.613303:0:18612:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f8a01f5f000@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.138@tcp at head 00010000:00010000:2.0:1783071622.614926:0:18612:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:2.0:1783071622.615026:0:18612:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1783071622.615071:0:18612:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1783071622.615083:0:18612:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x6b58994c2cbdd395 00000100:00080000:2.0:1783071622.615094:0:18612:0:(import.c:512:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783071622.615100:0:18612:0:(import.c:626:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8f8a01f5f000 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:2.0:1783071622.615139:0:18612:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8a032e7480 x1869685707687424/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783071622.615188:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1869685707687424:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783071622.615270:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071622.615334:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707687424 00000100:00100000:2.0:1783071622.615341:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707687424 00000100:00100000:2.0:1783071622.615389:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783071622.615397:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1869685707687424:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1783071622.615425:0:17086:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 524 last 0 00000020:00000080:2.0:1783071622.615477:0:17086:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x6b58994c2cbdd39c 00000004:00100000:2.0:1783071622.615492:0:17086:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783071622.615526:0:17086:0:(import.c:65:import_set_state_nolock()) ffff8f8a03009800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783071622.615572:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1869685707687424:12345-0@lo:38:llog_process_th.0 Request processed in 176us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071622.615579:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1783071622.615613:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f8a032e7480 x1869685707687424/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783071632 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071622.615623:0:3644:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783071622.615629:0:3644:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1783071622.615642:0:3644:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1783071622.615646:0:3644:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1783071622.615649:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8f8a01f5f000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783071622.615655:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1869685707687424:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1783071622.615672:0:18612:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1783071622.615695:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783071622.615700:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783071622.615703:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783071622.615706:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783071622.615709:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783071622.615712:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783071622.615714:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783071622.615717:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1783071622.619845:0:18612:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:0.0:1783071622.620480:0:18585:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1783071622.620527:0:18585:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783071622.620584:0:18585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66200/0x6b58994c2cbdd36b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd372 expref: -99 pid: 18585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071622.620597:0:18585:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66200/0x6b58994c2cbdd36b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd372 expref: -99 pid: 18585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1783071622.620654:0:18585:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1783071622.620656:0:18585:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783071622.620658:0:18585:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783071622.620664:0:18585:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783071622.620665:0:18585:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783071622.620666:0:18585:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783071622.620668:0:18585:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783071622.620669:0:18585:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783071622.620671:0:18585:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783071622.620674:0:18585:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1783071622.620677:0:18585:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783071622.620678:0:18585:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783071622.620679:0:18585:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783071622.620680:0:18585:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783071622.620681:0:18585:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783071622.620682:0:18585:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783071622.620683:0:18585:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783071622.620683:0:18585:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783071622.620684:0:18585:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783071622.620712:0:18585:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1783071622.620732:0:18585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01767800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:18585:1869685707687552:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1783071622.620797:0:18585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071622.620835:0:18585:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b07686600 going to sleep for 11 seconds 00000100:00100000:2.0:1783071622.621208:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707687552 00000100:00100000:2.0:1783071622.621217:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707687552 00000100:00100000:2.0:1783071622.621279:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1783071622.621289:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03813850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+21:18585:x1869685707687552:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783071622.621320:0:17081:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1783071622.621334:0:17081:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1783071622.627726:0:17081:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1783071622.627754:0:17081:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1783071622.628056:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03813850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+21:18585:x1869685707687552:12345-0@lo:253:mount.lustre.0 Request processed in 6761us (7251us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071622.628070:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1783071622.628112:0:18585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01767800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:18585:1869685707687552:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1783071622.628127:0:18585:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1783071622.628130:0:18585:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783071622.628132:0:18585:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783071622.628134:0:18585:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783071622.628135:0:18585:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783071622.628136:0:18585:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783071622.628137:0:18585:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783071622.628139:0:18585:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 20000000:01000000:2.0:1783071622.628141:0:17101:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 00000020:01000004:0.0:1783071622.628141:0:18585:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783071622.628142:0:18585:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783071622.628147:0:17101:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000020:02000000:0.0:1783071622.628162:0:18585:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1783071622.628169:0:17101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f8b2fd67600/0x6b58994c2cbdd3a3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071622.628201:0:17101:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8a03bd7800/0x6b58994c2cbdd2ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdd2e6 expref: 20 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071622.628209:0:17101:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8a03864000/0x6b58994c2cbdd2fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdd2f4 expref: 20 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071622.628216:0:17101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f8b2fd67600/0x6b58994c2cbdd3a3 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071622.628327:0:17101:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8a03864000/0x6b58994c2cbdd2fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6b58994c2cbdd2f4 expref: 20 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071622.628343:0:17101:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f8a03864000/0x6b58994c2cbdd2fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6b58994c2cbdd2f4 expref: 20 pid: 17079 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071622.628359:0:17101:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e7480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17101:1869685707687680:0@lo:104: 00000100:00100000:2.0:1783071622.628436:0:17101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783071622.628493:0:17101:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8a03bd7800/0x6b58994c2cbdd2ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6b58994c2cbdd2e6 expref: 20 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071622.628501:0:17101:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f8a03bd7800/0x6b58994c2cbdd2ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6b58994c2cbdd2e6 expref: 20 pid: 17078 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071622.628510:0:17101:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e4e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17101:1869685707687808:0@lo:104: 00000100:00100000:2.0:1783071622.628533:0:17101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071622.628675:0:17101:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b18027b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783071622.628749:0:17069:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1783071622.628763:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707687680 00000100:00100000:3.0:1783071622.628769:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707687680 00000100:00100000:3.0:1783071622.628800:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707687808 00000100:00100000:3.0:1783071622.628803:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707687808 00000100:00100000:3.0:1783071622.628817:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783071622.628827:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5ed14122-6273-4ec6-b260-6e79c239c375+4:17101:x1869685707687680:12345-0@lo:104: 00010000:00010000:3.0:1783071622.628840:0:17069:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66800/0x6b58994c2cbdd2f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdd2fb expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071622.628908:0:17069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783071622.628915:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5ed14122-6273-4ec6-b260-6e79c239c375+4:17101:x1869685707687680:12345-0@lo:104: Request processed in 89us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071622.628921:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783071622.628936:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783071622.628942:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b04393850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5ed14122-6273-4ec6-b260-6e79c239c375+3:17101:x1869685707687808:12345-0@lo:104: 00010000:00010000:3.0:1783071622.628950:0:17069:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67800/0x6b58994c2cbdd2e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdd2ed expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071622.628980:0:17069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1783071622.628986:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b04393850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5ed14122-6273-4ec6-b260-6e79c239c375+3:17101:x1869685707687808:12345-0@lo:104: Request processed in 45us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071622.628991:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1783071622.629021:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783071622.629027:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66800/0x6b58994c2cbdd2f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdd2fb expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071622.629034:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd66800 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:3.0:1783071622.629037:0:17075:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66800/0x6b58994c2cbdd2f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6b58994c2cbdd2fb expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071622.629045:0:17075:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66800/0x6b58994c2cbdd2f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6b58994c2cbdd2fb expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783071622.629052:0:17075:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66800/0x6b58994c2cbdd2f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6b58994c2cbdd2fb expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783071622.629057:0:17075:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783071622.629091:0:17075:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66800/0x6b58994c2cbdd2f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdd2fb expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071622.629098:0:17075:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783071622.629117:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66800/0x6b58994c2cbdd2f4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdd2fb expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071622.629124:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd66800/0x6b58994c2cbdd2f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdd2fb expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071622.629133:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783071622.629136:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67800/0x6b58994c2cbdd2e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdd2ed expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071622.629142:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd67800 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:3.0:1783071622.629144:0:17075:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67800/0x6b58994c2cbdd2e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6b58994c2cbdd2ed expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071622.629151:0:17075:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67800/0x6b58994c2cbdd2e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6b58994c2cbdd2ed expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783071622.629156:0:17075:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67800/0x6b58994c2cbdd2e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6b58994c2cbdd2ed expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783071622.629161:0:17075:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783071622.629173:0:17075:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67800/0x6b58994c2cbdd2e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdd2ed expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071622.629178:0:17075:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783071622.629189:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67800/0x6b58994c2cbdd2e6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdd2ed expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071622.629208:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67800/0x6b58994c2cbdd2e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdd2ed expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071622.629222:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071622.629224:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071622.629225:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071622.629231:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071622.629239:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783071622.629321:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03bd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ed14122-6273-4ec6-b260-6e79c239c375:3647:1869685707687936:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783071622.629353:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071622.629626:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707687936 00000100:00100000:3.0:1783071622.629631:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707687936 00010000:00010000:3.0:1783071622.629650:0:17073:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8a03864000/0x6b58994c2cbdd2fb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdd2f4 expref: 21 pid: 17079 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071622.629671:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783071622.629677:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03bd2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ed14122-6273-4ec6-b260-6e79c239c375+21:3647:x1869685707687936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783071622.629688:0:17073:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071622.629694:0:17073:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8a03864000/0x6b58994c2cbdd2fb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdd2f4 expref: 21 pid: 17079 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071622.629703:0:17073:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8a03864000/0x6b58994c2cbdd2fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6b58994c2cbdd2f4 expref: 21 pid: 17079 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071622.629720:0:17073:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783071622.629764:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03bd2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ed14122-6273-4ec6-b260-6e79c239c375+21:3647:x1869685707687936:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071622.629771:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783071622.629817:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03bd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ed14122-6273-4ec6-b260-6e79c239c375:3647:1869685707687936:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783071622.629904:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03bd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ed14122-6273-4ec6-b260-6e79c239c375:3645:1869685707688064:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783071622.629936:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071622.629992:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707688064 00000100:00100000:2.0:1783071622.629996:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707688064 00010000:00010000:2.0:1783071622.630011:0:17072:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8a03bd7800/0x6b58994c2cbdd2ed lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdd2e6 expref: 21 pid: 17078 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071622.630032:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783071622.630039:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3eb8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ed14122-6273-4ec6-b260-6e79c239c375+21:3645:x1869685707688064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783071622.630046:0:17072:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071622.630050:0:17072:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8a03bd7800/0x6b58994c2cbdd2ed lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdd2e6 expref: 21 pid: 17078 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071622.630059:0:17072:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8a03bd7800/0x6b58994c2cbdd2ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6b58994c2cbdd2e6 expref: 21 pid: 17078 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071622.630072:0:17072:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f8b2fd67600/0x6b58994c2cbdd3a3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071622.630080:0:17072:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b2fd67600/0x6b58994c2cbdd3a3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783071622.630096:0:17072:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002755277s 00010000:00010000:2.0:1783071622.630101:0:17072:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f8b2fd67600/0x6b58994c2cbdd3a3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071622.630109:0:17072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f8b2fd67600/0x6b58994c2cbdd3a3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071622.630116:0:17072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f8b2fd67600/0x6b58994c2cbdd3a3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071622.630122:0:17072:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f8b2fd67600/0x6b58994c2cbdd3a3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071622.630138:0:17072:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd67600 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:2.0:1783071622.630142:0:17072:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f8b2fd67600/0x6b58994c2cbdd3a3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071622.630151:0:17072:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f8b2fd67600/0x6b58994c2cbdd3a3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071622.630158:0:17072:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f8b2fd67600/0x6b58994c2cbdd3a3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071622.630170:0:17072:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071622.630201:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3eb8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ed14122-6273-4ec6-b260-6e79c239c375+21:3645:x1869685707688064:12345-0@lo:103:ldlm_bl.0 Request processed in 162us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071622.630208:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783071622.630345:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03bd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ed14122-6273-4ec6-b260-6e79c239c375:3645:1869685707688064:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783071622.630482:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8a03864000/0x6b58994c2cbdd2fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6b58994c2cbdd2f4 expref: 20 pid: 17079 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071622.630495:0:17101:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e7480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17101:1869685707687680:0@lo:104: 00010000:00010000:2.0:1783071622.630506:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8a03bd7800/0x6b58994c2cbdd2ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6b58994c2cbdd2e6 expref: 19 pid: 17078 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071622.630513:0:17101:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e4e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17101:1869685707687808:0@lo:104: 00010000:00010000:2.0:1783071622.630526:0:17101:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f8b2fd67600/0x6b58994c2cbdd3a3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071622.630536:0:17101:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f8b2fd67600/0x6b58994c2cbdd3a3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071622.630804:0:17101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f8b2fd67600/0x6b58994c2cbdd3a3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071622.630811:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b2fd67600/0x6b58994c2cbdd3a3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:2.0:1783071622.638351:0:18585:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1783071622.650142:0:18585:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1783071622.650153:0:18585:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1783071622.650192:0:18585:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783071622.650240:0:18585:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.138@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783071622.650265:0:18585:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1783071622.650289:0:18585:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1783071622.651934:0:18585:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783071622.652168:0:18585:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783071623.113531:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1783071623.491877:0:18665:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783071623.492305:0:18665:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783071624.133716:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1783071624.461625:0:17083:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783071624.461636:0:17083:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8f8b10f78000 from 9 10000000:01000000:2.0:1783071624.461642:0:17083:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783071624.461692:0:17083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67600/0x6b58994c2cbdd3aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071624.461714:0:17083:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67600/0x6b58994c2cbdd3aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071624.461727:0:17083:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67600/0x6b58994c2cbdd3aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071624.461867:0:17083:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ed14122-6273-4ec6-b260-6e79c239c375:17083:1869685707688192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783071624.461950:0:17083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071624.462000:0:17083:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0394f300 going to sleep for 11 seconds 00000100:00100000:0.0:1783071624.462070:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707688192 00000100:00100000:0.0:1783071624.462077:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707688192 00000100:00100000:0.0:1783071624.462128:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1783071624.462145:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03811850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+19:17083:x1869685707688192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783071624.462160:0:17078:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071624.462174:0:17078:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8a03864200/0x6b58994c2cbdd3b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdd3aa expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071624.462196:0:17078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8a03864200/0x6b58994c2cbdd3b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdd3aa expref: 20 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071624.462206:0:17078:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8a03864200/0x6b58994c2cbdd3b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdd3aa expref: 20 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071624.462216:0:17078:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a03864200, rc 0) 00000100:00100000:0.0:1783071624.462256:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03811850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+20:17083:x1869685707688192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071624.462263:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1783071624.462351:0:17083:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ed14122-6273-4ec6-b260-6e79c239c375:17083:1869685707688192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783071624.462394:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67600/0x6b58994c2cbdd3aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd3b1 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071624.462405:0:17083:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67600/0x6b58994c2cbdd3aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdd3b1 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071624.462471:0:17083:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ed14122-6273-4ec6-b260-6e79c239c375:17083:1869685707688320:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1783071624.462501:0:17083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071624.462526:0:17083:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0394f300 going to sleep for 11 seconds 00000100:00100000:0.0:1783071624.462683:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707688320 00000100:00100000:0.0:1783071624.462687:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707688320 00000100:00100000:0.0:1783071624.462763:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1783071624.462772:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03811c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+20:17083:x1869685707688320:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1783071624.462787:0:17081:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783071624.462803:0:17081:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783071624.462806:0:17081:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1783071624.462904:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03811c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+20:17083:x1869685707688320:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 132us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071624.462912:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1783071624.463036:0:17083:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ed14122-6273-4ec6-b260-6e79c239c375:17083:1869685707688320:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1783071624.463112:0:17083:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783071624.463120:0:17083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67600/0x6b58994c2cbdd3aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd3b1 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071624.463129:0:17083:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67600/0x6b58994c2cbdd3aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd3b1 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071624.463141:0:17083:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783071624.463143:0:17083:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8f8a041ea000 from 9 10000000:01000000:2.0:1783071624.463145:0:17083:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783071624.463163:0:17083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67800/0x6b58994c2cbdd3b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071624.463170:0:17083:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67800/0x6b58994c2cbdd3b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071624.463179:0:17083:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67800/0x6b58994c2cbdd3b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071624.463204:0:17083:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ed14122-6273-4ec6-b260-6e79c239c375:17083:1869685707688448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783071624.463230:0:17083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071624.463245:0:17083:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0394f300 going to sleep for 11 seconds 00000100:00100000:2.0:1783071624.463258:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707688448 00000100:00100000:2.0:1783071624.463262:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707688448 00000100:00100000:2.0:1783071624.463284:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1783071624.463291:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03813450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+20:17083:x1869685707688448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783071624.463299:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071624.463308:0:17079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b2fd66800/0x6b58994c2cbdd3bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdd3b8 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071624.463326:0:17079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b2fd66800/0x6b58994c2cbdd3bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdd3b8 expref: 21 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071624.463335:0:17079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b2fd66800/0x6b58994c2cbdd3bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdd3b8 expref: 21 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071624.463344:0:17079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b2fd66800, rc 0) 00000100:00100000:2.0:1783071624.463394:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03813450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+21:17083:x1869685707688448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071624.463401:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1783071624.463447:0:17083:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ed14122-6273-4ec6-b260-6e79c239c375:17083:1869685707688448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783071624.463458:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67800/0x6b58994c2cbdd3b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd3bf expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071624.463467:0:17083:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67800/0x6b58994c2cbdd3b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdd3bf expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071624.463506:0:17083:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ed14122-6273-4ec6-b260-6e79c239c375:17083:1869685707688576:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1783071624.463532:0:17083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071624.463549:0:17083:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0394f300 going to sleep for 11 seconds 00000100:00100000:2.0:1783071624.463559:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707688576 00000100:00100000:2.0:1783071624.463562:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707688576 00000100:00100000:2.0:1783071624.463580:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1783071624.463586:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03813c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+21:17083:x1869685707688576:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783071624.463596:0:17079:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783071624.463608:0:17079:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783071624.463611:0:17079:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1783071624.463671:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03813c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+21:17083:x1869685707688576:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 84us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071624.463677:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1783071624.463934:0:17083:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ed14122-6273-4ec6-b260-6e79c239c375:17083:1869685707688576:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1783071624.463977:0:17083:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783071624.463983:0:17083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67800/0x6b58994c2cbdd3b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd3bf expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071624.463991:0:17083:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67800/0x6b58994c2cbdd3b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd3bf expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071625.155294:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071625.538699:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783071625.538743:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03bd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707688704:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783071625.538775:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783071625.538785:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03bd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707688832:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783071625.538831:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071625.538852:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707688832 00000100:00100000:1.0:1783071625.538860:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707688832 00000100:00100000:3.0:1783071625.538872:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071625.538898:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707688704 00000100:00100000:3.0:1783071625.538901:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707688704 00000100:00100000:1.0:1783071625.538910:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783071625.538918:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03bd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707688832:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783071625.538919:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783071625.538924:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03bd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707688704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783071625.538953:0:17091:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000004:00000024:1.0:1783071625.538953:0:17090:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1783071625.539061:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03bd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707688832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071625.539070:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783071625.545497:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03bd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707688704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 6548us (6599us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071625.545517:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783071625.546228:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03bd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707688832:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783071625.546290:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03bd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707688704:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1783071626.178566:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071627.202540:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783071628.103207:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783071628.103216:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783071628.103219:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783071628.103229:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783071628.103250:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783071628.103254:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783071628.103256:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783071628.103259:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783071628.103312:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707689344:0@lo:400:kworker.0 00000100:00100000:1.0:1783071628.103901:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01767800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ed14122-6273-4ec6-b260-6e79c239c375:3648:1869685707688960:0@lo:400:kworker.0 00000100:00100000:0.0:1783071628.105066:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071628.105224:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707689088:0@lo:400:kworker.0 00000100:00100000:0.0:1783071628.105253:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071628.105315:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071628.105339:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869685707689472:0@lo:400:kworker.0 00000100:00100000:0.0:1783071628.105532:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01766680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1869685707689600:0@lo:400:kworker.0 00000100:00100000:0.0:1783071628.105560:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071628.105582:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1783071628.105588:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869685707689216:0@lo:400:kworker.0 00000100:00100000:0.0:1783071628.105608:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071628.105625:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02e42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1869685707689728:0@lo:400:kworker.0 00000100:00100000:0.0:1783071628.105648:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071628.105679:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707689600 00000100:00100000:0.0:1783071628.105687:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707689600 00000100:00100000:0.0:1783071628.105730:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707689216 00000100:00100000:0.0:1783071628.105733:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707689216 00000100:00100000:0.0:1783071628.105743:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707689728 00000100:00100000:0.0:1783071628.105746:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707689728 00000100:00100000:0.0:1783071628.105762:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783071628.105769:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02e40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1869685707689600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071628.105823:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02e40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1869685707689600:12345-0@lo:400:kworker.0 Request processed in 54us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071628.105835:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783071628.105853:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783071628.105860:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02e40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1869685707689216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071628.105886:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02e40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1869685707689216:12345-0@lo:400:kworker.0 Request processed in 26us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071628.105892:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783071628.105902:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783071628.105908:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02e41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1869685707689728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071628.105931:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02e41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1869685707689728:12345-0@lo:400:kworker.0 Request processed in 24us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071628.105937:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1783071628.105972:0:17082:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783071628.106064:0:17825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707689344 00000100:00100000:2.0:1783071628.106069:0:17825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707689344 00000100:00100000:2.0:1783071628.106096:0:17825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707689088 00000100:00100000:2.0:1783071628.106099:0:17825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707689088 00000100:00100000:2.0:1783071628.106112:0:17825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783071628.106126:0:17825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02e41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707689344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071628.106172:0:17825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02e41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707689344:12345-0@lo:400:kworker.0 Request processed in 47us (1109us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071628.106178:0:17825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783071628.106190:0:17825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783071628.106195:0:17825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02e42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707689088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071628.106221:0:17825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02e42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707689088:12345-0@lo:400:kworker.0 Request processed in 27us (968us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071628.106229:0:17825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1783071628.106315:0:17082:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1783071628.106552:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a01767480 x1869685707689216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071644 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071628.106567:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869685707689216:0@lo:400:kworker.0 00010000:00080000:0.0:1783071628.106580:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a02e42680 x1869685707689728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071644 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071628.106588:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02e42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1869685707689728:0@lo:400:kworker.0 00000100:00100000:0.0:1783071628.106597:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707689088:0@lo:400:kworker.0 00010000:00080000:0.0:1783071628.106606:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a01766680 x1869685707689600/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071644 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071628.106613:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01766680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1869685707689600:0@lo:400:kworker.0 00000100:00100000:0.0:1783071628.106659:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707689344:0@lo:400:kworker.0 00000100:00100000:1.0:1783071628.108190:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071628.108286:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707688960 00000100:00100000:1.0:1783071628.108293:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707688960 00000100:00100000:1.0:1783071628.108344:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1783071628.108354:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03812c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+21:3648:x1869685707688960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071628.108384:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707689472 00000100:00100000:2.0:1783071628.108388:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707689472 00000100:00100000:2.0:1783071628.108422:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783071628.108549:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869685707689472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071628.108613:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869685707689472:12345-0@lo:400:kworker.0 Request processed in 185us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071628.108621:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783071628.109218:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03812c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+21:3648:x1869685707688960:12345-0@lo:400:kworker.0 Request processed in 863us (3900us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071628.109227:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1783071628.109290:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01767800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ed14122-6273-4ec6-b260-6e79c239c375:3648:1869685707688960:0@lo:400:kworker.0 00010000:00080000:1.0:1783071628.109307:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a01765f80 x1869685707689472/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071644 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071628.109318:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869685707689472:0@lo:400:kworker.0 00010000:00010000:2.0:1783071628.227662:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783071628.497942:0:18954:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg438-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:0.0:1783071628.686357:0:17119:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1783071629.251043:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1783071629.279575:0:19006:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783071629.280172:0:19006:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:3.0:1783071630.105951:0:19057:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783071630.106339:0:19057:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783071630.278344:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071630.660134:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783071630.660162:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03bd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707689856:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783071630.660240:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071630.663175:0:17825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707689856 00000100:00100000:3.0:1783071630.663192:0:17825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707689856 00000100:00100000:3.0:1783071630.663268:0:17825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783071630.663279:0:17825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707689856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783071630.663330:0:17825:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1783071630.663468:0:17825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707689856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 190us (3227us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071630.663492:0:17825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783071630.663614:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03bd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707689856:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783071630.665646:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02e42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707689984:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783071630.665717:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071630.665894:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707689984 00000100:00100000:3.0:1783071630.665903:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707689984 00000100:00100000:3.0:1783071630.665970:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783071630.665980:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707689984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783071630.666016:0:17090:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1783071630.666072:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707689984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071630.666079:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783071630.666262:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02e42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707689984:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1783071631.302494:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071632.326554:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783071632.518976:0:17836:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:1.0:1783071633.218687:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:3.0:1783071633.218817:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707690240:0@lo:400:kworker.0 00000100:00100000:3.0:1783071633.218922:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071633.218937:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ed14122-6273-4ec6-b260-6e79c239c375:3645:1869685707690112:0@lo:400:kworker.0 00000100:00100000:2.0:1783071633.218990:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071633.219047:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707690240 00000100:00100000:3.0:1783071633.219059:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707690240 00000100:00100000:2.0:1783071633.219065:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707690112 00000100:00100000:2.0:1783071633.219071:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707690112 00000100:00100000:3.0:1783071633.219127:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783071633.219127:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1783071633.219144:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+21:3645:x1869685707690112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071633.219145:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03bd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707690240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071633.219223:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03bd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707690240:12345-0@lo:400:kworker.0 Request processed in 82us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071633.219225:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+21:3645:x1869685707690112:12345-0@lo:400:kworker.0 Request processed in 85us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071633.219239:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783071633.219240:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1783071633.219312:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707690240:0@lo:400:kworker.0 00000100:00100000:2.0:1783071633.219312:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ed14122-6273-4ec6-b260-6e79c239c375:3645:1869685707690112:0@lo:400:kworker.0 00000100:00080000:1.0:1783071633.219690:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783071633.219958:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783071633.219964:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783071633.220017:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783071633.220021:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783071633.220024:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783071633.220028:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1783071633.220084:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707690496:0@lo:400:kworker.0 00000100:00100000:2.0:1783071633.220095:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869685707690368:0@lo:400:kworker.0 00000100:00100000:1.0:1783071633.220142:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071633.220146:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071633.220175:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1869685707690880:0@lo:400:kworker.0 00000100:00100000:2.0:1783071633.220201:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071633.220205:0:17825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707690496 00000100:00100000:1.0:1783071633.220212:0:17825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707690496 00000100:00100000:2.0:1783071633.220240:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707690368 00000100:00100000:2.0:1783071633.220245:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707690368 00000100:00100000:1.0:1783071633.220259:0:17825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783071633.220281:0:17825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707690496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071633.220292:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707690880 00000100:00100000:2.0:1783071633.220297:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707690880 00000100:00100000:2.0:1783071633.220330:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783071633.220339:0:17825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707690496:12345-0@lo:400:kworker.0 Request processed in 60us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071633.220340:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869685707690368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071633.220354:0:17825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783071633.220414:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707690496:0@lo:400:kworker.0 00000100:00100000:1.0:1783071633.220434:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869685707690624:0@lo:400:kworker.0 00000100:00100000:1.0:1783071633.220460:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071633.220474:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783071633.220960:0:17085:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1783071633.220983:0:17085:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00080000:0.0:1783071633.221001:0:17082:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783071633.221217:0:17085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707690624 00000100:00100000:0.0:1783071633.221224:0:17085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707690624 00000100:00100000:0.0:1783071633.221251:0:17085:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1783071633.221270:0:17085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783071633.221280:0:17085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869685707690880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071633.221345:0:17085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869685707690880:12345-0@lo:400:kworker.0 Request processed in 66us (1142us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071633.221352:0:17085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783071633.221511:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869685707690368:12345-0@lo:400:kworker.0 Request processed in 1173us (1365us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071633.221520:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783071633.221536:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783071633.221543:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1869685707690624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071633.221573:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1869685707690624:12345-0@lo:400:kworker.0 Request processed in 32us (1113us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071633.221580:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1783071633.221632:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a03a9d500 x1869685707690368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071649 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071633.221669:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869685707690368:0@lo:400:kworker.0 00010000:00080000:2.0:1783071633.221685:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a03a9df80 x1869685707690880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071649 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071633.221694:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1869685707690880:0@lo:400:kworker.0 00000100:00100000:1.0:1783071633.222350:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1869685707690752:0@lo:400:kworker.0 00000100:00100000:1.0:1783071633.222428:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1783071633.222474:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a03a9c700 x1869685707690624/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071649 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071633.222494:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869685707690624:0@lo:400:kworker.0 00000100:00100000:1.0:1783071633.222544:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707690752 00000100:00100000:1.0:1783071633.222551:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707690752 00000100:00100000:1.0:1783071633.222601:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783071633.222609:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1869685707690752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071633.222658:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1869685707690752:12345-0@lo:400:kworker.0 Request processed in 50us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071633.222666:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1783071633.222687:0:17082:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1783071633.222799:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a03a9ea00 x1869685707690752/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071649 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071633.222828:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1869685707690752:0@lo:400:kworker.0 00010000:00010000:3.0:1783071633.349967:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071634.373671:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071634.882520:0:3644:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783071619/real 1783071619] req@ffff8f8a03a9ca80 x1869685707682944/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783071634 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071634.882569:0:3644:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f8a03a9ca80 x1869685707682944/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783071634 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071634.882583:0:3644:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783071619/real 1783071619] req@ffff8f8a03a9f100 x1869685707683072/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783071634 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071634.882596:0:3644:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f8a03a9f100 x1869685707683072/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783071634 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783071634.882702:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8f8a01e4e800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783071634.882725:0:3644:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1783071634.882730:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1869685707682944:0@lo:8:kworker.0 00000100:00080000:0.0:1783071634.882747:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8f8b3b4b0800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783071634.882781:0:3644:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1783071634.882785:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1869685707683072:0@lo:8:kworker.0 00000100:00080000:1.0:1783071634.883195:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:0.0:1783071634.883197:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ed14122-6273-4ec6-b260-6e79c239c375:3648:1869685707691008:0@lo:400:kworker.0 00000100:00080000:1.0:1783071634.883205:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783071634.883211:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783071634.883214:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783071634.883248:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783071634.883252:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1783071634.883255:0:38:0:(import.c:65:import_set_state_nolock()) ffff8f8a01e4e800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783071634.883261:0:38:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 521 00000100:00080000:1.0:1783071634.883268:0:38:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783071634.883277:0:38:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8f8a01e4e800 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:1.0:1783071634.883310:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8a03a9ca80 x1869685707691520/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783071634.883327:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783071634.883330:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1783071634.883332:0:38:0:(import.c:65:import_set_state_nolock()) ffff8f8b3b4b0800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783071634.883335:0:38:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 521 00000100:00080000:1.0:1783071634.883338:0:38:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783071634.883342:0:38:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8f8b3b4b0800 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:1.0:1783071634.883355:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8a03a9df80 x1869685707691648/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783071634.883414:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707691392:0@lo:400:kworker.0 00000100:00100000:1.0:1783071634.883438:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707691136:0@lo:400:kworker.0 00000100:00100000:2.0:1783071634.883460:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071634.883635:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071634.883758:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707691008 00000100:00100000:3.0:1783071634.883770:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707691008 00000100:00100000:3.0:1783071634.883837:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1783071634.883847:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+21:3648:x1869685707691008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071634.884156:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071634.884190:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783071634.884192:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03af0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1869685707691904:0@lo:400:kworker.0 00000100:00100000:2.0:1783071634.884201:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869685707691776:0@lo:400:kworker.0 00000100:00100000:2.0:1783071634.884419:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071634.884462:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707691392 00000100:00100000:2.0:1783071634.884468:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707691392 00000100:00100000:1.0:1783071634.884478:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071634.884508:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707691136 00000100:00100000:1.0:1783071634.884509:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1783071634.884513:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707691136 00000100:00100000:1.0:1783071634.884521:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869685707691264:0@lo:400:kworker.0 00000100:00100000:2.0:1783071634.884536:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783071634.884546:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707691392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071634.884553:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071634.884575:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03af2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1869685707692032:0@lo:400:kworker.0 00000100:00100000:2.0:1783071634.884608:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707691392:12345-0@lo:400:kworker.0 Request processed in 61us (1146us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071634.884616:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071634.884653:0:17825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783071634.884662:0:17825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03af3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707691136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071634.884703:0:17825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03af3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707691136:12345-0@lo:400:kworker.0 Request processed in 42us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071634.884711:0:17825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783071634.884742:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707691776 00000100:00100000:1.0:1783071634.884748:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707691776 00000100:00100000:1.0:1783071634.884771:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707691904 00000100:00100000:1.0:1783071634.884774:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707691904 00000100:00100000:1.0:1783071634.884786:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707691264 00000100:00100000:1.0:1783071634.884789:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707691264 00000100:00100000:1.0:1783071634.884806:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707692032 00000100:00100000:1.0:1783071634.884809:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707692032 00000100:00100000:0.0:1783071634.884827:0:17085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783071634.884845:0:17085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869685707691776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071634.884882:0:17085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869685707691776:12345-0@lo:400:kworker.0 Request processed in 42us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071634.884907:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1783071634.884958:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a03a9d500 x1869685707691776/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071650 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071634.884976:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869685707691776:0@lo:400:kworker.0 00000100:00100000:2.0:1783071634.884991:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707691392:0@lo:400:kworker.0 00000100:00100000:3.0:1783071634.885125:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+21:3648:x1869685707691008:12345-0@lo:400:kworker.0 Request processed in 1277us (1817us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071634.885147:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1783071634.885291:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783071634.885300:0:17085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783071634.885306:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03af2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1869685707691904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071634.885353:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03af2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1869685707691904:12345-0@lo:400:kworker.0 Request processed in 50us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071634.885486:0:19199:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1783071634.885501:0:19199:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:2.0:1783071634.885532:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1869685707691520:0@lo:8:kworker.0 00000100:00100000:2.0:1783071634.885567:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071634.885703:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1869685707691648:0@lo:8:kworker.0 00000100:00100000:2.0:1783071634.885730:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071634.885789:0:18591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707691520 00000100:00100000:2.0:1783071634.885795:0:18591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707691520 00000100:00100000:2.0:1783071634.885815:0:18591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707691648 00000100:00100000:2.0:1783071634.885818:0:18591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707691648 00000100:00100000:2.0:1783071634.885828:0:18591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783071634.885834:0:18591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3644:x1869685707691520:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1783071634.885867:0:18591:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 536 last 0 00000020:00000080:2.0:1783071634.885903:0:18591:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x6b58994c2cbdd3c6 00002000:00100000:2.0:1783071634.885921:0:18591:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8f8a01f5e800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1783071634.885926:0:18591:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1783071634.885929:0:18591:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1783071634.886472:0:18591:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1783071634.886508:0:18591:0:(import.c:65:import_set_state_nolock()) ffff8f8a01f5d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783071634.886581:0:18591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3644:x1869685707691520:12345-0@lo:8:kworker.0 Request processed in 745us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071634.886590:0:18591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783071634.886608:0:18591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783071634.886692:0:18591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3644:x1869685707691648:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1783071634.886712:0:18591:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:3.0:1783071634.887259:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a03a9ca80 x1869685707691520/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783071654 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071634.887281:0:3644:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783071634.887299:0:3644:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1783071634.887310:0:3644:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1783071634.887316:0:3644:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1783071634.887320:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8f8a01e4e800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1783071634.887347:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1783071634.887354:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1869685707691520:0@lo:8:kworker.0 00000004:00080000:3.0:1783071634.887435:0:17827:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1783071634.887457:0:17827:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03bd3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17827:1869685707692288:0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1783071634.887504:0:17827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071634.887529:0:17827:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a03235480 going to sleep for 11 seconds 00000100:00100000:3.0:1783071634.887550:0:18589:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1783071634.887557:0:18589:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000004:00080000:3.0:1783071634.889484:0:17826:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1783071634.890428:0:17826:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 536679061656ns, next at 0ns, rc = 0 00080000:00080000:3.0:1783071634.890440:0:17826:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1783071634.890491:0:18592:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1783071634.890509:0:18592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707692288 00000100:00100000:3.0:1783071634.890521:0:18592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707692288 00000100:00080000:3.0:1783071634.891723:0:17082:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783071634.892738:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000004:00080000:3.0:1783071634.895331:0:17817:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:1.0:1783071634.895455:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783071634.895495:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03af0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1869685707691264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071634.895639:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03af0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1869685707691264:12345-0@lo:400:kworker.0 Request processed in 152us (11085us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071634.895648:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783071634.895673:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783071634.895681:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03af0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1869685707692032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071634.895710:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03af0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1869685707692032:12345-0@lo:400:kworker.0 Request processed in 32us (11095us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071634.895716:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1783071634.896161:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a03a9f480 x1869685707691264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071650 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071634.896181:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869685707691264:0@lo:400:kworker.0 00010000:00080000:1.0:1783071634.896199:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a03af2d80 x1869685707692032/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071650 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071634.896208:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03af2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1869685707692032:0@lo:400:kworker.0 00000100:00100000:1.0:1783071634.896223:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707691136:0@lo:400:kworker.0 00010000:00080000:1.0:1783071634.896248:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a03af0000 x1869685707691904/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071650 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071634.896257:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03af0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1869685707691904:0@lo:400:kworker.0 00000100:00100000:1.0:1783071634.896687:0:19286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783071634.896700:0:19286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03bd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17827:x1869685707692288:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1783071634.896771:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ed14122-6273-4ec6-b260-6e79c239c375:3648:1869685707691008:0@lo:400:kworker.0 00000100:00100000:0.0:1783071634.896790:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783071634.896803:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03bd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707692160:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783071634.896864:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071634.901774:0:18593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707692160 00000100:00100000:3.0:1783071634.901794:0:18593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707692160 00000100:00100000:2.0:1783071634.902963:0:18591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3644:x1869685707691648:12345-0@lo:8:kworker.0 Request processed in 16334us (17218us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783071634.902984:0:18591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1783071634.903074:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8f8b3b4b0800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783071634.903081:0:3644:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783071634.903086:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1869685707691648:0@lo:8:kworker.0 00000100:00100000:3.0:1783071634.903244:0:18593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783071634.903260:0:18593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02e42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3648:x1869685707692160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783071634.903309:0:18593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1783071634.903393:0:18593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02e42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3648:x1869685707692160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 138us (6528us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071634.903400:0:18593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1783071634.903493:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a03bd0380 x1869685707692160/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071650 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071634.903529:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03bd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707692160:0@lo:13:osp-pre-0-1.0 00002000:00080000:1.0:1783071634.904719:0:19286:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1783071634.904728:0:19286:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:1.0:1783071634.904807:0:19286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03bd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17827:x1869685707692288:12345-0@lo:7:osp-pre-0-1.0 Request processed in 8108us (17299us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071634.904817:0:19286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1783071634.904930:0:17827:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a03bd3b80 x1869685707692288/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783071650 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071634.904945:0:17827:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03bd3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17827:1869685707692288:0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1783071634.904959:0:17827:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:2.0:1783071634.905008:0:17827:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e7100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17827:1869685707692416:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1783071634.905047:0:17827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071634.905077:0:17827:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b064efe40 going to sleep for 11 seconds 00000100:00100000:2.0:1783071634.905095:0:18592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707692416 00000100:00100000:2.0:1783071634.905102:0:18592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707692416 00000100:00100000:2.0:1783071634.905152:0:18592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783071634.905160:0:18592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17827:x1869685707692416:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1783071634.905190:0:18592:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:2.0:1783071634.905220:0:18592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17827:x1869685707692416:12345-0@lo:5:osp-pre-0-1.0 Request processed in 60us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071634.905226:0:18592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1783071634.905266:0:17827:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a032e7100 x1869685707692416/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783071650 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071634.905276:0:17827:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e7100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17827:1869685707692416:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1783071634.905284:0:17827:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:2.0:1783071634.905319:0:17827:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17827:1869685707692544:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1783071634.905338:0:17827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071634.905380:0:17827:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b064efe40 going to sleep for 11 seconds 00000100:00100000:2.0:1783071634.905392:0:18591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707692544 00000100:00100000:2.0:1783071634.905396:0:18591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707692544 00000100:00100000:2.0:1783071634.905414:0:18591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783071634.905419:0:18591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17827:x1869685707692544:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1783071634.905445:0:18591:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000001:00080000:1.0:1783071634.947056:0:18586:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:1.0:1783071634.947080:0:18586:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1783071634.948822:0:18591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:17827:x1869685707692544:12345-0@lo:5:osp-pre-0-1.0 Request processed in 43389us (43470us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1783071634.948845:0:18591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1783071634.948861:0:17827:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a03a9ea00 x1869685707692544/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783071650 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071634.948878:0:17827:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1783071634.948887:0:17827:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17827:1869685707692544:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1783071634.948907:0:17827:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:3.0:1783071634.948983:0:17827:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03bd2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17827:1869685707692672:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1783071634.949029:0:17827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071634.949100:0:17827:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a03235240 going to sleep for 11 seconds 00000100:00100000:0.0:1783071634.953294:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707692672 00000100:00100000:0.0:1783071634.953329:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707692672 00000100:00100000:0.0:1783071634.953445:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783071634.953458:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03bd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17827:x1869685707692672:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1783071634.953610:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03bd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17827:x1869685707692672:12345-0@lo:900:osp-pre-0-1.0 Request processed in 154us (4580us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071634.953635:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1783071634.953701:0:17827:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a03bd2a00 x1869685707692672/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783071650 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071634.953737:0:17827:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03bd2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17827:1869685707692672:0@lo:900:osp-pre-0-1.0 00010000:00010000:1.0:1783071635.395812:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071635.779133:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783071635.779166:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03bd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707692800:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783071635.779274:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071635.779468:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707692928:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783071635.779503:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071635.779580:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707692800 00000100:00100000:2.0:1783071635.779590:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707692800 00000100:00100000:2.0:1783071635.779658:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707692928 00000100:00100000:2.0:1783071635.779662:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707692928 00000100:00100000:2.0:1783071635.779681:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783071635.779691:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707692800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783071635.779740:0:17090:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1783071635.779800:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707692800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071635.779808:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783071635.779828:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783071635.779849:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03bd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707692928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783071635.779871:0:17090:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1783071635.779909:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03bd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707692928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071635.779917:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783071635.780165:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707692928:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783071635.780204:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03bd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707692800:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1783071636.421821:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1783071636.842288:0:19405:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:1.0:1783071636.842292:0:19405:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1783071636.842294:0:19405:0:(obd_mount.c:920:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1783071636.842595:0:19405:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8f8b069dc800 00000020:01000004:1.0:1783071636.842612:0:19405:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1783071636.842629:0:19405:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1783071636.842642:0:19405:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8f8a017d8000) 00000020:00000080:1.0:1783071636.842663:0:19405:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1783071636.878095:0:19405:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1783071636.880349:0:19405:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1783071636.880811:0:19405:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1783071636.881006:0:19405:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1783071636.881423:0:19405:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1783071636.881638:0:19405:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1783071636.881857:0:19405:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:0.0:1783071636.884207:0:19405:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1783071636.884594:0:19405:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1783071636.884610:0:19405:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:0.0:1783071636.884622:0:19405:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x6b58994c2cbdd3d4 00000020:01000004:0.0:1783071636.884630:0:19405:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1783071636.884654:0:19405:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.204.138@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1783071636.884658:0:19405:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.138@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1783071636.884664:0:19405:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1783071636.884701:0:19405:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1783071636.884706:0:19405:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.138@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1783071636.897039:0:19405:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.138@tcp ctxt 0 is initialized 00000020:01000004:0.0:1783071636.897092:0:19405:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.138@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1783071636.897098:0:19405:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1783071636.897100:0:19405:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783071636.897101:0:19405:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783071636.897102:0:19405:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783071636.897103:0:19405:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783071636.897104:0:19405:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783071636.897106:0:19405:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783071636.897108:0:19405:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783071636.897109:0:19405:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783071636.897112:0:19405:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1783071636.897115:0:19405:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783071636.897116:0:19405:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783071636.897123:0:19405:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783071636.897124:0:19405:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783071636.897124:0:19405:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783071636.897125:0:19405:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783071636.897126:0:19405:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783071636.897127:0:19405:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783071636.897128:0:19405:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783071636.897170:0:19405:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1783071636.897203:0:19405:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01765f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:19405:1869685707693056:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1783071636.897332:0:19405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071636.897456:0:19405:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b064ef780 going to sleep for 11 seconds 00000100:00100000:2.0:1783071636.897499:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707693056 00000100:00100000:2.0:1783071636.897508:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707693056 00000100:00100000:2.0:1783071636.897605:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1783071636.897624:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+21:19405:x1869685707693056:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783071636.897660:0:17078:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1783071636.897663:0:17078:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1783071636.897667:0:17078:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1783071636.897992:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+21:19405:x1869685707693056:12345-0@lo:253:mount.lustre.0 Request processed in 368us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071636.898001:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1783071636.898094:0:19405:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01765f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:19405:1869685707693056:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1783071636.898107:0:19405:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1783071636.898110:0:19405:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783071636.898111:0:19405:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783071636.898112:0:19405:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783071636.898113:0:19405:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783071636.898115:0:19405:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783071636.898116:0:19405:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783071636.898118:0:19405:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783071636.898119:0:19405:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783071636.898120:0:19405:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1783071636.898144:0:19405:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8f8b069dc800 from lustre-OST0001 10000000:01000000:1.0:1783071636.898176:0:19405:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1783071636.898179:0:19405:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1783071636.898204:0:19405:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8f8b34e64d40 local copy 00010000:00010000:1.0:1783071636.898215:0:19405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8a03864600/0x6b58994c2cbdd0ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd0f5 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071636.898338:0:19405:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03af0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:19405:1869685707693184:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783071636.898463:0:19405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071636.898486:0:19405:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b419cd480 going to sleep for 11 seconds 00000100:00100000:3.0:1783071636.898610:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707693184 00000100:00100000:3.0:1783071636.898616:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707693184 00000100:00100000:3.0:1783071636.898688:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1783071636.898697:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+21:19405:x1869685707693184:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783071636.898776:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+21:19405:x1869685707693184:12345-0@lo:501:mount.lustre.0 Request processed in 80us (312us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783071636.898789:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1783071636.898912:0:19405:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03af0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:19405:1869685707693184:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1783071636.898925:0:19405:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.138@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1783071636.898944:0:19405:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.138@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1783071636.898950:0:19405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8a03864600/0x6b58994c2cbdd0ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd0f5 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071636.898960:0:19405:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8a03864600/0x6b58994c2cbdd0ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd0f5 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783071636.898986:0:19405:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f8b069dc800 10000000:01000000:1.0:1783071636.898991:0:19405:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1783071636.898996:0:19405:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1783071636.898998:0:19405:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783071636.899002:0:19405:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1783071636.899005:0:19405:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1783071636.899028:0:19405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd7200/0x6b58994c2cbdd3db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071636.899035:0:19405:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd7200/0x6b58994c2cbdd3db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071636.899043:0:19405:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd7200/0x6b58994c2cbdd3db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071636.899062:0:19405:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03af0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:19405:1869685707693312:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783071636.899089:0:19405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071636.899112:0:19405:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b419cd480 going to sleep for 11 seconds 00000100:00100000:3.0:1783071636.899167:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707693312 00000100:00100000:3.0:1783071636.899171:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707693312 00000100:00100000:3.0:1783071636.899210:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1783071636.899216:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+21:19405:x1869685707693312:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783071636.899225:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071636.899236:0:17079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8a01749a00/0x6b58994c2cbdd3e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdd3db expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071636.899256:0:17079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8a01749a00/0x6b58994c2cbdd3e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdd3db expref: 22 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071636.899264:0:17079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8a01749a00/0x6b58994c2cbdd3e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdd3db expref: 22 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071636.899284:0:17079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a01749a00, rc 0) 00000100:00100000:3.0:1783071636.899319:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+22:19405:x1869685707693312:12345-0@lo:101:mount.lustre.0 Request processed in 103us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071636.899326:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1783071636.899517:0:19405:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03af0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:19405:1869685707693312:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783071636.899528:0:19405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd7200/0x6b58994c2cbdd3db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd3e2 expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071636.899536:0:19405:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd7200/0x6b58994c2cbdd3db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdd3e2 expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783071636.904321:0:19405:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1783071636.905240:0:19405:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783071636.906974:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1783071636.907028:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1783071636.907043:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1783071636.907057:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1783071636.907071:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1783071636.907083:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1783071636.907106:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1783071636.907112:0:19405:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1783071636.907236:0:19405:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03af0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:19405:1869685707693440:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783071636.907417:0:19405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071636.907473:0:19405:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b419cd3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071636.907565:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707693440 00000100:00100000:3.0:1783071636.907573:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707693440 00000100:00100000:3.0:1783071636.907733:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1783071636.907743:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+22:19405:x1869685707693440:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783071636.907901:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+22:19405:x1869685707693440:12345-0@lo:501:mount.lustre.0 Request processed in 159us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071636.907909:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1783071636.907982:0:19405:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03af0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:19405:1869685707693440:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783071636.908015:0:19405:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03af0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:19405:1869685707693568:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783071636.908059:0:19405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071636.908143:0:19405:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b419cd3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783071636.908206:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707693568 00000100:00100000:2.0:1783071636.908211:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707693568 00000100:00100000:2.0:1783071636.908237:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1783071636.908244:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+22:19405:x1869685707693568:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783071636.909011:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+22:19405:x1869685707693568:12345-0@lo:503:mount.lustre.0 Request processed in 766us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071636.909020:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1783071636.909108:0:19405:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03af0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:19405:1869685707693568:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1783071636.909617:0:19405:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783071636.909696:0:19405:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03af0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:19405:1869685707693696:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783071636.909747:0:19405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071636.909776:0:19405:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b06962780 going to sleep for 11 seconds 00000100:00100000:2.0:1783071636.909887:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707693696 00000100:00100000:2.0:1783071636.909893:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707693696 00000100:00100000:2.0:1783071636.909928:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1783071636.909936:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+22:19405:x1869685707693696:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783071636.910317:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+22:19405:x1869685707693696:12345-0@lo:502:mount.lustre.0 Request processed in 382us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071636.910325:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1783071636.910658:0:19405:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03af0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:19405:1869685707693696:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783071636.910852:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1783071636.910881:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1783071636.910893:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1783071636.910905:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1783071636.910916:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1783071636.910927:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1783071636.910938:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1783071636.910948:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1783071636.910974:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1783071636.911001:0:19405:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03af0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:19405:1869685707693824:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783071636.911043:0:19405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071636.911079:0:19405:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b06962780 going to sleep for 11 seconds 00000100:00100000:3.0:1783071636.911181:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707693824 00000100:00100000:3.0:1783071636.911203:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707693824 00000100:00100000:3.0:1783071636.911243:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1783071636.911251:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+22:19405:x1869685707693824:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783071636.911578:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+22:19405:x1869685707693824:12345-0@lo:502:mount.lustre.0 Request processed in 328us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071636.911586:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1783071636.911833:0:19405:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03af0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:19405:1869685707693824:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783071636.911972:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1783071636.911982:0:19405:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:0.0:1783071636.912858:0:19409:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783071636.912869:0:19409:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1783071636.912876:0:19409:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783071636.912879:0:19409:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1783071636.912887:0:19409:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783071636.912905:0:19409:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8f8b3d5ccd40) 00000020:00000080:0.0:1783071636.912934:0:19409:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:0.0:1783071636.912941:0:19409:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1783071636.913013:0:19409:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f8b069dc800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1783071636.913023:0:19409:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:0.0:1783071636.913029:0:19409:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x6b58994c2cbdd3f0 00010000:00010000:1.0:1783071636.919410:0:19409:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:1.0:1783071636.920615:0:19409:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:1.0:1783071636.926665:0:19409:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:2.0:1783071636.934945:0:19409:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1783071636.934966:0:19409:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783071636.934974:0:19409:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071636.934976:0:19409:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1783071636.934981:0:19409:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783071636.934991:0:19409:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071636.934993:0:19409:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783071636.934997:0:19409:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783071636.934999:0:19409:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1783071636.935002:0:19409:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783071636.935004:0:19409:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071636.935006:0:19409:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1783071636.935009:0:19409:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783071636.935011:0:19409:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071636.935012:0:19409:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1783071636.935015:0:19409:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1783071636.935057:0:19409:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783071636.935061:0:19409:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071636.935062:0:19409:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1783071636.935066:0:19409:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1783071636.935559:0:19405:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1783071636.935610:0:19405:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1783071636.935643:0:19405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd7200/0x6b58994c2cbdd3db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd3e2 expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071636.935657:0:19405:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd7200/0x6b58994c2cbdd3db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd3e2 expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783071636.935674:0:19405:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8f8b069dc800 from 1 10000000:01000000:1.0:1783071636.935677:0:19405:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783071636.935720:0:19405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd7600/0x6b58994c2cbdd3f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071636.935728:0:19405:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd7600/0x6b58994c2cbdd3f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071636.935739:0:19405:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd7600/0x6b58994c2cbdd3f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071636.935763:0:19405:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03af2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:19405:1869685707693952:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783071636.935834:0:19405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071636.935878:0:19405:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b1ee08a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783071636.936312:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707693952 00000100:00100000:3.0:1783071636.936321:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707693952 00000100:00100000:3.0:1783071636.936391:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1783071636.936401:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+22:19405:x1869685707693952:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783071636.936415:0:17078:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071636.936428:0:17078:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8a01749c00/0x6b58994c2cbdd3fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdd3f7 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071636.936452:0:17078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8a01749c00/0x6b58994c2cbdd3fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdd3f7 expref: 23 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071636.936462:0:17078:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8a01749c00/0x6b58994c2cbdd3fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdd3f7 expref: 23 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071636.936471:0:17078:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a01749c00, rc 0) 00000100:00100000:3.0:1783071636.936509:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+23:19405:x1869685707693952:12345-0@lo:101:mount.lustre.0 Request processed in 110us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071636.936516:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1783071636.938708:0:19405:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03af2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:19405:1869685707693952:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783071636.938737:0:19405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd7600/0x6b58994c2cbdd3f7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd3fe expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071636.938751:0:19405:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd7600/0x6b58994c2cbdd3f7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdd3fe expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783071636.940593:0:19405:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1783071636.940922:0:19405:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783071636.941164:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1783071636.941206:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1783071636.941240:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1783071636.941251:0:19405:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1783071636.941838:0:19405:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:19405:1869685707694080:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783071636.941917:0:19405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071636.942021:0:19405:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a01744a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783071636.942075:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707694080 00000100:00100000:0.0:1783071636.942084:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707694080 00000100:00100000:0.0:1783071636.942138:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1783071636.942147:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+23:19405:x1869685707694080:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783071636.942528:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+23:19405:x1869685707694080:12345-0@lo:501:mount.lustre.0 Request processed in 380us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071636.942536:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1783071636.945451:0:19405:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:19405:1869685707694080:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783071636.945564:0:19405:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03bd2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:19405:1869685707694208:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783071636.945707:0:19405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071636.945750:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707694208 00000100:00100000:3.0:1783071636.945752:0:19405:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b10efd6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783071636.945758:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707694208 00000100:00100000:1.0:1783071636.945816:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1783071636.945825:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+23:19405:x1869685707694208:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783071636.945956:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+23:19405:x1869685707694208:12345-0@lo:503:mount.lustre.0 Request processed in 131us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071636.945974:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1783071636.946528:0:19405:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03bd2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:19405:1869685707694208:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1783071636.947212:0:19405:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783071636.947457:0:19405:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:19405:1869685707694336:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783071636.947529:0:19405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071636.947752:0:19405:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a01744a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783071636.947833:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707694336 00000100:00100000:0.0:1783071636.947841:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707694336 00000100:00100000:0.0:1783071636.947896:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1783071636.947905:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+23:19405:x1869685707694336:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783071636.948071:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+23:19405:x1869685707694336:12345-0@lo:502:mount.lustre.0 Request processed in 166us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071636.948080:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1783071636.948210:0:19405:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:19405:1869685707694336:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783071636.948522:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1783071636.948555:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1783071636.948701:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1783071636.948722:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1783071636.948735:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1783071636.948749:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1783071636.948762:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1783071636.948775:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:2.0:1783071636.948790:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1783071636.948803:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:2.0:1783071636.948835:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:2.0:1783071636.948866:0:19405:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:19405:1869685707694464:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783071636.948913:0:19405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071636.948992:0:19405:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a01744a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783071636.949032:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707694464 00000100:00100000:0.0:1783071636.949039:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707694464 00000100:00100000:0.0:1783071636.949228:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1783071636.949237:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+23:19405:x1869685707694464:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783071636.949356:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+23:19405:x1869685707694464:12345-0@lo:502:mount.lustre.0 Request processed in 120us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071636.949384:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1783071636.949587:0:19405:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:19405:1869685707694464:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783071636.949646:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:2.0:1783071636.949656:0:19405:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1783071636.951932:0:19413:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783071636.951946:0:19413:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071636.951948:0:19413:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1783071636.951956:0:19413:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f8b069dc800 00000020:00000080:3.0:1783071636.951959:0:19413:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783071636.951967:0:19413:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783071636.951973:0:19413:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071636.951975:0:19413:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1783071636.951977:0:19413:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783071636.951978:0:19413:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071636.951980:0:19413:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1783071636.951983:0:19413:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f8b069dc800 00000020:00000080:3.0:1783071636.951984:0:19413:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783071636.952042:0:19413:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783071636.952046:0:19413:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071636.952047:0:19413:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1783071636.952050:0:19413:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783071636.952052:0:19413:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071636.952053:0:19413:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783071636.952056:0:19413:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f8b069dc800 00000020:00000080:3.0:1783071636.952058:0:19413:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783071636.952096:0:19413:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783071636.952100:0:19413:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071636.952101:0:19413:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783071636.952104:0:19413:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783071636.952106:0:19413:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071636.952108:0:19413:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1783071636.952111:0:19413:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f8b069dc800 00000020:00000080:3.0:1783071636.952113:0:19413:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783071636.952136:0:19413:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783071636.952139:0:19413:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071636.952141:0:19413:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1783071636.952144:0:19413:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1783071636.952235:0:19405:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1783071636.952298:0:19405:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783071636.952315:0:19405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd7600/0x6b58994c2cbdd3f7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd3fe expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071636.952328:0:19405:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd7600/0x6b58994c2cbdd3f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd3fe expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783071636.952815:0:19405:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1783071636.952819:0:19405:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f8b069dc800 10000000:01000000:3.0:1783071636.952822:0:19405:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f8b069dc800 10000000:01000000:3.0:1783071636.952826:0:19405:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783071636.952833:0:19405:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8f8b069dc800 from 1 10000000:01000000:3.0:1783071636.952836:0:19405:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783071636.952877:0:19405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8a01749200/0x6b58994c2cbdd405 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071636.952887:0:19405:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8a01749200/0x6b58994c2cbdd405 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071636.952900:0:19405:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8a01749200/0x6b58994c2cbdd405 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071636.952930:0:19405:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03bd3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:19405:1869685707694592:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783071636.953022:0:19405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071636.953080:0:19405:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b03f12d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783071636.953382:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707694592 00000100:00100000:2.0:1783071636.953390:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707694592 00000100:00100000:2.0:1783071636.953436:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1783071636.953456:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+23:19405:x1869685707694592:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783071636.953473:0:17078:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071636.953487:0:17078:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b2fd67c00/0x6b58994c2cbdd40c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdd405 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071636.953516:0:17078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b2fd67c00/0x6b58994c2cbdd40c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdd405 expref: 24 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071636.953528:0:17078:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b2fd67c00/0x6b58994c2cbdd40c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdd405 expref: 24 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071636.953538:0:17078:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b2fd67c00, rc 0) 00000100:00100000:2.0:1783071636.953585:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+24:19405:x1869685707694592:12345-0@lo:101:mount.lustre.0 Request processed in 131us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071636.953593:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1783071636.953676:0:19405:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03bd3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:19405:1869685707694592:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783071636.953692:0:19405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8a01749200/0x6b58994c2cbdd405 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd40c expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071636.953701:0:19405:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8a01749200/0x6b58994c2cbdd405 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdd40c expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783071636.959979:0:19405:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:2.0:1783071636.961098:0:19405:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783071636.961346:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1783071636.961395:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1783071636.961412:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1783071636.961426:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1783071636.961438:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1783071636.961451:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1783071636.961463:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1783071636.961476:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1783071636.961488:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1783071636.961501:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1783071636.961513:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1783071636.961526:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1783071636.961540:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1783071636.961565:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1783071636.961581:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1783071636.961595:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1783071636.961609:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1783071636.964508:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1783071636.965883:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1783071636.965917:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1783071636.965932:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1783071636.965948:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1783071636.965982:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1783071636.965999:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1783071636.966012:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:2.0:1783071636.966023:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:2.0:1783071636.966035:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:2.0:1783071636.966046:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:2.0:1783071636.966057:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1783071636.966069:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:2.0:1783071636.966080:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:2.0:1783071636.966091:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:2.0:1783071636.966102:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:2.0:1783071636.966114:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:2.0:1783071636.966125:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:2.0:1783071636.966137:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:2.0:1783071636.966148:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:2.0:1783071636.966160:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:2.0:1783071636.966186:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:2.0:1783071636.966213:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:2.0:1783071636.966227:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:2.0:1783071636.966238:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:2.0:1783071636.966249:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:2.0:1783071636.966261:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:2.0:1783071636.967888:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:2.0:1783071636.967926:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:2.0:1783071636.967963:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:2.0:1783071636.967969:0:19405:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:2.0:1783071636.968874:0:19405:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:19405:1869685707694720:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783071636.968948:0:19405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071636.969005:0:19405:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a01744480 going to sleep for 11 seconds 00000100:00100000:1.0:1783071636.969999:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707694720 00000100:00100000:1.0:1783071636.970010:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707694720 00000100:00100000:1.0:1783071636.970079:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1783071636.970092:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+24:19405:x1869685707694720:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783071636.970288:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+24:19405:x1869685707694720:12345-0@lo:501:mount.lustre.0 Request processed in 198us (1339us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071636.970296:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1783071636.970469:0:19405:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:19405:1869685707694720:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783071636.970517:0:19405:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:19405:1869685707694848:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783071636.971353:0:19405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071636.971424:0:19405:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a01744480 going to sleep for 11 seconds 00000100:00100000:1.0:1783071636.971690:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707694848 00000100:00100000:1.0:1783071636.971697:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707694848 00000100:00100000:1.0:1783071636.971753:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1783071636.971762:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+24:19405:x1869685707694848:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783071636.972049:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+24:19405:x1869685707694848:12345-0@lo:503:mount.lustre.0 Request processed in 287us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071636.972056:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1783071636.972778:0:19405:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:19405:1869685707694848:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1783071636.973232:0:19405:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783071636.974457:0:19405:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:19405:1869685707694976:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783071636.974538:0:19405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071636.974601:0:19405:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a01744480 going to sleep for 11 seconds 00000100:00100000:0.0:1783071636.975406:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707694976 00000100:00100000:0.0:1783071636.975414:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707694976 00000100:00100000:0.0:1783071636.975471:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1783071636.975480:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+24:19405:x1869685707694976:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783071636.975873:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+24:19405:x1869685707694976:12345-0@lo:502:mount.lustre.0 Request processed in 392us (1334us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071636.975881:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1783071636.975992:0:19405:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:19405:1869685707694976:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783071636.977867:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1783071636.977929:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1783071636.977946:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1783071636.977962:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1783071636.977978:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1783071636.978020:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1783071636.978038:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1783071636.978052:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1783071636.978068:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1783071636.978083:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1783071636.978098:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1783071636.978114:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1783071636.978142:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1783071636.978157:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1783071636.978173:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1783071636.978188:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1783071636.978221:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1783071636.978238:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1783071636.978254:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1783071636.979123:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1783071636.979158:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1783071636.979206:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1783071636.979224:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1783071636.979240:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1783071636.979251:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1783071636.979264:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1783071636.979421:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1783071636.979452:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1783071636.979466:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1783071636.979480:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1783071636.979493:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1783071636.979504:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1783071636.979514:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1783071636.979524:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1783071636.979536:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1783071636.979548:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1783071636.979561:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1783071636.979729:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1783071636.979749:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1783071636.979764:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1783071636.979778:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1783071636.979792:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1783071636.979807:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1783071636.979824:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1783071636.979840:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1783071636.979864:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1783071636.979877:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1783071636.979891:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1783071636.979951:0:19405:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:19405:1869685707695104:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783071636.980045:0:19405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071636.980161:0:19405:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a01744480 going to sleep for 11 seconds 00000100:00100000:0.0:1783071636.980341:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707695104 00000100:00100000:0.0:1783071636.980349:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707695104 00000100:00100000:0.0:1783071636.981005:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1783071636.981016:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+24:19405:x1869685707695104:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783071636.981220:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+24:19405:x1869685707695104:12345-0@lo:502:mount.lustre.0 Request processed in 205us (1175us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071636.981229:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1783071636.981445:0:19405:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:19405:1869685707695104:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783071636.981945:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1783071636.981976:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1783071636.982009:0:19405:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:19405:1869685707695232:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783071636.982061:0:19405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071636.982131:0:19405:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a01744480 going to sleep for 11 seconds 00000100:00100000:0.0:1783071636.982167:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707695232 00000100:00100000:0.0:1783071636.982173:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707695232 00000100:00100000:0.0:1783071636.982225:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1783071636.982232:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+24:19405:x1869685707695232:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783071636.982482:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+24:19405:x1869685707695232:12345-0@lo:502:mount.lustre.0 Request processed in 250us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071636.982490:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1783071636.983704:0:19405:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:19405:1869685707695232:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783071636.983814:0:19405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1783071636.983827:0:19405:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1783071636.985715:0:19418:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1783071636.985735:0:19418:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8f8b3d5c99c0) 00000020:00000080:0.0:1783071636.985766:0:19418:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:0.0:1783071636.986040:0:19418:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f8b069dc800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1783071636.986045:0:19418:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f8b069dc800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1783071636.986049:0:19418:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8f8b069dc800 3 00010000:00080000:0.0:1783071636.986092:0:19418:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f8a010f7800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.138@tcp at head 00010000:00010000:0.0:1783071636.989051:0:19418:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:0.0:1783071636.989178:0:19418:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1783071636.989240:0:19418:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1783071636.989253:0:19418:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x6b58994c2cbdd41a 00000100:00080000:0.0:1783071636.989265:0:19418:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783071636.991107:0:19418:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8f8a010f7800 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:0.0:1783071636.991215:0:19418:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8a01767800 x1869685707695360/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783071636.991334:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01767800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1869685707695360:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783071636.991436:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071636.991529:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707695360 00000100:00100000:2.0:1783071636.991537:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707695360 00000100:00100000:2.0:1783071636.991580:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783071636.991589:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03bd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1869685707695360:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1783071636.991615:0:17087:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 538 last 0 00000020:00000080:2.0:1783071636.991681:0:17087:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x6b58994c2cbdd421 00000004:00100000:2.0:1783071636.991699:0:17087:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783071636.991736:0:17087:0:(import.c:65:import_set_state_nolock()) ffff8f8a02e05800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1783071636.992334:0:19418:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1783071636.992770:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783071636.992776:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783071636.992780:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783071636.992783:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783071636.992812:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783071636.992828:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1783071636.992832:0:8:0:(import.c:65:import_set_state_nolock()) ffff8f8b3b4b0800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783071636.992838:0:8:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 536 00000100:00080000:1.0:1783071636.992842:0:8:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1783071636.992854:0:8:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8f8b3b4b0800 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:1.0:1783071636.992875:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8a03af0380 x1869685707696000/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783071636.993060:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03af2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707695488:0@lo:400:kworker.0 00000100:00100000:0.0:1783071636.993114:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071636.993147:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783071636.993153:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03af2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707695872:0@lo:400:kworker.0 00000100:00100000:0.0:1783071636.993176:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071636.993269:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707695488 00000100:00100000:0.0:1783071636.993281:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707695488 00000100:00100000:0.0:1783071636.993337:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783071636.993346:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707695488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071636.993443:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707695488:12345-0@lo:400:kworker.0 Request processed in 98us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071636.993451:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783071636.993488:0:18592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707695872 00000100:00100000:0.0:1783071636.993492:0:18592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707695872 00000100:00100000:0.0:1783071636.993527:0:18592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783071636.993534:0:18592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01766680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707695872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071636.993573:0:18592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01766680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707695872:12345-0@lo:400:kworker.0 Request processed in 40us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071636.993580:0:18592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1783071636.993614:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a03af2300 x1869685707695872/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071652 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071636.993627:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03af2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707695872:0@lo:400:kworker.0 00000100:00100000:0.0:1783071636.993638:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03af2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707695488:0@lo:400:kworker.0 00000100:00100000:3.0:1783071636.994436:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03af0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1869685707696000:0@lo:8:kworker.0 00000100:00100000:3.0:1783071636.994495:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071636.994587:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03bd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1869685707695360:12345-0@lo:38:llog_process_th.0 Request processed in 2995us (3149us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071636.994597:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783071636.994618:0:19286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707696000 00000100:00100000:0.0:1783071636.994625:0:19286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707696000 00000100:00100000:0.0:1783071636.994653:0:19286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783071636.994659:0:19286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03bd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3644:x1869685707696000:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1783071636.994710:0:19286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03bd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3644:x1869685707696000:12345-0@lo:8:kworker.0 Request processed in 49us (214us total) trans 0 rc -11/-11 00000100:00100000:0.0:1783071636.994717:0:19286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1783071636.994731:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a01767800 x1869685707695360/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783071646 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071636.994742:0:3644:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783071636.994750:0:3644:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1783071636.994758:0:3644:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1783071636.994763:0:3644:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1783071636.994767:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8f8a010f7800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1783071636.994774:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01767800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1869685707695360:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783071636.994797:0:3644:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783071636.994801:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8f8b3b4b0800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783071636.994805:0:3644:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1783071636.994807:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03af0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1869685707696000:0@lo:8:kworker.0 00000100:00100000:3.0:1783071636.994837:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03af3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869685707695616:0@lo:400:kworker.0 00000100:00100000:3.0:1783071636.994868:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071636.994896:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03af0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1869685707696256:0@lo:400:kworker.0 00000100:00100000:1.0:1783071636.994920:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03af1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707695744:0@lo:400:kworker.0 00000100:00100000:3.0:1783071636.994921:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783071636.994950:0:17082:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783071636.994962:0:17085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707695616 00000100:00100000:1.0:1783071636.994963:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071636.994968:0:17085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707695616 00000100:00100000:1.0:1783071636.994992:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03af3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1869685707696384:0@lo:400:kworker.0 00000100:00100000:1.0:1783071636.995016:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071636.995099:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783071636.995109:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03af1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869685707696128:0@lo:400:kworker.0 00000100:00100000:1.0:1783071636.995140:0:17825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707695744 00000100:00100000:2.0:1783071636.995144:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071636.995146:0:17825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707695744 00000100:00100000:2.0:1783071636.995175:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707696256 00000100:00100000:2.0:1783071636.995180:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707696256 00000100:00100000:1.0:1783071636.995204:0:17825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783071636.995215:0:17825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03af2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707695744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071636.995220:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707696384 00000100:00100000:2.0:1783071636.995224:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707696384 00000100:00100000:2.0:1783071636.995242:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707696128 00000100:00100000:2.0:1783071636.995244:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707696128 00000100:00100000:2.0:1783071636.995261:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783071636.995267:0:17825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03af2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707695744:12345-0@lo:400:kworker.0 Request processed in 55us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071636.995274:0:17825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783071636.995346:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869685707695616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071636.995408:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869685707695616:12345-0@lo:400:kworker.0 Request processed in 140us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071636.995415:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783071636.995429:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783071636.995435:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03bd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869685707696256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071636.995463:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03bd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869685707696256:12345-0@lo:400:kworker.0 Request processed in 28us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071636.995469:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783071636.995479:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783071636.995485:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03af1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869685707696384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071636.995510:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03af1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869685707696384:12345-0@lo:400:kworker.0 Request processed in 25us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071636.995515:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783071636.995525:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783071636.995530:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1869685707696128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071636.995565:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1869685707696128:12345-0@lo:400:kworker.0 Request processed in 34us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071636.995575:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03af1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707695744:0@lo:400:kworker.0 00000100:00100000:2.0:1783071636.995585:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1783071636.995592:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a03af3480 x1869685707696384/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071652 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071636.995602:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03af3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1869685707696384:0@lo:400:kworker.0 00010000:00080000:2.0:1783071636.995620:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a03af1f80 x1869685707696128/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071652 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071636.995736:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03af1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869685707696128:0@lo:400:kworker.0 00000100:00080000:3.0:1783071636.999416:0:17082:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783071636.999425:0:17082:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1783071636.999488:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a03af0e00 x1869685707696256/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071652 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071636.999510:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03af0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1869685707696256:0@lo:400:kworker.0 00010000:00080000:3.0:1783071636.999526:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a03af3800 x1869685707695616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071652 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071636.999547:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03af3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869685707695616:0@lo:400:kworker.0 00000020:01000004:1.0:1783071637.000642:0:19418:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1783071637.000658:0:19418:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8f8a017db380) 00000020:00000080:1.0:1783071637.000684:0:19418:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1783071637.001150:0:19418:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f8b069dc800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1783071637.001156:0:19418:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f8b069dc800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1783071637.001159:0:19418:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8f8b069dc800 3 00010000:00080000:1.0:1783071637.001215:0:19418:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f8a02ef1000@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.138@tcp at head 00010000:00010000:1.0:1783071637.008783:0:19418:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:1.0:1783071637.008968:0:19418:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1783071637.009048:0:19418:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783071637.009065:0:19418:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x6b58994c2cbdd42f 00000100:00080000:1.0:1783071637.009077:0:19418:0:(import.c:512:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783071637.009085:0:19418:0:(import.c:626:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8f8a02ef1000 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:1.0:1783071637.009128:0:19418:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8a03af3480 x1869685707696512/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783071637.009159:0:19418:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1783071637.009315:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03af3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1869685707696512:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783071637.009414:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071637.009497:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707696512 00000100:00100000:3.0:1783071637.009505:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707696512 00000100:00100000:3.0:1783071637.009544:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783071637.009555:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03bd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1869685707696512:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1783071637.009582:0:17086:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 538 last 0 00000020:00000080:3.0:1783071637.009645:0:17086:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x6b58994c2cbdd436 00000004:00100000:3.0:1783071637.009664:0:17086:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783071637.009704:0:17086:0:(import.c:65:import_set_state_nolock()) ffff8f8a02c12800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783071637.009771:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03bd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1869685707696512:12345-0@lo:38:llog_process_th.0 Request processed in 215us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071637.009780:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1783071637.009838:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a03af3480 x1869685707696512/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783071647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071637.009849:0:3644:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783071637.009859:0:3644:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1783071637.009868:0:3644:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1783071637.009873:0:3644:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1783071637.009876:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8f8a02ef1000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1783071637.009885:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03af3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1869685707696512:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1783071637.010167:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783071637.010173:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783071637.010177:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783071637.010180:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1783071637.014550:0:19418:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:3.0:1783071637.015045:0:19405:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1783071637.015083:0:19405:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783071637.015119:0:19405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8a01749200/0x6b58994c2cbdd405 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd40c expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071637.015133:0:19405:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8a01749200/0x6b58994c2cbdd405 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd40c expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1783071637.015202:0:19405:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1783071637.015205:0:19405:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783071637.015206:0:19405:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783071637.015207:0:19405:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783071637.015209:0:19405:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783071637.015210:0:19405:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783071637.015212:0:19405:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783071637.015213:0:19405:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783071637.015215:0:19405:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783071637.015219:0:19405:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1783071637.015222:0:19405:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783071637.015223:0:19405:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783071637.015224:0:19405:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783071637.015225:0:19405:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783071637.015226:0:19405:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783071637.015227:0:19405:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783071637.015228:0:19405:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783071637.015229:0:19405:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783071637.015230:0:19405:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783071637.015259:0:19405:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1783071637.015281:0:19405:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03bd0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:19405:1869685707696640:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783071637.015357:0:19405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071637.015439:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707696640 00000100:00100000:3.0:1783071637.015451:0:19405:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b186cb540 going to sleep for 11 seconds 00000100:00100000:0.0:1783071637.015459:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707696640 00000100:00100000:0.0:1783071637.015544:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1783071637.015555:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+24:19405:x1869685707696640:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783071637.015583:0:17081:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1783071637.015597:0:17081:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1783071637.018543:0:17081:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783071637.018607:0:17081:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1783071637.018963:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+24:19405:x1869685707696640:12345-0@lo:253:mount.lustre.0 Request processed in 3404us (3600us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071637.018976:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1783071637.019103:0:19405:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03bd0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ed14122-6273-4ec6-b260-6e79c239c375:19405:1869685707696640:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1783071637.019119:0:19405:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1783071637.019122:0:19405:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783071637.019124:0:19405:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783071637.019125:0:19405:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783071637.019133:0:19405:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783071637.019134:0:19405:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783071637.019136:0:19405:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783071637.019137:0:19405:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783071637.019140:0:19405:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783071637.019141:0:19405:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1783071637.019160:0:19405:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1783071637.022756:0:17101:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1783071637.022768:0:17101:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1783071637.022792:0:17101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f8a03bd7800/0x6b58994c2cbdd43d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071637.022811:0:17101:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8a03864200/0x6b58994c2cbdd3b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdd3aa expref: 23 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071637.022820:0:17101:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8b2fd66800/0x6b58994c2cbdd3bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdd3b8 expref: 23 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071637.022829:0:17101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f8a03bd7800/0x6b58994c2cbdd43d lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071637.022883:0:17101:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8b2fd66800/0x6b58994c2cbdd3bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6b58994c2cbdd3b8 expref: 23 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071637.022909:0:17101:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f8b2fd66800/0x6b58994c2cbdd3bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6b58994c2cbdd3b8 expref: 23 pid: 17079 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071637.022925:0:17101:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03af1180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17101:1869685707696768:0@lo:104: 00000100:00100000:1.0:1783071637.023711:0:17101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783071637.023814:0:17101:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8a03864200/0x6b58994c2cbdd3b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6b58994c2cbdd3aa expref: 23 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071637.023825:0:17101:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f8a03864200/0x6b58994c2cbdd3b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6b58994c2cbdd3aa expref: 23 pid: 17078 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071637.023835:0:17101:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03af3b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17101:1869685707696896:0@lo:104: 00000100:00100000:1.0:1783071637.023866:0:17101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071637.029418:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707696768 00000100:00100000:2.0:1783071637.029436:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707696768 00000100:00100000:1.0:1783071637.029437:0:17101:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0324fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1783071637.029477:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707696896 00000100:00100000:2.0:1783071637.029481:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707696896 00000100:00100000:2.0:1783071637.029499:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783071637.029506:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03af1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5ed14122-6273-4ec6-b260-6e79c239c375+4:17101:x1869685707696768:12345-0@lo:104: 00010000:00010000:2.0:1783071637.029521:0:17069:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67800/0x6b58994c2cbdd3b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdd3bf expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071637.029743:0:17069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783071637.029750:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03af1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5ed14122-6273-4ec6-b260-6e79c239c375+4:17101:x1869685707696768:12345-0@lo:104: Request processed in 244us (6757us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071637.029757:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783071637.029774:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783071637.029949:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03af1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5ed14122-6273-4ec6-b260-6e79c239c375+3:17101:x1869685707696896:12345-0@lo:104: 00010000:00010000:2.0:1783071637.029960:0:17069:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67600/0x6b58994c2cbdd3aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdd3b1 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071637.029997:0:17069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783071637.030002:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03af1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5ed14122-6273-4ec6-b260-6e79c239c375+3:17101:x1869685707696896:12345-0@lo:104: Request processed in 223us (6135us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071637.030008:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1783071637.030028:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783071637.030031:0:17074:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783071637.030034:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67800/0x6b58994c2cbdd3b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdd3bf expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071637.030043:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd67800 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:1.0:1783071637.030048:0:17075:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67800/0x6b58994c2cbdd3b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6b58994c2cbdd3bf expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071637.030058:0:17075:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67800/0x6b58994c2cbdd3b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6b58994c2cbdd3bf expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783071637.030066:0:17075:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67800/0x6b58994c2cbdd3b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6b58994c2cbdd3bf expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783071637.030072:0:17075:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783071637.030124:0:17075:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67800/0x6b58994c2cbdd3b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdd3bf expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071637.030131:0:17075:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783071637.030152:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67800/0x6b58994c2cbdd3b8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdd3bf expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071637.030159:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67800/0x6b58994c2cbdd3b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdd3bf expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071637.030171:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071637.030173:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071637.030174:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071637.030197:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03af3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ed14122-6273-4ec6-b260-6e79c239c375:3645:1869685707697024:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783071637.030238:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071637.030289:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707697024 00000100:00100000:2.0:1783071637.030294:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707697024 00010000:00010000:2.0:1783071637.030315:0:17073:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8b2fd66800/0x6b58994c2cbdd3bf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdd3b8 expref: 24 pid: 17079 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071637.030337:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783071637.030344:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03af3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ed14122-6273-4ec6-b260-6e79c239c375+24:3645:x1869685707697024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783071637.030355:0:17073:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071637.030360:0:17073:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8b2fd66800/0x6b58994c2cbdd3bf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdd3b8 expref: 24 pid: 17079 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071637.030386:0:17073:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8b2fd66800/0x6b58994c2cbdd3bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6b58994c2cbdd3b8 expref: 24 pid: 17079 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071637.030393:0:17101:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03af1180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17101:1869685707696768:0@lo:104: 00010000:00010000:2.0:1783071637.030400:0:17073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b2fd66800/0x6b58994c2cbdd3bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6b58994c2cbdd3b8 expref: 24 pid: 17079 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071637.030402:0:17101:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03af3b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17101:1869685707696896:0@lo:104: 00010000:00010000:2.0:1783071637.030413:0:17073:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783071637.030424:0:17101:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f8a03bd7800/0x6b58994c2cbdd43d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071637.030440:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03af3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ed14122-6273-4ec6-b260-6e79c239c375+23:3645:x1869685707697024:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071637.030446:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03af3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ed14122-6273-4ec6-b260-6e79c239c375:3645:1869685707697024:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783071637.030447:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1783071637.032783:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071637.032796:0:17074:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67600/0x6b58994c2cbdd3aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdd3b1 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071637.032807:0:17074:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd67600 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:1.0:1783071637.032812:0:17074:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67600/0x6b58994c2cbdd3aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6b58994c2cbdd3b1 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071637.032835:0:17074:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67600/0x6b58994c2cbdd3aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6b58994c2cbdd3b1 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783071637.032842:0:17074:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67600/0x6b58994c2cbdd3aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6b58994c2cbdd3b1 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783071637.032848:0:17074:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783071637.032891:0:17074:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67600/0x6b58994c2cbdd3aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdd3b1 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071637.032899:0:17074:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783071637.032917:0:17074:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67600/0x6b58994c2cbdd3aa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdd3b1 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071637.032925:0:17074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8b2fd67600/0x6b58994c2cbdd3aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdd3b1 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071637.032940:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071637.032942:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071637.032944:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071637.032962:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03af3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ed14122-6273-4ec6-b260-6e79c239c375:3646:1869685707697152:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783071637.033043:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071637.033115:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707697152 00000100:00100000:1.0:1783071637.033123:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707697152 00010000:00010000:1.0:1783071637.033150:0:17072:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8a03864200/0x6b58994c2cbdd3b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdd3aa expref: 23 pid: 17078 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071637.033187:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783071637.033206:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03af3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ed14122-6273-4ec6-b260-6e79c239c375+23:3646:x1869685707697152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783071637.033230:0:17072:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071637.033235:0:17072:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8a03864200/0x6b58994c2cbdd3b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdd3aa expref: 23 pid: 17078 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071637.033248:0:17072:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8a03864200/0x6b58994c2cbdd3b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6b58994c2cbdd3aa expref: 23 pid: 17078 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071637.033536:0:17072:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8a03864200/0x6b58994c2cbdd3b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6b58994c2cbdd3aa expref: 23 pid: 17078 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071637.033556:0:17072:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f8a03bd7800/0x6b58994c2cbdd43d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071637.033566:0:17072:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8a03bd7800/0x6b58994c2cbdd43d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783071637.033583:0:17072:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010815820s 00010000:00010000:1.0:1783071637.033589:0:17072:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f8a03bd7800/0x6b58994c2cbdd43d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071637.033598:0:17072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f8a03bd7800/0x6b58994c2cbdd43d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071637.033605:0:17072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f8a03bd7800/0x6b58994c2cbdd43d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071637.033612:0:17072:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f8a03bd7800/0x6b58994c2cbdd43d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071637.033618:0:17072:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03bd7800 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:1.0:1783071637.033895:0:17072:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f8a03bd7800/0x6b58994c2cbdd43d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071637.033910:0:17072:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f8a03bd7800/0x6b58994c2cbdd43d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071637.033935:0:17072:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f8a03bd7800/0x6b58994c2cbdd43d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071637.033947:0:17072:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071637.034059:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03af3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ed14122-6273-4ec6-b260-6e79c239c375+22:3646:x1869685707697152:12345-0@lo:103:ldlm_bl.0 Request processed in 852us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071637.034069:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783071637.034132:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03af3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ed14122-6273-4ec6-b260-6e79c239c375:3646:1869685707697152:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783071637.034162:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071637.034165:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071637.034254:0:17101:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f8a03bd7800/0x6b58994c2cbdd43d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071637.034264:0:17101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f8a03bd7800/0x6b58994c2cbdd43d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071637.034345:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8a03bd7800/0x6b58994c2cbdd43d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:1.0:1783071637.036463:0:19405:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1783071637.040876:0:19405:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1783071637.040887:0:19405:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1783071637.040933:0:19405:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1783071637.040983:0:19405:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.138@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1783071637.041059:0:19405:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1783071637.041079:0:19405:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1783071637.043323:0:19405:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783071637.047531:0:19405:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783071637.442679:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1783071637.770784:0:19472:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783071637.771031:0:19472:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783071638.467976:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1783071638.533226:0:17083:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783071638.533235:0:17083:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8f8b10f78000 from 10 10000000:01000000:0.0:1783071638.533241:0:17083:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783071638.533315:0:17083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8a03864800/0x6b58994c2cbdd444 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071638.533329:0:17083:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8a03864800/0x6b58994c2cbdd444 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071638.533340:0:17083:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8a03864800/0x6b58994c2cbdd444 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071638.533383:0:17083:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01765500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ed14122-6273-4ec6-b260-6e79c239c375:17083:1869685707697280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783071638.533457:0:17083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071638.533508:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707697280 00000100:00100000:0.0:1783071638.533513:0:17083:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0394f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783071638.533518:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707697280 00000100:00100000:1.0:1783071638.533583:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1783071638.533594:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+22:17083:x1869685707697280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783071638.533612:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071638.533628:0:17079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8a03bd7e00/0x6b58994c2cbdd44b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdd444 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071638.533664:0:17079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8a03bd7e00/0x6b58994c2cbdd44b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdd444 expref: 23 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071638.533677:0:17079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8a03bd7e00/0x6b58994c2cbdd44b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdd444 expref: 23 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071638.533686:0:17079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a03bd7e00, rc 0) 00000100:00100000:1.0:1783071638.533738:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+23:17083:x1869685707697280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071638.533745:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1783071638.534485:0:17083:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01765500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ed14122-6273-4ec6-b260-6e79c239c375:17083:1869685707697280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783071638.534505:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8a03864800/0x6b58994c2cbdd444 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd44b expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071638.534524:0:17083:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8a03864800/0x6b58994c2cbdd444 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdd44b expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071638.534601:0:17083:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01765500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ed14122-6273-4ec6-b260-6e79c239c375:17083:1869685707697408:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1783071638.534651:0:17083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071638.534689:0:17083:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0394f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783071638.535267:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707697408 00000100:00100000:1.0:1783071638.535274:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707697408 00000100:00100000:1.0:1783071638.535326:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1783071638.535335:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+23:17083:x1869685707697408:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1783071638.535357:0:17081:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1783071638.535402:0:17081:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783071638.535406:0:17081:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1783071638.535500:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+23:17083:x1869685707697408:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 166us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071638.535506:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1783071638.535656:0:17083:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01765500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ed14122-6273-4ec6-b260-6e79c239c375:17083:1869685707697408:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1783071638.535723:0:17083:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783071638.535731:0:17083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8a03864800/0x6b58994c2cbdd444 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd44b expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071638.535741:0:17083:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8a03864800/0x6b58994c2cbdd444 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd44b expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783071638.535750:0:17083:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783071638.535752:0:17083:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8f8a041ea000 from 10 10000000:01000000:0.0:1783071638.535754:0:17083:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783071638.535779:0:17083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8a03864000/0x6b58994c2cbdd452 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071638.535788:0:17083:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8a03864000/0x6b58994c2cbdd452 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071638.535796:0:17083:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8a03864000/0x6b58994c2cbdd452 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071638.535811:0:17083:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01765500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ed14122-6273-4ec6-b260-6e79c239c375:17083:1869685707697536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783071638.535851:0:17083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071638.536230:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707697536 00000100:00100000:1.0:1783071638.536235:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707697536 00000100:00100000:1.0:1783071638.536273:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1783071638.536280:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+23:17083:x1869685707697536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783071638.536291:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071638.536304:0:17079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8a03bd6600/0x6b58994c2cbdd459 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdd452 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071638.536338:0:17079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8a03bd6600/0x6b58994c2cbdd459 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdd452 expref: 24 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071638.536349:0:17079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8a03bd6600/0x6b58994c2cbdd459 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdd452 expref: 24 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071638.536359:0:17079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a03bd6600, rc 0) 00000100:00100000:1.0:1783071638.536417:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+24:17083:x1869685707697536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071638.536423:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1783071638.536691:0:17083:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0394f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783071638.536710:0:17083:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01765500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ed14122-6273-4ec6-b260-6e79c239c375:17083:1869685707697536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783071638.536723:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8a03864000/0x6b58994c2cbdd452 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd459 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071638.536732:0:17083:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8a03864000/0x6b58994c2cbdd452 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdd459 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071638.536786:0:17083:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01765500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ed14122-6273-4ec6-b260-6e79c239c375:17083:1869685707697664:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1783071638.536815:0:17083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071638.536845:0:17083:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0394f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783071638.536962:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707697664 00000100:00100000:1.0:1783071638.536967:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707697664 00000100:00100000:1.0:1783071638.536997:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1783071638.537005:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+24:17083:x1869685707697664:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1783071638.537018:0:17081:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1783071638.537034:0:17081:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783071638.537037:0:17081:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1783071638.537706:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+24:17083:x1869685707697664:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 699us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071638.537715:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1783071638.537924:0:17083:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01765500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ed14122-6273-4ec6-b260-6e79c239c375:17083:1869685707697664:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1783071638.537994:0:17083:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783071638.538003:0:17083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8a03864000/0x6b58994c2cbdd452 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd459 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071638.538013:0:17083:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8a03864000/0x6b58994c2cbdd452 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd459 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783071638.916038:0:17119:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1783071639.494346:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071640.388875:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783071640.390625:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707697792:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783071640.390705:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071640.390758:0:18594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707697792 00000100:00100000:0.0:1783071640.390768:0:18594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707697792 00000100:00100000:0.0:1783071640.390835:0:18594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783071640.390845:0:18594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707697792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783071640.390876:0:18594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00080000:1.0:1783071640.390923:0:17082:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783071640.396265:0:18594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707697792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 5410us (5548us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071640.396281:0:18594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1783071640.396871:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a01767480 x1869685707697792/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071656 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071640.396900:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707697792:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1783071640.517618:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071640.898716:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03bd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707697920:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783071640.898798:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071640.898868:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707698048:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783071640.898897:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071640.898955:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707697920 00000100:00100000:1.0:1783071640.898964:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707697920 00000100:00100000:1.0:1783071640.899011:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707698048 00000100:00100000:1.0:1783071640.899014:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707698048 00000100:00100000:1.0:1783071640.899033:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783071640.899041:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03af3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707697920:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783071640.899042:0:17825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783071640.899051:0:17825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03af1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707698048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783071640.899080:0:17825:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000004:00000024:1.0:1783071640.899080:0:17090:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1783071640.899136:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03af3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707697920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071640.899137:0:17825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03af1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707698048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071640.899144:0:17825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783071640.899148:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783071640.899268:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707698048:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783071640.899305:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03bd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707697920:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783071641.092161:0:3644:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783071621/real 1783071621] req@ffff8f8a02e40700 x1869685707683840/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783071641 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071641.092208:0:3644:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f8a02e40700 x1869685707683840/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783071641 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071641.092219:0:3644:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783071621/real 1783071621] req@ffff8f8a02e42d80 x1869685707683968/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783071641 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071641.092231:0:3644:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f8a02e42d80 x1869685707683968/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783071641 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783071641.092253:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8f8a02c74000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783071641.092272:0:3644:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1783071641.092277:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02e40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869685707683840:0@lo:8:kworker.0 00000100:00080000:1.0:1783071641.092283:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8f8a01e3f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783071641.092288:0:3644:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1783071641.092304:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02e42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869685707683968:0@lo:8:kworker.0 00000100:00080000:2.0:1783071641.093452:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783071641.093458:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1783071641.093463:0:8:0:(import.c:65:import_set_state_nolock()) ffff8f8a02c74000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783071641.093469:0:8:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 523 00000100:00080000:2.0:1783071641.093474:0:8:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1783071641.093481:0:8:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8f8a02c74000 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:2.0:1783071641.093503:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8a03a9ea00 x1869685707698304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783071641.093518:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783071641.093521:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1783071641.093523:0:8:0:(import.c:65:import_set_state_nolock()) ffff8f8a01e3f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783071641.093526:0:8:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 523 00000100:00080000:2.0:1783071641.093529:0:8:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1783071641.093533:0:8:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8f8a01e3f800 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:2.0:1783071641.093546:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8a03a9ca80 x1869685707698432/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783071641.093571:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783071641.093575:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1783071641.093654:0:8:0:(import.c:65:import_set_state_nolock()) ffff8f8b3b4b0800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783071641.093659:0:8:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8f8b3b4b0800 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:2.0:1783071641.093672:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8b078daa00 x1869685707698688/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783071641.093733:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b078da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1869685707698944:0@lo:400:kworker.0 00000100:00100000:2.0:1783071641.093808:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071641.093846:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1783071641.093852:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ed14122-6273-4ec6-b260-6e79c239c375:3645:1869685707698176:0@lo:400:kworker.0 00000100:00100000:2.0:1783071641.093880:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071641.093907:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b078d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1869685707699072:0@lo:400:kworker.0 00000100:00100000:2.0:1783071641.093930:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071641.093956:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a032e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869685707698560:0@lo:400:kworker.0 00000100:00100000:2.0:1783071641.093976:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071641.093994:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b078db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1869685707699200:0@lo:400:kworker.0 00000100:00100000:2.0:1783071641.094014:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071641.094032:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1783071641.094037:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b078d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869685707698816:0@lo:400:kworker.0 00000100:00100000:2.0:1783071641.094056:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071641.094071:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b078d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1869685707699328:0@lo:400:kworker.0 00000100:00100000:2.0:1783071641.094091:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071641.094126:0:19285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707698944 00000100:00100000:2.0:1783071641.094133:0:19285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707698944 00000100:00100000:2.0:1783071641.094184:0:19285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707699072 00000100:00100000:2.0:1783071641.094187:0:19285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707699072 00000100:00100000:1.0:1783071641.094728:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869685707698304:0@lo:8:kworker.0 00000100:00100000:1.0:1783071641.094765:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071641.094794:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869685707698432:0@lo:8:kworker.0 00000100:00100000:1.0:1783071641.094813:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071641.094829:0:3644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b078daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1869685707698688:0@lo:8:kworker.0 00000100:00100000:1.0:1783071641.094846:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071641.094873:0:18592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707698304 00000100:00100000:1.0:1783071641.094877:0:18592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707698304 00000100:00100000:1.0:1783071641.094898:0:18592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707698432 00000100:00100000:1.0:1783071641.094900:0:18592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707698432 00000100:00100000:1.0:1783071641.094908:0:18592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707698688 00000100:00100000:1.0:1783071641.094910:0:18592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707698688 00000100:00100000:1.0:1783071641.094919:0:18592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783071641.094926:0:18592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03af0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3644:x1869685707698304:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1783071641.094953:0:18592:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 542 last 0 00000020:00000080:1.0:1783071641.094981:0:18592:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6b58994c2cbdd460 00002000:00100000:1.0:1783071641.094994:0:18592:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8f8a02ef5000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1783071641.094998:0:18592:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1783071641.095000:0:18592:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1783071641.095076:0:18592:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1783071641.095098:0:18592:0:(import.c:65:import_set_state_nolock()) ffff8f8a02ef0000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783071641.095155:0:18592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03af0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1869685707698304:12345-0@lo:8:kworker.0 Request processed in 228us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071641.095163:0:18592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783071641.095181:0:18592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783071641.095185:0:18592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03af1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3644:x1869685707698432:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1783071641.095321:0:17085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707698560 00000100:00100000:3.0:1783071641.095326:0:17085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707698560 00000100:00100000:3.0:1783071641.095347:0:17085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707699200 00000100:00100000:3.0:1783071641.095349:0:17085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707699200 00000100:00100000:3.0:1783071641.095388:0:17085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707698816 00000100:00100000:3.0:1783071641.095391:0:17085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707698816 00000100:00100000:3.0:1783071641.095403:0:17085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707699328 00000100:00100000:3.0:1783071641.095415:0:17085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707699328 00000100:00100000:3.0:1783071641.095433:0:17085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783071641.095440:0:17085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b078d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1869685707698944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071641.095481:0:17085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b078d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1869685707698944:12345-0@lo:400:kworker.0 Request processed in 42us (1673us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071641.095488:0:17085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783071641.095500:0:17085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783071641.095505:0:17085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b078db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869685707698560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071641.095538:0:17085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b078db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869685707698560:12345-0@lo:400:kworker.0 Request processed in 32us (1559us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071641.095543:0:17085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783071641.095554:0:17085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783071641.095559:0:17085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b078d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869685707699200:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1783071641.095761:0:18592:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 542 last 0 00000020:00000080:1.0:1783071641.095778:0:18592:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6b58994c2cbdd467 00002000:00100000:1.0:1783071641.095785:0:18592:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8f8a02ef2800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1783071641.095789:0:18592:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1783071641.095792:0:18592:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1783071641.095935:0:18592:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1783071641.095950:0:18592:0:(import.c:65:import_set_state_nolock()) ffff8f8a02ef4800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783071641.095983:0:18592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03af1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1869685707698432:12345-0@lo:8:kworker.0 Request processed in 796us (1168us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071641.095989:0:18592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783071641.096002:0:18592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783071641.096006:0:18592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03af0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3644:x1869685707698688:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1783071641.096019:0:18592:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 542 last 0 00000020:00000080:1.0:1783071641.096034:0:18592:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x6b58994c2cbdd46e 00002000:00100000:1.0:1783071641.096039:0:18592:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8f8a02ef3800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1783071641.096042:0:18592:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:1.0:1783071641.096043:0:18592:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1783071641.096061:0:18592:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1783071641.096088:0:18592:0:(import.c:65:import_set_state_nolock()) ffff8f8a02dd7800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783071641.096129:0:18592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03af0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3644:x1869685707698688:12345-0@lo:8:kworker.0 Request processed in 120us (1281us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071641.096135:0:18592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1783071641.096186:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a03a9ea00 x1869685707698304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783071666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071641.096807:0:19285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783071641.096816:0:19285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b078d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869685707698816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071641.096871:0:19285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b078d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869685707698816:12345-0@lo:400:kworker.0 Request processed in 57us (2814us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071641.096878:0:19285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783071641.096891:0:19285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783071641.096898:0:19285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b078dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869685707699328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071641.096925:0:19285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b078dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869685707699328:12345-0@lo:400:kworker.0 Request processed in 28us (2833us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071641.096931:0:19285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783071641.096941:0:19285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783071641.096946:0:19285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b078d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1869685707699072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071641.096972:0:19285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b078d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1869685707699072:12345-0@lo:400:kworker.0 Request processed in 25us (3041us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071641.096977:0:19285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1783071641.097003:0:17082:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783071641.097006:0:17082:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1783071641.097031:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b078d9180 x1869685707698816/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071657 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071641.097045:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b078d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869685707698816:0@lo:400:kworker.0 00010000:00080000:2.0:1783071641.097059:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b078d9c00 x1869685707699328/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071657 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071641.097068:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b078d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1869685707699328:0@lo:400:kworker.0 00010000:00080000:2.0:1783071641.097079:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a032e7100 x1869685707698560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071657 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071641.097087:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a032e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869685707698560:0@lo:400:kworker.0 00010000:00080000:2.0:1783071641.097142:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b078d8a80 x1869685707699072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071657 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071641.097152:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b078d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1869685707699072:0@lo:400:kworker.0 00010000:00080000:2.0:1783071641.097163:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b078da300 x1869685707698944/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071657 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071641.097170:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b078da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1869685707698944:0@lo:400:kworker.0 00000100:00100000:3.0:1783071641.097317:0:17085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b078d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869685707699200:12345-0@lo:400:kworker.0 Request processed in 1755us (3298us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071641.097324:0:17085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783071641.097351:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707698176 00000100:00100000:3.0:1783071641.097356:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707698176 00000100:00100000:3.0:1783071641.097401:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1783071641.097406:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+24:3645:x1869685707698176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071641.097436:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+24:3645:x1869685707698176:12345-0@lo:400:kworker.0 Request processed in 30us (3556us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071641.097442:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00010000:00080000:2.0:1783071641.098556:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b078db100 x1869685707699200/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071657 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071641.098571:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b078db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1869685707699200:0@lo:400:kworker.0 00000100:00100000:2.0:1783071641.098621:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ed14122-6273-4ec6-b260-6e79c239c375:3645:1869685707698176:0@lo:400:kworker.0 00000100:00100000:1.0:1783071641.098714:0:3644:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783071641.098734:0:3644:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1783071641.098742:0:3644:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1783071641.098749:0:3644:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1783071641.098752:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8f8a02c74000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1783071641.098768:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1783071641.098774:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869685707698304:0@lo:8:kworker.0 00010000:00080000:1.0:1783071641.098791:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a03a9ca80 x1869685707698432/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783071666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071641.098799:0:3644:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783071641.098802:0:3644:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1783071641.098806:0:3644:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1783071641.098808:0:3644:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1783071641.098810:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8f8a01e3f800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1783071641.098828:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1783071641.098831:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1869685707698432:0@lo:8:kworker.0 00010000:00080000:1.0:1783071641.098844:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b078daa00 x1869685707698688/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783071666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783071641.098852:0:3644:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1783071641.098856:0:3644:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1783071641.098859:0:3644:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1783071641.098861:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8f8b3b4b0800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1783071641.098870:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1783071641.098873:0:3644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b078daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1869685707698688:0@lo:8:kworker.0 00000004:00080000:1.0:1783071641.098931:0:17110:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:1.0:1783071641.098950:0:17110:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03af2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17110:1869685707699584:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1783071641.099006:0:17110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071641.099029:0:17110:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0394f900 going to sleep for 11 seconds 00000004:00080000:1.0:1783071641.099048:0:17109:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1783071641.099155:0:17109:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 542887790717ns, next at 0ns, rc = 0 00080000:00080000:1.0:1783071641.099162:0:17109:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1783071641.099380:0:17829:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1783071641.099398:0:17829:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b078da300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17829:1869685707699840:0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1783071641.099424:0:17829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071641.099445:0:17829:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b076d7cc0 going to sleep for 11 seconds 00000004:00080000:0.0:1783071641.099662:0:17111:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1783071641.099713:0:17111:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 542888348237ns, next at 0ns, rc = 0 00080000:00080000:0.0:1783071641.099718:0:17111:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1783071641.099730:0:17828:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1783071641.099768:0:17828:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 542888403310ns, next at 0ns, rc = 0 00080000:00080000:0.0:1783071641.099773:0:17828:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1783071641.100562:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b078db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707699712:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783071641.100620:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071641.100648:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783071641.100662:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03af2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707699456:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783071641.100684:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071641.100721:0:18593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707699712 00000100:00100000:3.0:1783071641.100727:0:18593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707699712 00000100:00100000:3.0:1783071641.100770:0:18593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707699456 00000100:00100000:3.0:1783071641.100773:0:18593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707699456 00000100:00100000:3.0:1783071641.100791:0:18593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783071641.100798:0:18593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03bd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1869685707699712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783071641.100827:0:18593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1783071641.100885:0:18593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03bd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1869685707699712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071641.100892:0:18593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783071641.100909:0:18593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783071641.100915:0:18593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1869685707699456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783071641.100925:0:18593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1783071641.100950:0:18593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1869685707699456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 34us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071641.100955:0:18593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1783071641.101064:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a03af2d80 x1869685707699456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071657 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071641.101084:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03af2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707699456:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1783071641.101095:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b078db100 x1869685707699712/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071657 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071641.101106:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b078db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707699712:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783071641.101145:0:18592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707699584 00000100:00100000:3.0:1783071641.101155:0:18592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707699584 00000100:00100000:3.0:1783071641.101181:0:18592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707699840 00000100:00100000:3.0:1783071641.101184:0:18592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707699840 00000100:00100000:3.0:1783071641.101201:0:18592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783071641.101207:0:18592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03af0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17110:x1869685707699584:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:3.0:1783071641.101469:0:17082:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783071641.101473:0:17082:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783071641.101747:0:19286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783071641.101757:0:19286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b078d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17829:x1869685707699840:12345-0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1783071641.101992:0:17112:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:1.0:1783071641.102014:0:17112:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02e40700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17112:1869685707700096:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1783071641.102061:0:17112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071641.102082:0:17112:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0394f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783071641.102097:0:18591:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1783071641.102103:0:18591:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1783071641.102248:0:18591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707700096 00000100:00100000:1.0:1783071641.102253:0:18591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707700096 00000100:00080000:1.0:1783071641.102286:0:17082:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783071641.102351:0:19700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783071641.102358:0:19700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c78dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:17112:x1869685707700096:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1783071641.102492:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02e42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707699968:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783071641.102528:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071641.106014:0:18593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707699968 00000100:00100000:1.0:1783071641.106025:0:18593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707699968 00000100:00100000:1.0:1783071641.106076:0:18593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783071641.106086:0:18593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b078d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1869685707699968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783071641.106111:0:18593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1783071641.106201:0:18593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b078d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1869685707699968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (3672us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071641.106209:0:18593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1783071641.108103:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a02e42d80 x1869685707699968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071657 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071641.108148:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02e42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707699968:0@lo:13:osp-pre-1-0.0 00000004:00080000:2.0:1783071641.108237:0:17817:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000004:00080000:2.0:1783071641.108299:0:17066:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:3.0:1783071641.108861:0:18592:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1783071641.108870:0:18592:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1783071641.108876:0:18592:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00002000:00080000:1.0:1783071641.114244:0:19286:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1783071641.114257:0:19286:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1783071641.114358:0:19286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b078d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17829:x1869685707699840:12345-0@lo:7:osp-pre-1-1.0 Request processed in 12599us (14928us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071641.114408:0:19286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1783071641.115728:0:17829:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b078da300 x1869685707699840/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783071657 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071641.115744:0:17829:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b078da300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17829:1869685707699840:0@lo:7:osp-pre-1-1.0 00000004:00080000:2.0:1783071641.115757:0:17829:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1783071641.115797:0:17829:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b078da300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17829:1869685707700224:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1783071641.115840:0:17829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071641.115862:0:17829:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b076d7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783071641.116152:0:18591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707700224 00000100:00100000:1.0:1783071641.116159:0:18591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707700224 00000100:00100000:1.0:1783071641.116281:0:18591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783071641.116291:0:18591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b078d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17829:x1869685707700224:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1783071641.116320:0:18591:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:1.0:1783071641.116359:0:18591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b078d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17829:x1869685707700224:12345-0@lo:5:osp-pre-1-1.0 Request processed in 70us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071641.116382:0:18591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00002000:00010000:3.0:1783071641.122377:0:18592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783071641.122394:0:18592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e283ef91/0x6b58994c2cbdd475 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.122412:0:18592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=542s v=(0 0) 00010000:00010000:3.0:1783071641.122416:0:18592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783071641.122423:0:18592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e283ef91/0x6b58994c2cbdd475 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.122443:0:18592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e283ef91/0x6b58994c2cbdd475 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.122453:0:18592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e283ef91/0x6b58994c2cbdd475 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.122461:0:18592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e283ef91/0x6b58994c2cbdd475 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.122504:0:18592:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1783071641.125831:0:17066:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:1.0:1783071641.126708:0:17074:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783071641.126720:0:17074:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e283ef91/0x6b58994c2cbdd475 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.126734:0:17074:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01748c00 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:1.0:1783071641.126739:0:17074:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e283ef91/0x6b58994c2cbdd475 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.126749:0:17074:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e283ef91/0x6b58994c2cbdd475 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.126774:0:17074:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e283ef91/0x6b58994c2cbdd475 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.126780:0:17074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e283ef91/0x6b58994c2cbdd475 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.126817:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071641.126818:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071641.126820:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:1.0:1783071641.126871:0:17829:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b078da300 x1869685707700224/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783071657 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071641.126885:0:17829:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b078da300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17829:1869685707700224:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1783071641.126900:0:17829:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1783071641.126959:0:17829:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17829:1869685707700352:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1783071641.127020:0:17829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071641.127058:0:17829:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b2fc82f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783071641.127219:0:19286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707700352 00000100:00100000:0.0:1783071641.127233:0:19286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707700352 00000100:00100000:0.0:1783071641.127290:0:19286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783071641.127301:0:19286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c78f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17829:x1869685707700352:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1783071641.127343:0:19286:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00010000:1.0:1783071641.129551:0:18592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783071641.129565:0:18592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5bbedce/0x6b58994c2cbdd47c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.129590:0:18592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=542s v=(0 0) 00010000:00010000:1.0:1783071641.129595:0:18592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783071641.129601:0:18592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5bbedce/0x6b58994c2cbdd47c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.129616:0:18592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5bbedce/0x6b58994c2cbdd47c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.129627:0:18592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5bbedce/0x6b58994c2cbdd47c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.129649:0:18592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d5bbedce/0x6b58994c2cbdd47c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.129678:0:18592:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783071641.129913:0:19422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783071641.129919:0:19422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d5bbedce/0x6b58994c2cbdd47c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.129928:0:19422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03bd6e00 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:3.0:1783071641.129932:0:19422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5bbedce/0x6b58994c2cbdd47c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.129941:0:19422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5bbedce/0x6b58994c2cbdd47c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.129958:0:19422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d5bbedce/0x6b58994c2cbdd47c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.129965:0:19422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5bbedce/0x6b58994c2cbdd47c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.129983:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071641.129984:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071641.129986:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1783071641.130235:0:19700:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1783071641.130243:0:19700:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1783071641.130248:0:19700:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00002000:00010000:1.0:1783071641.134972:0:18592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783071641.134987:0:18592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e74ff39/0x6b58994c2cbdd483 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.135008:0:18592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=542s v=(0 0) 00010000:00010000:1.0:1783071641.135013:0:18592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783071641.135021:0:18592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e74ff39/0x6b58994c2cbdd483 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.135036:0:18592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e74ff39/0x6b58994c2cbdd483 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.135047:0:18592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e74ff39/0x6b58994c2cbdd483 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.135055:0:18592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e74ff39/0x6b58994c2cbdd483 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.135076:0:18592:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783071641.136516:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783071641.136525:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e74ff39/0x6b58994c2cbdd483 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.136543:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03bd6400 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:1.0:1783071641.136547:0:17075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e74ff39/0x6b58994c2cbdd483 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.136559:0:17075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e74ff39/0x6b58994c2cbdd483 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.136635:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e74ff39/0x6b58994c2cbdd483 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.136644:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e74ff39/0x6b58994c2cbdd483 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.136665:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071641.136667:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071641.136669:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783071641.140811:0:19700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783071641.140822:0:19700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049e80cbc/0x6b58994c2cbdd48a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.140841:0:19700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=542s v=(0 0) 00010000:00010000:0.0:1783071641.140846:0:19700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071641.140852:0:19700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049e80cbc/0x6b58994c2cbdd48a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.140869:0:19700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049e80cbc/0x6b58994c2cbdd48a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.140879:0:19700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049e80cbc/0x6b58994c2cbdd48a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.140888:0:19700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000049e80cbc/0x6b58994c2cbdd48a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.140912:0:19700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783071641.141846:0:17074:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783071641.141856:0:17074:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049e80cbc/0x6b58994c2cbdd48a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.141867:0:17074:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03865a00 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:1.0:1783071641.141871:0:17074:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049e80cbc/0x6b58994c2cbdd48a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.141882:0:17074:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049e80cbc/0x6b58994c2cbdd48a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.141911:0:17074:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049e80cbc/0x6b58994c2cbdd48a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.141919:0:17074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049e80cbc/0x6b58994c2cbdd48a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.141938:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071641.141940:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071641.141942:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783071641.144016:0:18592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783071641.144032:0:18592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005dedf76/0x6b58994c2cbdd491 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.144051:0:18592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=542s v=(0 0) 00010000:00010000:3.0:1783071641.144062:0:18592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783071641.144069:0:18592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005dedf76/0x6b58994c2cbdd491 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.144085:0:18592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005dedf76/0x6b58994c2cbdd491 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.144096:0:18592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005dedf76/0x6b58994c2cbdd491 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.144104:0:18592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005dedf76/0x6b58994c2cbdd491 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.144142:0:18592:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783071641.144359:0:19700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783071641.144388:0:19700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da4cf9e8/0x6b58994c2cbdd498 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.144396:0:19700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=542s v=(0 0) 00010000:00010000:0.0:1783071641.144400:0:19700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071641.144404:0:19700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da4cf9e8/0x6b58994c2cbdd498 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.144414:0:19700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da4cf9e8/0x6b58994c2cbdd498 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.144423:0:19700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da4cf9e8/0x6b58994c2cbdd498 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.144430:0:19700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000da4cf9e8/0x6b58994c2cbdd498 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.144447:0:19700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783071641.145295:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783071641.145304:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005dedf76/0x6b58994c2cbdd491 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.145316:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01748400 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:1.0:1783071641.145321:0:17075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005dedf76/0x6b58994c2cbdd491 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.145331:0:17075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005dedf76/0x6b58994c2cbdd491 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.145349:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005dedf76/0x6b58994c2cbdd491 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.145357:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005dedf76/0x6b58994c2cbdd491 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.145412:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783071641.145417:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000da4cf9e8/0x6b58994c2cbdd498 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.145424:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03864200 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:1.0:1783071641.145428:0:17075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000da4cf9e8/0x6b58994c2cbdd498 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.145436:0:17075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000da4cf9e8/0x6b58994c2cbdd498 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.145448:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000da4cf9e8/0x6b58994c2cbdd498 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.145455:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da4cf9e8/0x6b58994c2cbdd498 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.145469:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071641.145470:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071641.145472:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071641.145676:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783071641.146223:0:18592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783071641.146233:0:18592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070fd10ee/0x6b58994c2cbdd49f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.146246:0:18592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=542s v=(0 0) 00010000:00010000:3.0:1783071641.146250:0:18592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783071641.146256:0:18592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070fd10ee/0x6b58994c2cbdd49f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.146764:0:18592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070fd10ee/0x6b58994c2cbdd49f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.146775:0:18592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070fd10ee/0x6b58994c2cbdd49f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.147414:0:18592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000070fd10ee/0x6b58994c2cbdd49f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.147440:0:18592:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783071641.148266:0:19700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783071641.148276:0:19700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a19eddc3/0x6b58994c2cbdd4a6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.148288:0:19700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=542s v=(0 0) 00010000:00010000:0.0:1783071641.148293:0:19700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071641.148299:0:19700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a19eddc3/0x6b58994c2cbdd4a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.148312:0:19700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a19eddc3/0x6b58994c2cbdd4a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.148327:0:19700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a19eddc3/0x6b58994c2cbdd4a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.148334:0:19700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a19eddc3/0x6b58994c2cbdd4a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.148352:0:19700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783071641.148587:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783071641.148595:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000070fd10ee/0x6b58994c2cbdd49f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.148604:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01749000 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:1.0:1783071641.148615:0:17075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000070fd10ee/0x6b58994c2cbdd49f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.148625:0:17075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000070fd10ee/0x6b58994c2cbdd49f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.148645:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000070fd10ee/0x6b58994c2cbdd49f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.148653:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070fd10ee/0x6b58994c2cbdd49f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.148677:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783071641.148681:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a19eddc3/0x6b58994c2cbdd4a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.148687:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03864a00 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:1.0:1783071641.148691:0:17075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a19eddc3/0x6b58994c2cbdd4a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.148698:0:17075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a19eddc3/0x6b58994c2cbdd4a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.148710:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a19eddc3/0x6b58994c2cbdd4a6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.148716:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a19eddc3/0x6b58994c2cbdd4a6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.148734:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071641.148736:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071641.148738:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783071641.148829:0:18592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783071641.148834:0:18592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008774de30/0x6b58994c2cbdd4ad lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.148843:0:18592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=542s v=(0 0) 00010000:00010000:3.0:1783071641.148846:0:18592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783071641.148851:0:18592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008774de30/0x6b58994c2cbdd4ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.148861:0:18592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008774de30/0x6b58994c2cbdd4ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.148868:0:18592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008774de30/0x6b58994c2cbdd4ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.148875:0:18592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008774de30/0x6b58994c2cbdd4ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.148896:0:18592:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783071641.149000:0:17074:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783071641.149005:0:17074:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008774de30/0x6b58994c2cbdd4ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.149017:0:17074:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01749600 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:3.0:1783071641.149021:0:17074:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008774de30/0x6b58994c2cbdd4ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.149029:0:17074:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008774de30/0x6b58994c2cbdd4ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.149041:0:17074:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008774de30/0x6b58994c2cbdd4ad lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.149047:0:17074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008774de30/0x6b58994c2cbdd4ad lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.149060:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071641.149062:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071641.149064:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783071641.149447:0:18592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783071641.149456:0:18592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e283ef91/0x6b58994c2cbdd4b4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.149466:0:18592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=542s v=(0 0) 00010000:00010000:3.0:1783071641.149469:0:18592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783071641.149473:0:18592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e283ef91/0x6b58994c2cbdd4b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.149483:0:18592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e283ef91/0x6b58994c2cbdd4b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.149500:0:18592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e283ef91/0x6b58994c2cbdd4b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.149507:0:18592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e283ef91/0x6b58994c2cbdd4b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.149524:0:18592:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783071641.149779:0:19422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783071641.149786:0:19422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e283ef91/0x6b58994c2cbdd4b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.149794:0:19422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01748c00 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:0.0:1783071641.149797:0:19422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e283ef91/0x6b58994c2cbdd4b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.149806:0:19422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e283ef91/0x6b58994c2cbdd4b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.149820:0:19422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e283ef91/0x6b58994c2cbdd4b4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.149828:0:19422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e283ef91/0x6b58994c2cbdd4b4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.149845:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071641.149852:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071641.149854:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783071641.149901:0:19700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783071641.149907:0:19700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de0adcb9/0x6b58994c2cbdd4bb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.149915:0:19700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=542s v=(0 0) 00010000:00010000:0.0:1783071641.149918:0:19700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071641.149923:0:19700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de0adcb9/0x6b58994c2cbdd4bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.149932:0:19700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de0adcb9/0x6b58994c2cbdd4bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.149941:0:19700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de0adcb9/0x6b58994c2cbdd4bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.149949:0:19700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de0adcb9/0x6b58994c2cbdd4bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.149963:0:19700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783071641.150145:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783071641.150151:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de0adcb9/0x6b58994c2cbdd4bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.150159:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b421d8200 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:1.0:1783071641.150163:0:17075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de0adcb9/0x6b58994c2cbdd4bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.150171:0:17075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de0adcb9/0x6b58994c2cbdd4bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.150183:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de0adcb9/0x6b58994c2cbdd4bb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.150196:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de0adcb9/0x6b58994c2cbdd4bb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.150212:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071641.150213:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071641.150215:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783071641.150289:0:18592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783071641.150294:0:18592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000466281cd/0x6b58994c2cbdd4c2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.150302:0:18592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=542s v=(0 0) 00010000:00010000:3.0:1783071641.150305:0:18592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783071641.150309:0:18592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000466281cd/0x6b58994c2cbdd4c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.150317:0:18592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000466281cd/0x6b58994c2cbdd4c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.150324:0:18592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000466281cd/0x6b58994c2cbdd4c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.150331:0:18592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000466281cd/0x6b58994c2cbdd4c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.150378:0:18592:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783071641.150462:0:17074:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783071641.150466:0:17074:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000466281cd/0x6b58994c2cbdd4c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.150473:0:17074:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01749e00 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:3.0:1783071641.150476:0:17074:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000466281cd/0x6b58994c2cbdd4c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.150484:0:17074:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000466281cd/0x6b58994c2cbdd4c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.150494:0:17074:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000466281cd/0x6b58994c2cbdd4c2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.150500:0:17074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000466281cd/0x6b58994c2cbdd4c2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.150513:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071641.150515:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071641.150516:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071641.150727:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783071641.150861:0:18592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783071641.150867:0:18592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017756155/0x6b58994c2cbdd4c9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.150876:0:18592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=542s v=(0 0) 00010000:00010000:3.0:1783071641.150884:0:18592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783071641.150889:0:18592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017756155/0x6b58994c2cbdd4c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.150899:0:18592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017756155/0x6b58994c2cbdd4c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.150907:0:18592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017756155/0x6b58994c2cbdd4c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.150915:0:18592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017756155/0x6b58994c2cbdd4c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.150928:0:18592:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783071641.151017:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783071641.151022:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017756155/0x6b58994c2cbdd4c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.151029:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b3c460a00 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:3.0:1783071641.151033:0:17075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017756155/0x6b58994c2cbdd4c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.151042:0:17075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017756155/0x6b58994c2cbdd4c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.151053:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017756155/0x6b58994c2cbdd4c9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.151070:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017756155/0x6b58994c2cbdd4c9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.151100:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071641.151102:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071641.151104:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783071641.151993:0:18592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783071641.152003:0:18592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cc6a731/0x6b58994c2cbdd4d0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.152015:0:18592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=542s v=(0 0) 00010000:00010000:3.0:1783071641.152019:0:18592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783071641.152024:0:18592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004cc6a731/0x6b58994c2cbdd4d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.152035:0:18592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004cc6a731/0x6b58994c2cbdd4d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.152045:0:18592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cc6a731/0x6b58994c2cbdd4d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.152053:0:18592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004cc6a731/0x6b58994c2cbdd4d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.152076:0:18592:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783071641.152217:0:17074:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783071641.152223:0:17074:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004cc6a731/0x6b58994c2cbdd4d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.152230:0:17074:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b3c460600 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:0.0:1783071641.152234:0:17074:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004cc6a731/0x6b58994c2cbdd4d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.152254:0:17074:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004cc6a731/0x6b58994c2cbdd4d0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.152267:0:17074:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004cc6a731/0x6b58994c2cbdd4d0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.152275:0:17074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004cc6a731/0x6b58994c2cbdd4d0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.152292:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071641.152294:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071641.152295:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783071641.152592:0:18592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783071641.152603:0:18592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fde40bb4/0x6b58994c2cbdd4d7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.152610:0:18592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=542s v=(0 0) 00010000:00010000:3.0:1783071641.152614:0:18592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783071641.152619:0:18592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fde40bb4/0x6b58994c2cbdd4d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.152628:0:18592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fde40bb4/0x6b58994c2cbdd4d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.152636:0:18592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fde40bb4/0x6b58994c2cbdd4d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.152643:0:18592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fde40bb4/0x6b58994c2cbdd4d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.152661:0:18592:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783071641.152792:0:19422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783071641.152797:0:19422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fde40bb4/0x6b58994c2cbdd4d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.152804:0:19422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b3c461400 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:0.0:1783071641.152807:0:19422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fde40bb4/0x6b58994c2cbdd4d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.152815:0:19422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fde40bb4/0x6b58994c2cbdd4d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.152825:0:19422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fde40bb4/0x6b58994c2cbdd4d7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.152843:0:19422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fde40bb4/0x6b58994c2cbdd4d7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.152858:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071641.152860:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071641.152861:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783071641.155054:0:18592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783071641.155067:0:18592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000612b690b/0x6b58994c2cbdd4de lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.155083:0:18592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=542s v=(0 0) 00010000:00010000:0.0:1783071641.155087:0:18592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071641.155093:0:18592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000612b690b/0x6b58994c2cbdd4de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.155106:0:18592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000612b690b/0x6b58994c2cbdd4de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.155129:0:18592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000612b690b/0x6b58994c2cbdd4de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.155138:0:18592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000612b690b/0x6b58994c2cbdd4de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.155161:0:18592:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783071641.155950:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783071641.155959:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000612b690b/0x6b58994c2cbdd4de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.155969:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b421d9800 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:3.0:1783071641.155974:0:17075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000612b690b/0x6b58994c2cbdd4de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.155984:0:17075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000612b690b/0x6b58994c2cbdd4de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.156013:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000612b690b/0x6b58994c2cbdd4de lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.156021:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000612b690b/0x6b58994c2cbdd4de lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.156044:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071641.156046:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071641.156048:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783071641.156466:0:19700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783071641.156473:0:19700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e74ff39/0x6b58994c2cbdd4e5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.156488:0:19700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=542s v=(0 0) 00010000:00010000:1.0:1783071641.156492:0:19700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783071641.156497:0:19700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e74ff39/0x6b58994c2cbdd4e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.156509:0:19700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e74ff39/0x6b58994c2cbdd4e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.156519:0:19700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e74ff39/0x6b58994c2cbdd4e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.156527:0:19700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e74ff39/0x6b58994c2cbdd4e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.156542:0:19700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783071641.156697:0:17074:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783071641.156708:0:17074:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e74ff39/0x6b58994c2cbdd4e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.156716:0:17074:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03bd6400 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:0.0:1783071641.156719:0:17074:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e74ff39/0x6b58994c2cbdd4e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.156729:0:17074:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e74ff39/0x6b58994c2cbdd4e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.156742:0:17074:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e74ff39/0x6b58994c2cbdd4e5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.156749:0:17074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e74ff39/0x6b58994c2cbdd4e5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.156763:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071641.156765:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071641.156766:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1783071641.157564:0:19406:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1783071641.157582:0:19406:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1783071641.157585:0:19406:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1783071641.157810:0:19286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c78f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:17829:x1869685707700352:12345-0@lo:5:osp-pre-1-1.0 Request processed in 30507us (30786us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1783071641.157821:0:19286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783071641.157868:0:17829:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1783071641.157874:0:17829:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17829:1869685707700352:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1783071641.157888:0:17829:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1783071641.157937:0:17829:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17829:1869685707700480:0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1783071641.157968:0:17829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071641.157989:0:17829:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b06c44600 going to sleep for 11 seconds 00000100:00100000:0.0:1783071641.158051:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707700480 00000100:00100000:0.0:1783071641.158058:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707700480 00000100:00100000:0.0:1783071641.158103:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783071641.158120:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c78f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17829:x1869685707700480:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1783071641.158172:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c78f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17829:x1869685707700480:12345-0@lo:900:osp-pre-1-1.0 Request processed in 62us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071641.158185:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00002000:00010000:0.0:1783071641.158279:0:19700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783071641.158287:0:19700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b0b7a50/0x6b58994c2cbdd4ec lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.158299:0:19700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=542s v=(0 0) 00010000:00010000:0.0:1783071641.158302:0:19700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071641.158307:0:19700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b0b7a50/0x6b58994c2cbdd4ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.158318:0:19700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b0b7a50/0x6b58994c2cbdd4ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.158328:0:19700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b0b7a50/0x6b58994c2cbdd4ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.158336:0:19700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b0b7a50/0x6b58994c2cbdd4ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.158351:0:19700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783071641.158359:0:19422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783071641.158388:0:19422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b0b7a50/0x6b58994c2cbdd4ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.158395:0:19422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b421d9c00 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:0.0:1783071641.158398:0:19422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b0b7a50/0x6b58994c2cbdd4ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.158412:0:19422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b0b7a50/0x6b58994c2cbdd4ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.158426:0:19422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b0b7a50/0x6b58994c2cbdd4ec lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.158433:0:19422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b0b7a50/0x6b58994c2cbdd4ec lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.158450:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071641.158452:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071641.158453:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783071641.158897:0:19700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783071641.158904:0:19700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a053e71/0x6b58994c2cbdd4f3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.158912:0:19700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=542s v=(0 0) 00010000:00010000:0.0:1783071641.158915:0:19700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071641.158920:0:19700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a053e71/0x6b58994c2cbdd4f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.158929:0:19700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a053e71/0x6b58994c2cbdd4f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.158937:0:19700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a053e71/0x6b58994c2cbdd4f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.158952:0:19700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a053e71/0x6b58994c2cbdd4f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.158971:0:19700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783071641.158980:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783071641.158984:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a053e71/0x6b58994c2cbdd4f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.158992:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b421d9e00 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:0.0:1783071641.158995:0:17075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a053e71/0x6b58994c2cbdd4f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.159004:0:17075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a053e71/0x6b58994c2cbdd4f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.159016:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a053e71/0x6b58994c2cbdd4f3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.159024:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a053e71/0x6b58994c2cbdd4f3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.159038:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071641.159040:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071641.159042:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783071641.159331:0:19700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783071641.159345:0:19700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d161545a/0x6b58994c2cbdd4fa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.159354:0:19700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=542s v=(0 0) 00010000:00010000:0.0:1783071641.159357:0:19700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071641.159410:0:19700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d161545a/0x6b58994c2cbdd4fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.159422:0:19700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d161545a/0x6b58994c2cbdd4fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.159431:0:19700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d161545a/0x6b58994c2cbdd4fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.159438:0:19700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d161545a/0x6b58994c2cbdd4fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.159451:0:19700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:1.0:1783071641.159650:0:17829:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c78ce00 x1869685707700480/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783071657 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071641.159664:0:17829:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17829:1869685707700480:0@lo:900:osp-pre-1-1.0 00002000:00010000:0.0:1783071641.159912:0:19700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783071641.159918:0:19700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef65c43c/0x6b58994c2cbdd501 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.159926:0:19700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=542s v=(0 0) 00010000:00010000:0.0:1783071641.159929:0:19700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071641.159934:0:19700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef65c43c/0x6b58994c2cbdd501 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.159942:0:19700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef65c43c/0x6b58994c2cbdd501 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.159957:0:19700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef65c43c/0x6b58994c2cbdd501 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.159964:0:19700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ef65c43c/0x6b58994c2cbdd501 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.160024:0:19700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1783071641.160241:0:18592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783071641.160247:0:18592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017756155/0x6b58994c2cbdd508 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.160256:0:18592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=542s v=(0 0) 00010000:00010000:3.0:1783071641.160259:0:18592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783071641.160263:0:18592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017756155/0x6b58994c2cbdd508 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.160273:0:18592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017756155/0x6b58994c2cbdd508 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.160282:0:18592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017756155/0x6b58994c2cbdd508 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.160289:0:18592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017756155/0x6b58994c2cbdd508 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783071641.160820:0:19700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783071641.160827:0:19700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5be14d8/0x6b58994c2cbdd50f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.160836:0:19700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=542s v=(0 0) 00010000:00010000:0.0:1783071641.160839:0:19700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071641.160842:0:19700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5be14d8/0x6b58994c2cbdd50f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.160851:0:19700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5be14d8/0x6b58994c2cbdd50f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.160858:0:19700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5be14d8/0x6b58994c2cbdd50f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.160865:0:19700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5be14d8/0x6b58994c2cbdd50f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.160930:0:19422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783071641.160933:0:17074:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783071641.160938:0:19422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d161545a/0x6b58994c2cbdd4fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.160939:0:17074:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ef65c43c/0x6b58994c2cbdd501 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.160948:0:17074:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b421d8400 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:1.0:1783071641.160948:0:19422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b421d9a00 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:2.0:1783071641.160953:0:17074:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef65c43c/0x6b58994c2cbdd501 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.160953:0:19422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d161545a/0x6b58994c2cbdd4fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.160964:0:17074:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef65c43c/0x6b58994c2cbdd501 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.160964:0:19422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d161545a/0x6b58994c2cbdd4fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.160981:0:17074:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ef65c43c/0x6b58994c2cbdd501 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.160981:0:19422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d161545a/0x6b58994c2cbdd4fa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.160990:0:17074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef65c43c/0x6b58994c2cbdd501 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.160990:0:19422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d161545a/0x6b58994c2cbdd4fa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.161008:0:17074:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783071641.161008:0:19422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783071641.161011:0:19422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017756155/0x6b58994c2cbdd508 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.161016:0:17074:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5be14d8/0x6b58994c2cbdd50f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.161017:0:19422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b3c460a00 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:1.0:1783071641.161021:0:19422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017756155/0x6b58994c2cbdd508 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.161023:0:17074:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b421d8600 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:2.0:1783071641.161025:0:17074:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5be14d8/0x6b58994c2cbdd50f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.161034:0:17074:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5be14d8/0x6b58994c2cbdd50f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.161035:0:19422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017756155/0x6b58994c2cbdd508 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.161045:0:17074:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5be14d8/0x6b58994c2cbdd50f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.161046:0:19422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017756155/0x6b58994c2cbdd508 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.161053:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071641.161054:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071641.161055:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071641.161055:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071641.161056:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071641.161057:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071641.161122:0:18592:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783071641.161128:0:18592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017756155/0x6b58994c2cbdd508 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.161265:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783071641.161709:0:18592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783071641.161716:0:18592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084cfea8d/0x6b58994c2cbdd516 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.161727:0:18592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=542s v=(0 0) 00010000:00010000:3.0:1783071641.161730:0:18592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783071641.161735:0:18592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084cfea8d/0x6b58994c2cbdd516 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.161745:0:18592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084cfea8d/0x6b58994c2cbdd516 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.161753:0:18592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084cfea8d/0x6b58994c2cbdd516 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.161760:0:18592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084cfea8d/0x6b58994c2cbdd516 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.161777:0:18592:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783071641.162094:0:18592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783071641.162099:0:18592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a36c1a3/0x6b58994c2cbdd51d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.162126:0:18592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=542s v=(0 0) 00010000:00010000:3.0:1783071641.162129:0:18592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783071641.162134:0:18592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a36c1a3/0x6b58994c2cbdd51d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.162143:0:18592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a36c1a3/0x6b58994c2cbdd51d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.162152:0:18592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a36c1a3/0x6b58994c2cbdd51d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.162159:0:18592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a36c1a3/0x6b58994c2cbdd51d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.162221:0:19700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783071641.162228:0:19700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5be14d8/0x6b58994c2cbdd50f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783071641.162680:0:19700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783071641.162685:0:19700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c90fa58/0x6b58994c2cbdd524 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.162693:0:19700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=542s v=(0 0) 00010000:00010000:0.0:1783071641.162695:0:19700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071641.162699:0:19700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c90fa58/0x6b58994c2cbdd524 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.162708:0:19700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c90fa58/0x6b58994c2cbdd524 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.162716:0:19700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c90fa58/0x6b58994c2cbdd524 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.162724:0:19700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c90fa58/0x6b58994c2cbdd524 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.162775:0:19422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783071641.162782:0:19422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084cfea8d/0x6b58994c2cbdd516 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.162789:0:19422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b3c461000 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:1.0:1783071641.162794:0:19422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084cfea8d/0x6b58994c2cbdd516 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.162800:0:17074:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783071641.162803:0:19422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084cfea8d/0x6b58994c2cbdd516 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.162805:0:17074:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a36c1a3/0x6b58994c2cbdd51d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.162812:0:17074:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b3c461800 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:2.0:1783071641.162815:0:17074:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a36c1a3/0x6b58994c2cbdd51d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.162822:0:17074:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a36c1a3/0x6b58994c2cbdd51d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.162822:0:19422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084cfea8d/0x6b58994c2cbdd516 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.162830:0:19422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084cfea8d/0x6b58994c2cbdd516 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.162836:0:17074:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a36c1a3/0x6b58994c2cbdd51d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.162853:0:17074:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783071641.162856:0:17074:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c90fa58/0x6b58994c2cbdd524 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.162858:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071641.162860:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071641.162862:0:17074:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b421d9000 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:1.0:1783071641.162862:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071641.162865:0:17074:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c90fa58/0x6b58994c2cbdd524 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.162872:0:17074:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c90fa58/0x6b58994c2cbdd524 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.162883:0:17074:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c90fa58/0x6b58994c2cbdd524 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.162890:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071641.162892:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071641.162893:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071641.162960:0:18592:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783071641.162966:0:18592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a36c1a3/0x6b58994c2cbdd51d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.166747:0:19700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783071641.166765:0:19700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c90fa58/0x6b58994c2cbdd524 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.167272:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783071641.167422:0:19700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783071641.167429:0:19700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de0adcb9/0x6b58994c2cbdd52b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.167443:0:19700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=542s v=(0 0) 00010000:00010000:0.0:1783071641.167448:0:19700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071641.167454:0:19700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de0adcb9/0x6b58994c2cbdd52b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.167468:0:19700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de0adcb9/0x6b58994c2cbdd52b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.167478:0:19700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de0adcb9/0x6b58994c2cbdd52b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.167485:0:19700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de0adcb9/0x6b58994c2cbdd52b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.167501:0:19700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783071641.167774:0:17074:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783071641.167781:0:17074:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de0adcb9/0x6b58994c2cbdd52b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.167790:0:17074:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b421d8200 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:2.0:1783071641.167794:0:17074:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de0adcb9/0x6b58994c2cbdd52b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.167815:0:17074:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de0adcb9/0x6b58994c2cbdd52b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.167832:0:17074:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de0adcb9/0x6b58994c2cbdd52b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.167840:0:17074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de0adcb9/0x6b58994c2cbdd52b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.167857:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071641.167859:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071641.167861:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783071641.167935:0:19700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783071641.167940:0:19700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f817603/0x6b58994c2cbdd532 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.167948:0:19700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=542s v=(0 0) 00010000:00010000:0.0:1783071641.167951:0:19700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071641.167961:0:19700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f817603/0x6b58994c2cbdd532 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.167971:0:19700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f817603/0x6b58994c2cbdd532 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.167979:0:19700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f817603/0x6b58994c2cbdd532 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.167986:0:19700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006f817603/0x6b58994c2cbdd532 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.168007:0:19700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783071641.168244:0:19422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783071641.168249:0:19422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f817603/0x6b58994c2cbdd532 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.168257:0:19422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b00030200 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:2.0:1783071641.168261:0:19422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f817603/0x6b58994c2cbdd532 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.168269:0:19422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f817603/0x6b58994c2cbdd532 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.168279:0:19422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f817603/0x6b58994c2cbdd532 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.168297:0:19422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f817603/0x6b58994c2cbdd532 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.168312:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071641.168314:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071641.168316:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783071641.168413:0:19700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783071641.168419:0:19700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070fe9d28/0x6b58994c2cbdd539 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.168427:0:19700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=542s v=(0 0) 00010000:00010000:0.0:1783071641.168429:0:19700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071641.168433:0:19700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070fe9d28/0x6b58994c2cbdd539 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.168442:0:19700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070fe9d28/0x6b58994c2cbdd539 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.168450:0:19700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070fe9d28/0x6b58994c2cbdd539 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.168468:0:19700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070fe9d28/0x6b58994c2cbdd539 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.168483:0:19700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783071641.168721:0:17074:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783071641.168725:0:17074:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070fe9d28/0x6b58994c2cbdd539 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.168733:0:17074:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b00031400 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:2.0:1783071641.168736:0:17074:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070fe9d28/0x6b58994c2cbdd539 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.168743:0:17074:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070fe9d28/0x6b58994c2cbdd539 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.168755:0:17074:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070fe9d28/0x6b58994c2cbdd539 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.168763:0:17074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070fe9d28/0x6b58994c2cbdd539 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.168779:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071641.168781:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071641.168783:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783071641.168858:0:19700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783071641.168864:0:19700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd2ff347/0x6b58994c2cbdd540 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.168873:0:19700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=542s v=(0 0) 00010000:00010000:0.0:1783071641.168876:0:19700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071641.168880:0:19700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd2ff347/0x6b58994c2cbdd540 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.168889:0:19700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd2ff347/0x6b58994c2cbdd540 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.168897:0:19700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd2ff347/0x6b58994c2cbdd540 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.168904:0:19700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd2ff347/0x6b58994c2cbdd540 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.168957:0:19700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783071641.169300:0:19700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783071641.169306:0:19700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec2968b3/0x6b58994c2cbdd547 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.169321:0:19700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=542s v=(0 0) 00010000:00010000:0.0:1783071641.169324:0:19700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071641.169328:0:19700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec2968b3/0x6b58994c2cbdd547 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.169338:0:19700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec2968b3/0x6b58994c2cbdd547 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.169347:0:19700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec2968b3/0x6b58994c2cbdd547 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.169355:0:19700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec2968b3/0x6b58994c2cbdd547 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783071641.169530:0:18592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783071641.169537:0:18592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f03041e2/0x6b58994c2cbdd54e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.169545:0:18592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=542s v=(0 0) 00010000:00010000:3.0:1783071641.169548:0:18592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783071641.169552:0:18592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f03041e2/0x6b58994c2cbdd54e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.169575:0:18592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f03041e2/0x6b58994c2cbdd54e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.169584:0:18592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f03041e2/0x6b58994c2cbdd54e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.169592:0:18592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f03041e2/0x6b58994c2cbdd54e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.169650:0:19422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783071641.169657:0:19422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd2ff347/0x6b58994c2cbdd540 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.169664:0:19422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b00030c00 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:2.0:1783071641.169668:0:19422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd2ff347/0x6b58994c2cbdd540 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.169677:0:19422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd2ff347/0x6b58994c2cbdd540 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.169690:0:19422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd2ff347/0x6b58994c2cbdd540 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.169698:0:19422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd2ff347/0x6b58994c2cbdd540 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.169713:0:19422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783071641.169717:0:19422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec2968b3/0x6b58994c2cbdd547 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.169723:0:19422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b00031a00 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:2.0:1783071641.169726:0:19422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec2968b3/0x6b58994c2cbdd547 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.169734:0:19422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec2968b3/0x6b58994c2cbdd547 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.169756:0:19422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec2968b3/0x6b58994c2cbdd547 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.169764:0:19422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783071641.169767:0:19422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f03041e2/0x6b58994c2cbdd54e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.169774:0:19422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b3c461e00 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:2.0:1783071641.169777:0:19422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f03041e2/0x6b58994c2cbdd54e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.169785:0:19422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f03041e2/0x6b58994c2cbdd54e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.169794:0:19422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f03041e2/0x6b58994c2cbdd54e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.169802:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071641.169803:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071641.169805:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071641.169986:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071641.170062:0:19700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783071641.170069:0:19700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec2968b3/0x6b58994c2cbdd547 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783071641.170559:0:19700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783071641.170566:0:19700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b718b38/0x6b58994c2cbdd555 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.170576:0:19700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=542s v=(0 0) 00010000:00010000:0.0:1783071641.170580:0:19700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071641.170584:0:19700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b718b38/0x6b58994c2cbdd555 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.170607:0:19700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b718b38/0x6b58994c2cbdd555 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.170616:0:19700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b718b38/0x6b58994c2cbdd555 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.170624:0:19700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b718b38/0x6b58994c2cbdd555 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.170649:0:19700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783071641.170779:0:19422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783071641.170785:0:19422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b718b38/0x6b58994c2cbdd555 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.170793:0:19422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b00031600 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:1.0:1783071641.170797:0:19422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b718b38/0x6b58994c2cbdd555 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.170804:0:19422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b718b38/0x6b58994c2cbdd555 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.170816:0:19422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b718b38/0x6b58994c2cbdd555 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.170824:0:19422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b718b38/0x6b58994c2cbdd555 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.170838:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071641.170840:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071641.170841:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783071641.171224:0:19700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783071641.171231:0:19700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5bbedce/0x6b58994c2cbdd55c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.171246:0:19700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=542s v=(0 0) 00010000:00010000:1.0:1783071641.171249:0:19700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783071641.171254:0:19700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5bbedce/0x6b58994c2cbdd55c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.171266:0:19700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5bbedce/0x6b58994c2cbdd55c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.171274:0:19700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5bbedce/0x6b58994c2cbdd55c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.171282:0:19700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5bbedce/0x6b58994c2cbdd55c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.171336:0:18592:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783071641.171343:0:18592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f03041e2/0x6b58994c2cbdd54e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.174409:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783071641.174424:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5bbedce/0x6b58994c2cbdd55c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.174439:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03bd6e00 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:0.0:1783071641.174444:0:17075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5bbedce/0x6b58994c2cbdd55c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.174457:0:17075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5bbedce/0x6b58994c2cbdd55c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.174477:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5bbedce/0x6b58994c2cbdd55c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.174490:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071641.174502:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071641.174504:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071641.174593:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783071641.175407:0:18592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783071641.175418:0:18592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001efe5f67/0x6b58994c2cbdd563 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.175432:0:18592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=542s v=(0 0) 00010000:00010000:2.0:1783071641.175443:0:18592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783071641.175449:0:18592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001efe5f67/0x6b58994c2cbdd563 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.175463:0:18592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001efe5f67/0x6b58994c2cbdd563 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.175473:0:18592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001efe5f67/0x6b58994c2cbdd563 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.175481:0:18592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001efe5f67/0x6b58994c2cbdd563 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.175503:0:18592:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783071641.175900:0:19422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783071641.175907:0:19422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001efe5f67/0x6b58994c2cbdd563 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.175915:0:19422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd66600 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:0.0:1783071641.175919:0:19422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001efe5f67/0x6b58994c2cbdd563 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.175928:0:19422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001efe5f67/0x6b58994c2cbdd563 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.175941:0:19422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001efe5f67/0x6b58994c2cbdd563 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.175948:0:19422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001efe5f67/0x6b58994c2cbdd563 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.175963:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071641.175965:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071641.175966:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783071641.176311:0:18592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783071641.176318:0:18592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d2b99a6/0x6b58994c2cbdd56a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.176326:0:18592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=542s v=(0 0) 00010000:00010000:2.0:1783071641.176330:0:18592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783071641.176335:0:18592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d2b99a6/0x6b58994c2cbdd56a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.176344:0:18592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d2b99a6/0x6b58994c2cbdd56a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.176352:0:18592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d2b99a6/0x6b58994c2cbdd56a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071641.176498:0:19700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1783071641.176506:0:19700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5bbedce/0x6b58994c2cbdd55c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.178316:0:18592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d2b99a6/0x6b58994c2cbdd56a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.182440:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783071641.182456:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d2b99a6/0x6b58994c2cbdd56a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.182470:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd67800 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:0.0:1783071641.182475:0:17075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d2b99a6/0x6b58994c2cbdd56a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.182497:0:17075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d2b99a6/0x6b58994c2cbdd56a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.182518:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d2b99a6/0x6b58994c2cbdd56a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.182527:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071641.182528:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071641.182530:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783071641.183239:0:19700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783071641.183248:0:19700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032edb8b4/0x6b58994c2cbdd571 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.183262:0:19700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=542s v=(0 0) 00010000:00010000:0.0:1783071641.183267:0:19700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071641.183274:0:19700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032edb8b4/0x6b58994c2cbdd571 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.183286:0:19700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032edb8b4/0x6b58994c2cbdd571 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.183295:0:19700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032edb8b4/0x6b58994c2cbdd571 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.183304:0:19700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032edb8b4/0x6b58994c2cbdd571 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.183337:0:19700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783071641.183676:0:19700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783071641.183682:0:19700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ffb5347/0x6b58994c2cbdd578 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.183691:0:19700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=542s v=(0 0) 00010000:00010000:0.0:1783071641.183694:0:19700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071641.183698:0:19700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ffb5347/0x6b58994c2cbdd578 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.183707:0:19700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ffb5347/0x6b58994c2cbdd578 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.183716:0:19700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ffb5347/0x6b58994c2cbdd578 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.183724:0:19700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000ffb5347/0x6b58994c2cbdd578 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.183738:0:19700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783071641.183747:0:19422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783071641.183752:0:19422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032edb8b4/0x6b58994c2cbdd571 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.183759:0:19422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b00031200 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:0.0:1783071641.183769:0:19422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032edb8b4/0x6b58994c2cbdd571 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.183778:0:19422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032edb8b4/0x6b58994c2cbdd571 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.183790:0:19422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032edb8b4/0x6b58994c2cbdd571 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.183797:0:19422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032edb8b4/0x6b58994c2cbdd571 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.183819:0:19422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783071641.183822:0:19422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000ffb5347/0x6b58994c2cbdd578 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.183829:0:19422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b00030800 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:0.0:1783071641.183832:0:19422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000ffb5347/0x6b58994c2cbdd578 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.183840:0:19422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000ffb5347/0x6b58994c2cbdd578 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.183850:0:19422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000ffb5347/0x6b58994c2cbdd578 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.183857:0:19422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ffb5347/0x6b58994c2cbdd578 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.183878:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071641.183880:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071641.183882:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783071641.184173:0:19700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783071641.184179:0:19700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0a50427/0x6b58994c2cbdd57f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.184247:0:19700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=542s v=(0 0) 00010000:00010000:0.0:1783071641.184252:0:19700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071641.184256:0:19700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0a50427/0x6b58994c2cbdd57f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.184266:0:19700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0a50427/0x6b58994c2cbdd57f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.184275:0:19700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0a50427/0x6b58994c2cbdd57f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.184282:0:19700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0a50427/0x6b58994c2cbdd57f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.184298:0:19700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783071641.184305:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783071641.184310:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0a50427/0x6b58994c2cbdd57f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.184328:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a02ce8000 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:0.0:1783071641.184331:0:17075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0a50427/0x6b58994c2cbdd57f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.184340:0:17075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0a50427/0x6b58994c2cbdd57f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.184351:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0a50427/0x6b58994c2cbdd57f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.184358:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0a50427/0x6b58994c2cbdd57f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.184399:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071641.184400:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071641.184402:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783071641.184647:0:19700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783071641.184652:0:19700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006758feb5/0x6b58994c2cbdd586 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.184660:0:19700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=542s v=(0 0) 00010000:00010000:0.0:1783071641.184664:0:19700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071641.184668:0:19700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006758feb5/0x6b58994c2cbdd586 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.184677:0:19700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006758feb5/0x6b58994c2cbdd586 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.184691:0:19700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006758feb5/0x6b58994c2cbdd586 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.184698:0:19700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006758feb5/0x6b58994c2cbdd586 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.184713:0:19700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783071641.184721:0:19422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783071641.184725:0:19422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006758feb5/0x6b58994c2cbdd586 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.184731:0:19422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a02ce9400 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:0.0:1783071641.184735:0:19422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006758feb5/0x6b58994c2cbdd586 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.184742:0:19422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006758feb5/0x6b58994c2cbdd586 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.184754:0:19422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006758feb5/0x6b58994c2cbdd586 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.184761:0:19422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006758feb5/0x6b58994c2cbdd586 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.184775:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071641.184781:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071641.184783:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071641.185075:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783071641.185160:0:19700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783071641.185165:0:19700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040b253a9/0x6b58994c2cbdd58d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.185174:0:19700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=542s v=(0 0) 00010000:00010000:0.0:1783071641.185177:0:19700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071641.185181:0:19700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040b253a9/0x6b58994c2cbdd58d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.185245:0:19700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040b253a9/0x6b58994c2cbdd58d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.185253:0:19700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040b253a9/0x6b58994c2cbdd58d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.185259:0:19700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000040b253a9/0x6b58994c2cbdd58d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.185273:0:19700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783071641.185280:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783071641.185283:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000040b253a9/0x6b58994c2cbdd58d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.185289:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a02ce8c00 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:0.0:1783071641.185291:0:17075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000040b253a9/0x6b58994c2cbdd58d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.185310:0:17075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000040b253a9/0x6b58994c2cbdd58d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.185320:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000040b253a9/0x6b58994c2cbdd58d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.185327:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040b253a9/0x6b58994c2cbdd58d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.185340:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071641.185341:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071641.185343:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783071641.188346:0:19700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783071641.188434:0:19700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8e7f13e/0x6b58994c2cbdd594 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.188455:0:19700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=542s v=(0 0) 00010000:00010000:0.0:1783071641.188461:0:19700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071641.188468:0:19700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8e7f13e/0x6b58994c2cbdd594 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.188484:0:19700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8e7f13e/0x6b58994c2cbdd594 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.188495:0:19700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8e7f13e/0x6b58994c2cbdd594 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.188514:0:19700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b8e7f13e/0x6b58994c2cbdd594 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.188539:0:19700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783071641.188553:0:19422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783071641.188559:0:19422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b8e7f13e/0x6b58994c2cbdd594 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.188567:0:19422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a02ce8800 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:0.0:1783071641.188573:0:19422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8e7f13e/0x6b58994c2cbdd594 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.188582:0:19422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8e7f13e/0x6b58994c2cbdd594 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.188600:0:19422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b8e7f13e/0x6b58994c2cbdd594 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.188608:0:19422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8e7f13e/0x6b58994c2cbdd594 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.188629:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071641.188632:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071641.188634:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783071641.189077:0:19700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783071641.189091:0:19700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d81c8e4b/0x6b58994c2cbdd59b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.189101:0:19700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=542s v=(0 0) 00010000:00010000:0.0:1783071641.189105:0:19700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071641.189122:0:19700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d81c8e4b/0x6b58994c2cbdd59b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.189133:0:19700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d81c8e4b/0x6b58994c2cbdd59b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.189141:0:19700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d81c8e4b/0x6b58994c2cbdd59b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.189148:0:19700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d81c8e4b/0x6b58994c2cbdd59b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.189167:0:19700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783071641.189502:0:18592:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783071641.189510:0:18592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d2b99a6/0x6b58994c2cbdd56a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.189698:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783071641.189704:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d81c8e4b/0x6b58994c2cbdd59b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.189712:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a02ce9200 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:0.0:1783071641.189716:0:17075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d81c8e4b/0x6b58994c2cbdd59b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.189724:0:17075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d81c8e4b/0x6b58994c2cbdd59b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.189745:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d81c8e4b/0x6b58994c2cbdd59b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.189752:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d81c8e4b/0x6b58994c2cbdd59b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.189764:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071641.189766:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071641.189768:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783071641.190021:0:18592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783071641.190027:0:18592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008961d08d/0x6b58994c2cbdd5a2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.190036:0:18592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=542s v=(0 0) 00010000:00010000:2.0:1783071641.190040:0:18592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783071641.190044:0:18592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008961d08d/0x6b58994c2cbdd5a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.190054:0:18592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008961d08d/0x6b58994c2cbdd5a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.190062:0:18592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008961d08d/0x6b58994c2cbdd5a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.190069:0:18592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008961d08d/0x6b58994c2cbdd5a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.190095:0:18592:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783071641.190439:0:18592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783071641.190445:0:18592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b84e4d16/0x6b58994c2cbdd5a9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.190452:0:18592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=542s v=(0 0) 00010000:00010000:2.0:1783071641.190455:0:18592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783071641.190458:0:18592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b84e4d16/0x6b58994c2cbdd5a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.190467:0:18592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b84e4d16/0x6b58994c2cbdd5a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.190474:0:18592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b84e4d16/0x6b58994c2cbdd5a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.190481:0:18592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b84e4d16/0x6b58994c2cbdd5a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.190492:0:18592:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783071641.190756:0:19422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783071641.190761:0:19422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008961d08d/0x6b58994c2cbdd5a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.190768:0:19422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd67600 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:0.0:1783071641.190772:0:19422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008961d08d/0x6b58994c2cbdd5a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.190780:0:19422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008961d08d/0x6b58994c2cbdd5a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.190792:0:19422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008961d08d/0x6b58994c2cbdd5a2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.190799:0:19422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008961d08d/0x6b58994c2cbdd5a2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.190823:0:19422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783071641.190827:0:19422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b84e4d16/0x6b58994c2cbdd5a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.190833:0:19422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd66800 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:0.0:1783071641.190836:0:19422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b84e4d16/0x6b58994c2cbdd5a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.190842:0:19422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b84e4d16/0x6b58994c2cbdd5a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.190851:0:19422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b84e4d16/0x6b58994c2cbdd5a9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.190858:0:19422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b84e4d16/0x6b58994c2cbdd5a9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.190867:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071641.190868:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071641.190870:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071641.190876:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783071641.190974:0:19700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783071641.190980:0:19700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0b9facd/0x6b58994c2cbdd5b0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.190987:0:19700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=542s v=(0 0) 00010000:00010000:2.0:1783071641.190998:0:19700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783071641.191002:0:19700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0b9facd/0x6b58994c2cbdd5b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.191012:0:19700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0b9facd/0x6b58994c2cbdd5b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.191020:0:19700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0b9facd/0x6b58994c2cbdd5b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.191027:0:19700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d0b9facd/0x6b58994c2cbdd5b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.191039:0:19700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783071641.191318:0:19422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783071641.191323:0:19422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0b9facd/0x6b58994c2cbdd5b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.191331:0:19422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd66400 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:0.0:1783071641.191340:0:19422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0b9facd/0x6b58994c2cbdd5b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.191348:0:19422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0b9facd/0x6b58994c2cbdd5b0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.191359:0:19422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0b9facd/0x6b58994c2cbdd5b0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.191394:0:19422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0b9facd/0x6b58994c2cbdd5b0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.191409:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071641.191411:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071641.191412:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783071641.191457:0:18592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783071641.191463:0:18592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7870b7f/0x6b58994c2cbdd5b7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.191472:0:18592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=542s v=(0 0) 00010000:00010000:0.0:1783071641.191475:0:18592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071641.191479:0:18592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7870b7f/0x6b58994c2cbdd5b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.191487:0:18592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7870b7f/0x6b58994c2cbdd5b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.191495:0:18592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7870b7f/0x6b58994c2cbdd5b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.191508:0:18592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7870b7f/0x6b58994c2cbdd5b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.191524:0:18592:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783071641.191816:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783071641.191821:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7870b7f/0x6b58994c2cbdd5b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.191828:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a02ce9600 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:2.0:1783071641.191832:0:17075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7870b7f/0x6b58994c2cbdd5b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.191839:0:17075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7870b7f/0x6b58994c2cbdd5b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.191851:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7870b7f/0x6b58994c2cbdd5b7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.191869:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7870b7f/0x6b58994c2cbdd5b7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.191885:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071641.191887:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071641.191889:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783071641.191981:0:19700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783071641.191986:0:19700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9d7ce0b/0x6b58994c2cbdd5be lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.191994:0:19700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=542s v=(0 0) 00010000:00010000:0.0:1783071641.191998:0:19700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071641.192002:0:19700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9d7ce0b/0x6b58994c2cbdd5be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.192012:0:19700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9d7ce0b/0x6b58994c2cbdd5be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.192020:0:19700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9d7ce0b/0x6b58994c2cbdd5be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.192027:0:19700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9d7ce0b/0x6b58994c2cbdd5be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.192042:0:19700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783071641.192050:0:19422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783071641.192053:0:19422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9d7ce0b/0x6b58994c2cbdd5be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.192066:0:19422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a02ce9e00 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:0.0:1783071641.192069:0:19422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9d7ce0b/0x6b58994c2cbdd5be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.192076:0:19422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9d7ce0b/0x6b58994c2cbdd5be lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.192085:0:19422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9d7ce0b/0x6b58994c2cbdd5be lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.192092:0:19422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9d7ce0b/0x6b58994c2cbdd5be lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.192106:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071641.192108:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071641.192110:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783071641.192449:0:19700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783071641.192455:0:19700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce128f4a/0x6b58994c2cbdd5c5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.192463:0:19700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=542s v=(0 0) 00010000:00010000:0.0:1783071641.192466:0:19700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071641.192469:0:19700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce128f4a/0x6b58994c2cbdd5c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.192478:0:19700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce128f4a/0x6b58994c2cbdd5c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.192492:0:19700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce128f4a/0x6b58994c2cbdd5c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.192499:0:19700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce128f4a/0x6b58994c2cbdd5c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.192510:0:19700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1783071641.192539:0:19700:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:0.0:1783071641.192640:0:19700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c78dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:17112:x1869685707700096:12345-0@lo:5:osp-pre-1-0.0 Request processed in 90278us (90574us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071641.192650:0:19700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783071641.192707:0:17112:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02e40700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17112:1869685707700096:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1783071641.192724:0:17112:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:0.0:1783071641.192773:0:17112:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01767480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17112:1869685707700608:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1783071641.192806:0:17112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071641.192829:0:17112:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a0394f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783071641.192847:0:18591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707700608 00000100:00100000:0.0:1783071641.192853:0:18591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707700608 00000100:00100000:0.0:1783071641.192887:0:18591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783071641.192895:0:18591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17112:x1869685707700608:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1783071641.192932:0:18591:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00010000:00010000:2.0:1783071641.193194:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783071641.193202:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce128f4a/0x6b58994c2cbdd5c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.193211:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a02ce8a00 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:2.0:1783071641.193215:0:17075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce128f4a/0x6b58994c2cbdd5c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.193223:0:17075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce128f4a/0x6b58994c2cbdd5c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.193237:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce128f4a/0x6b58994c2cbdd5c5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.193244:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce128f4a/0x6b58994c2cbdd5c5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.193263:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071641.193265:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071641.193267:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783071641.193329:0:18592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783071641.193334:0:18592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038eddc02/0x6b58994c2cbdd5cc lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.193343:0:18592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=542s v=(0 0) 00010000:00010000:2.0:1783071641.193348:0:18592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783071641.193352:0:18592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038eddc02/0x6b58994c2cbdd5cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.193376:0:18592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038eddc02/0x6b58994c2cbdd5cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.193385:0:18592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038eddc02/0x6b58994c2cbdd5cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.193391:0:18592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000038eddc02/0x6b58994c2cbdd5cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.193406:0:18592:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783071641.193413:0:19422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783071641.193417:0:19422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000038eddc02/0x6b58994c2cbdd5cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.193424:0:19422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd66c00 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:2.0:1783071641.193427:0:19422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000038eddc02/0x6b58994c2cbdd5cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.193444:0:19422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000038eddc02/0x6b58994c2cbdd5cc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.193455:0:19422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000038eddc02/0x6b58994c2cbdd5cc lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.193462:0:19422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038eddc02/0x6b58994c2cbdd5cc lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.193475:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071641.193476:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071641.193478:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783071641.193841:0:18592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783071641.193847:0:18592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f377a4d/0x6b58994c2cbdd5d3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.193856:0:18592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=542s v=(0 0) 00010000:00010000:2.0:1783071641.193859:0:18592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783071641.193864:0:18592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f377a4d/0x6b58994c2cbdd5d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.193873:0:18592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f377a4d/0x6b58994c2cbdd5d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.193882:0:18592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f377a4d/0x6b58994c2cbdd5d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.193900:0:18592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f377a4d/0x6b58994c2cbdd5d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.193913:0:18592:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783071641.193921:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783071641.193925:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f377a4d/0x6b58994c2cbdd5d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.193931:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd66e00 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:2.0:1783071641.193935:0:17075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f377a4d/0x6b58994c2cbdd5d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.193943:0:17075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f377a4d/0x6b58994c2cbdd5d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.193954:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f377a4d/0x6b58994c2cbdd5d3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.193962:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f377a4d/0x6b58994c2cbdd5d3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.193976:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071641.193978:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071641.193979:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783071641.194562:0:18592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783071641.194574:0:18592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001efe5f67/0x6b58994c2cbdd5da lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.194584:0:18592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=542s v=(0 0) 00010000:00010000:2.0:1783071641.194587:0:18592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783071641.194591:0:18592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001efe5f67/0x6b58994c2cbdd5da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.194600:0:18592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001efe5f67/0x6b58994c2cbdd5da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.194609:0:18592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001efe5f67/0x6b58994c2cbdd5da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.194617:0:18592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001efe5f67/0x6b58994c2cbdd5da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.194630:0:18592:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783071641.194637:0:19422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783071641.194641:0:19422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001efe5f67/0x6b58994c2cbdd5da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.194648:0:19422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd66600 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:2.0:1783071641.194651:0:19422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001efe5f67/0x6b58994c2cbdd5da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.194659:0:19422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001efe5f67/0x6b58994c2cbdd5da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.194678:0:19422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001efe5f67/0x6b58994c2cbdd5da lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.194685:0:19422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001efe5f67/0x6b58994c2cbdd5da lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071641.194700:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071641.194701:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071641.194703:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071641.195132:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783071641.195853:0:18592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783071641.195861:0:18592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003086dfea/0x6b58994c2cbdd5e1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.195885:0:18592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=542s v=(0 0) 00010000:00010000:0.0:1783071641.195889:0:18592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071641.195895:0:18592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003086dfea/0x6b58994c2cbdd5e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.195906:0:18592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003086dfea/0x6b58994c2cbdd5e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.195916:0:18592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003086dfea/0x6b58994c2cbdd5e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.195924:0:18592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003086dfea/0x6b58994c2cbdd5e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.195939:0:18592:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783071641.196282:0:18592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783071641.196289:0:18592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001406df16/0x6b58994c2cbdd5e8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.196296:0:18592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=542s v=(0 0) 00010000:00010000:0.0:1783071641.196299:0:18592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071641.196303:0:18592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001406df16/0x6b58994c2cbdd5e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.196311:0:18592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001406df16/0x6b58994c2cbdd5e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.196330:0:18592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001406df16/0x6b58994c2cbdd5e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.196337:0:18592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001406df16/0x6b58994c2cbdd5e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.196352:0:18592:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1783071641.196623:0:18592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783071641.196628:0:18592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009038b4b6/0x6b58994c2cbdd5ef lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.196637:0:18592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=542s v=(0 0) 00010000:00010000:0.0:1783071641.196640:0:18592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071641.196643:0:18592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009038b4b6/0x6b58994c2cbdd5ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.196651:0:18592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009038b4b6/0x6b58994c2cbdd5ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.196658:0:18592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009038b4b6/0x6b58994c2cbdd5ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.196665:0:18592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009038b4b6/0x6b58994c2cbdd5ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071641.196687:0:18592:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00080000:0.0:1783071641.196713:0:18592:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:0.0:1783071641.196810:0:18592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03af0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17110:x1869685707699584:12345-0@lo:5:osp-pre-0-0.0 Request processed in 95599us (97800us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071641.196820:0:18592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783071641.196881:0:17110:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03af2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17110:1869685707699584:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1783071641.196895:0:17110:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:0.0:1783071641.196938:0:17110:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01767800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17110:1869685707700736:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1783071641.196972:0:17110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071641.196997:0:17110:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b101196c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783071641.197021:0:19286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707700736 00000100:00100000:0.0:1783071641.197027:0:19286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707700736 00000100:00100000:0.0:1783071641.197061:0:19286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783071641.197069:0:19286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01765f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17110:x1869685707700736:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1783071641.197102:0:19286:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00010000:00010000:3.0:1783071641.197388:0:19422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783071641.197396:0:19422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003086dfea/0x6b58994c2cbdd5e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.197404:0:19422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a02ce8600 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:3.0:1783071641.197409:0:19422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003086dfea/0x6b58994c2cbdd5e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.197417:0:19422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003086dfea/0x6b58994c2cbdd5e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.197447:0:19422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003086dfea/0x6b58994c2cbdd5e1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.197455:0:19422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003086dfea/0x6b58994c2cbdd5e1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.197476:0:19422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783071641.197480:0:19422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001406df16/0x6b58994c2cbdd5e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.197486:0:19422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a02ce9c00 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:3.0:1783071641.197489:0:19422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001406df16/0x6b58994c2cbdd5e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.197496:0:19422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001406df16/0x6b58994c2cbdd5e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.197505:0:19422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001406df16/0x6b58994c2cbdd5e8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.197512:0:19422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001406df16/0x6b58994c2cbdd5e8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.197524:0:19422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783071641.197527:0:19422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009038b4b6/0x6b58994c2cbdd5ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.197539:0:19422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a02ce8e00 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:3.0:1783071641.197542:0:19422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009038b4b6/0x6b58994c2cbdd5ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.197550:0:19422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009038b4b6/0x6b58994c2cbdd5ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.197559:0:19422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009038b4b6/0x6b58994c2cbdd5ef lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.197565:0:19422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009038b4b6/0x6b58994c2cbdd5ef lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071641.197577:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071641.197579:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071641.197581:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071641.197588:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071641.197699:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071641.201429:0:18591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17112:x1869685707700608:12345-0@lo:5:osp-pre-1-0.0 Request processed in 8525us (8614us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1783071641.201443:0:18591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783071641.201908:0:17112:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01767480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17112:1869685707700608:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1783071641.201925:0:17112:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00000001:00080000:1.0:1783071641.219482:0:18586:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:1.0:1783071641.219527:0:18586:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1783071641.219870:0:19286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01765f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17110:x1869685707700736:12345-0@lo:5:osp-pre-0-0.0 Request processed in 22797us (22893us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1783071641.219884:0:19286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783071641.223143:0:17110:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1783071641.223162:0:17110:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01767800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17110:1869685707700736:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1783071641.223180:0:17110:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00010000:00010000:1.0:1783071641.541317:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783071642.076650:0:19762:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg438-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1783071642.565722:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783071642.757770:0:17836:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:2.0:1783071642.840883:0:19814:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783071642.841432:0:19814:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:1.0:1783071643.540581:0:19864:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783071643.541051:0:19864:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783071643.586741:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071643.783071:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071643.783305:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692941696 00000100:00100000:0.0:1783071643.783321:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692941696 00000100:00100000:0.0:1783071643.783449:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 114 00000100:00100000:0.0:1783071643.783483:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2402:x1869685692941696:12345-192.168.204.38@tcp:250:mount.lustre.0 00010000:00080000:0.0:1783071643.783527:0:17081:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 7f80a971-9117-430f-93b5-a8b601517f46@192.168.204.38@tcp t0 exp 0000000000000000 cur 545 last 0 00000020:00000080:0.0:1783071643.783574:0:17081:0:(genops.c:1406:class_connect()) connect: client 7f80a971-9117-430f-93b5-a8b601517f46, cookie 0x6b58994c2cbdd5f6 00000100:00080000:0.0:1783071643.783769:0:17081:0:(import.c:65:import_set_state_nolock()) ffff8f8a010f6800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783071643.783887:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f80a971-9117-430f-93b5-a8b601517f46+5:2402:x1869685692941696:12345-192.168.204.38@tcp:250:mount.lustre.0 Request processed in 404us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071643.783897:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 114 00000100:00100000:2.0:1783071643.800571:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071643.801111:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692941824 00000100:00100000:3.0:1783071643.801154:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692941824 00000100:00100000:3.0:1783071643.801248:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 115 00000100:00100000:3.0:1783071643.801262:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f80a971-9117-430f-93b5-a8b601517f46+5:14905:x1869685692941824:12345-192.168.204.38@tcp:101:mount.lustre.0 00010000:00010000:3.0:1783071643.801288:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071643.801314:0:17079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b3c461e00/0x6b58994c2cbdd5fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d9915b expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071643.801353:0:17079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b3c461e00/0x6b58994c2cbdd5fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9915b expref: 6 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071643.801417:0:17079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b3c461e00/0x6b58994c2cbdd5fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9915b expref: 6 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071643.801430:0:17079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b3c461e00, rc 0) 00000100:00100000:3.0:1783071643.801650:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f80a971-9117-430f-93b5-a8b601517f46+6:14905:x1869685692941824:12345-192.168.204.38@tcp:101:mount.lustre.0 Request processed in 390us (1100us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071643.801659:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 115 00000100:00100000:0.0:1783071643.810334:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071643.810433:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692941952 00000100:00100000:1.0:1783071643.810455:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692941952 00000100:00100000:1.0:1783071643.810581:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 116 00000100:00100000:1.0:1783071643.810595:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f80a971-9117-430f-93b5-a8b601517f46+6:14905:x1869685692941952:12345-192.168.204.38@tcp:501:mount.lustre.0 00000100:00100000:1.0:1783071643.810797:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f80a971-9117-430f-93b5-a8b601517f46+6:14905:x1869685692941952:12345-192.168.204.38@tcp:501:mount.lustre.0 Request processed in 204us (666us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783071643.810807:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 116 00000100:00100000:1.0:1783071643.818600:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071643.818735:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692942080 00000100:00100000:0.0:1783071643.818752:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692942080 00000100:00100000:0.0:1783071643.818877:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 117 00000100:00100000:0.0:1783071643.818891:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f80a971-9117-430f-93b5-a8b601517f46+6:14905:x1869685692942080:12345-192.168.204.38@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783071643.818921:0:17078:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071643.818945:0:17078:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8a02ce8200/0x6b58994c2cbdd604 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d99162 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071643.818987:0:17078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8a02ce8200/0x6b58994c2cbdd604 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99162 expref: 7 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071643.818999:0:17078:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8a02ce8200/0x6b58994c2cbdd604 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99162 expref: 7 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071643.819011:0:17078:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a02ce8200, rc 0) 00000100:00100000:0.0:1783071643.819123:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f80a971-9117-430f-93b5-a8b601517f46+7:14905:x1869685692942080:12345-192.168.204.38@tcp:101:mount.lustre.0 Request processed in 233us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071643.819131:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 117 00000100:00100000:2.0:1783071643.823180:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071643.823361:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692942208 00000100:00100000:3.0:1783071643.823419:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692942208 00000100:00100000:3.0:1783071643.823506:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 118 00000100:00100000:3.0:1783071643.823520:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f80a971-9117-430f-93b5-a8b601517f46+7:14905:x1869685692942208:12345-192.168.204.38@tcp:501:mount.lustre.0 00000100:00100000:3.0:1783071643.823753:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f80a971-9117-430f-93b5-a8b601517f46+8:14905:x1869685692942208:12345-192.168.204.38@tcp:501:mount.lustre.0 Request processed in 237us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071643.823762:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 118 00000100:00100000:2.0:1783071643.835280:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071643.835459:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692942336 00000100:00100000:0.0:1783071643.835496:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692942336 00000100:00100000:0.0:1783071643.835635:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 119 00000100:00100000:0.0:1783071643.835650:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f80a971-9117-430f-93b5-a8b601517f46+8:14905:x1869685692942336:12345-192.168.204.38@tcp:503:mount.lustre.0 00000100:00100000:0.0:1783071643.835861:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f80a971-9117-430f-93b5-a8b601517f46+8:14905:x1869685692942336:12345-192.168.204.38@tcp:503:mount.lustre.0 Request processed in 212us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071643.835870:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 119 00000100:00100000:0.0:1783071643.841812:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071643.842099:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692942464 00000100:00100000:1.0:1783071643.842126:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692942464 00000100:00100000:1.0:1783071643.842320:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 120 00000100:00100000:1.0:1783071643.842334:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3eb85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f80a971-9117-430f-93b5-a8b601517f46+8:14923:x1869685692942464:12345-192.168.204.38@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783071643.842760:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3eb85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f80a971-9117-430f-93b5-a8b601517f46+8:14923:x1869685692942464:12345-192.168.204.38@tcp:502:llog_process_th.0 Request processed in 426us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071643.842770:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 120 00000100:00100000:2.0:1783071643.875500:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071643.875590:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692942592 00000100:00100000:0.0:1783071643.875608:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692942592 00000100:00100000:0.0:1783071643.875766:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 121 00000100:00100000:0.0:1783071643.875782:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3eb86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f80a971-9117-430f-93b5-a8b601517f46+8:14923:x1869685692942592:12345-192.168.204.38@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783071643.876137:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3eb86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f80a971-9117-430f-93b5-a8b601517f46+8:14923:x1869685692942592:12345-192.168.204.38@tcp:502:llog_process_th.0 Request processed in 358us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071643.876146:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 121 00000100:00100000:2.0:1783071643.892636:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071643.892825:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692942720 00000100:00100000:1.0:1783071643.892845:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692942720 00000100:00100000:1.0:1783071643.893011:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 122 00000100:00100000:1.0:1783071643.893030:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3eb87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f80a971-9117-430f-93b5-a8b601517f46+8:14923:x1869685692942720:12345-192.168.204.38@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783071643.893503:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3eb87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f80a971-9117-430f-93b5-a8b601517f46+8:14923:x1869685692942720:12345-192.168.204.38@tcp:502:llog_process_th.0 Request processed in 476us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071643.893516:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 122 00000100:00100000:1.0:1783071643.898532:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071643.904710:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692942848 00000100:00100000:0.0:1783071643.904728:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692942848 00000100:00100000:0.0:1783071643.904809:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 123 00000100:00100000:0.0:1783071643.904820:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3eb85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f80a971-9117-430f-93b5-a8b601517f46+8:14905:x1869685692942848:12345-192.168.204.38@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783071643.904838:0:17078:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071643.904860:0:17078:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8a02ce9a00/0x6b58994c2cbdd60b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d99193 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071643.904895:0:17078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8a02ce9a00/0x6b58994c2cbdd60b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99193 expref: 9 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071643.904907:0:17078:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8a02ce9a00/0x6b58994c2cbdd60b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99193 expref: 9 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071643.904932:0:17078:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a02ce9a00, rc 0) 00000100:00100000:0.0:1783071643.905020:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3eb85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f80a971-9117-430f-93b5-a8b601517f46+9:14905:x1869685692942848:12345-192.168.204.38@tcp:101:mount.lustre.0 Request processed in 201us (6500us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071643.905028:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 123 00000100:00100000:3.0:1783071643.907908:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071643.907987:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692942976 00000100:00100000:1.0:1783071643.907998:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692942976 00000100:00100000:1.0:1783071643.908055:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 124 00000100:00100000:1.0:1783071643.908075:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3eb87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f80a971-9117-430f-93b5-a8b601517f46+9:14905:x1869685692942976:12345-192.168.204.38@tcp:256:mount.lustre.0 20000000:01000000:1.0:1783071643.908117:0:17081:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1783071643.908137:0:17081:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1783071643.908141:0:17081:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1783071643.908144:0:17081:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1783071643.908148:0:17081:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1783071643.908150:0:17081:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:1.0:1783071643.910131:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3eb87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f80a971-9117-430f-93b5-a8b601517f46+9:14905:x1869685692942976:12345-192.168.204.38@tcp:256:mount.lustre.0 Request processed in 2055us (2219us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071643.910155:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 124 00000100:00100000:3.0:1783071643.912942:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071643.913034:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692943104 00000100:00100000:1.0:1783071643.913046:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692943104 00000100:00100000:1.0:1783071643.913113:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 125 00000100:00100000:1.0:1783071643.913125:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3eb87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f80a971-9117-430f-93b5-a8b601517f46+9:14905:x1869685692943104:12345-192.168.204.38@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783071643.913143:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071643.913161:0:17079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8a03bd6400/0x6b58994c2cbdd612 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d9919a expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071643.913344:0:17079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8a03bd6400/0x6b58994c2cbdd612 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9919a expref: 10 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071643.913356:0:17079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8a03bd6400/0x6b58994c2cbdd612 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9919a expref: 10 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071643.913394:0:17079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a03bd6400, rc 0) 00000100:00100000:1.0:1783071643.913556:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3eb87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f80a971-9117-430f-93b5-a8b601517f46+10:14905:x1869685692943104:12345-192.168.204.38@tcp:101:mount.lustre.0 Request processed in 432us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071643.913564:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 125 00000100:00100000:3.0:1783071643.915694:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071643.915770:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692943232 00000100:00100000:1.0:1783071643.915785:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692943232 00000100:00100000:1.0:1783071643.915842:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 126 00000100:00100000:1.0:1783071643.915852:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3eb85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f80a971-9117-430f-93b5-a8b601517f46+10:14905:x1869685692943232:12345-192.168.204.38@tcp:501:mount.lustre.0 00000100:00100000:1.0:1783071643.916077:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3eb85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f80a971-9117-430f-93b5-a8b601517f46+10:14905:x1869685692943232:12345-192.168.204.38@tcp:501:mount.lustre.0 Request processed in 225us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071643.916085:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 126 00000100:00100000:3.0:1783071643.919280:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071643.919688:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692943360 00000100:00100000:1.0:1783071643.919699:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692943360 00000100:00100000:1.0:1783071643.919766:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 127 00000100:00100000:1.0:1783071643.919777:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3eb84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f80a971-9117-430f-93b5-a8b601517f46+10:14905:x1869685692943360:12345-192.168.204.38@tcp:503:mount.lustre.0 00000100:00100000:1.0:1783071643.919947:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3eb84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f80a971-9117-430f-93b5-a8b601517f46+10:14905:x1869685692943360:12345-192.168.204.38@tcp:503:mount.lustre.0 Request processed in 170us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071643.919955:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 127 00000100:00100000:3.0:1783071643.932609:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071643.933128:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692943488 00000100:00100000:0.0:1783071643.933141:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692943488 00000100:00100000:0.0:1783071643.933205:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 128 00000100:00100000:0.0:1783071643.933216:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3eb91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f80a971-9117-430f-93b5-a8b601517f46+10:14928:x1869685692943488:12345-192.168.204.38@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783071643.933421:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3eb91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f80a971-9117-430f-93b5-a8b601517f46+10:14928:x1869685692943488:12345-192.168.204.38@tcp:502:llog_process_th.0 Request processed in 205us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071643.933430:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 128 00000100:00100000:3.0:1783071643.941343:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071643.941497:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692943616 00000100:00100000:0.0:1783071643.941508:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692943616 00000100:00100000:0.0:1783071643.941598:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 129 00000100:00100000:0.0:1783071643.941612:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3eb91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f80a971-9117-430f-93b5-a8b601517f46+10:14928:x1869685692943616:12345-192.168.204.38@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783071643.941787:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3eb91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f80a971-9117-430f-93b5-a8b601517f46+10:14928:x1869685692943616:12345-192.168.204.38@tcp:502:llog_process_th.0 Request processed in 177us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071643.941796:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 129 00000100:00100000:2.0:1783071643.948431:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071643.948594:0:19285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692943744 00000100:00100000:0.0:1783071643.948604:0:19285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692943744 00000100:00100000:0.0:1783071643.948663:0:19285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 7 00000100:00100000:0.0:1783071643.948671:0:19285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b078d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2402:x1869685692943744:12345-192.168.204.38@tcp:38:mount.lustre.0 00010000:00080000:0.0:1783071643.948700:0:19285:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from d5c8f6e7-f12c-493c-9545-6cf978dcf267@192.168.204.38@tcp t0 exp 0000000000000000 cur 545 last 0 00000020:00000080:0.0:1783071643.948761:0:19285:0:(genops.c:1406:class_connect()) connect: client d5c8f6e7-f12c-493c-9545-6cf978dcf267, cookie 0x6b58994c2cbdd619 00000004:00100000:0.0:1783071643.948805:0:19285:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1783071643.949038:0:19285:0:(import.c:65:import_set_state_nolock()) ffff8f8a010f3800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783071643.949144:0:19285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b078d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d5c8f6e7-f12c-493c-9545-6cf978dcf267+6:2402:x1869685692943744:12345-192.168.204.38@tcp:38:mount.lustre.0 Request processed in 471us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071643.949152:0:19285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 7 00000100:00100000:0.0:1783071643.956794:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071643.956910:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692944000 00000100:00100000:2.0:1783071643.956922:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692944000 00000100:00100000:2.0:1783071643.956975:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 8 00000100:00100000:2.0:1783071643.956984:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2402:x1869685692944000:12345-192.168.204.38@tcp:38:mount.lustre.0 00010000:00080000:2.0:1783071643.957015:0:17087:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from d5c8f6e7-f12c-493c-9545-6cf978dcf267@192.168.204.38@tcp t0 exp 0000000000000000 cur 545 last 0 00000020:00000080:2.0:1783071643.957074:0:17087:0:(genops.c:1406:class_connect()) connect: client d5c8f6e7-f12c-493c-9545-6cf978dcf267, cookie 0x6b58994c2cbdd620 00000004:00100000:2.0:1783071643.957114:0:17087:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1783071643.957353:0:17087:0:(import.c:65:import_set_state_nolock()) ffff8f8a02e06800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783071643.957665:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5c8f6e7-f12c-493c-9545-6cf978dcf267+6:2402:x1869685692944000:12345-192.168.204.38@tcp:38:mount.lustre.0 Request processed in 678us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071643.957674:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 8 00000100:00100000:3.0:1783071643.962928:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071643.963048:0:19199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692943872 00000100:00100000:2.0:1783071643.963069:0:19199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692943872 00000100:00080000:1.0:1783071643.963297:0:17082:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783071643.964511:0:19199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9 00000100:00100000:2.0:1783071643.964534:0:19199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03bd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5c8f6e7-f12c-493c-9545-6cf978dcf267+6:0:x1869685692943872:12345-192.168.204.38@tcp:41:mount.lustre.0 00000004:00000024:2.0:1783071643.964579:0:19199:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1783071643.964674:0:19199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03bd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5c8f6e7-f12c-493c-9545-6cf978dcf267+6:0:x1869685692943872:12345-192.168.204.38@tcp:41:mount.lustre.0 Request processed in 149us (1757us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071643.964681:0:19199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9 00000100:00100000:0.0:1783071643.970175:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071643.970307:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692944128 00000100:00100000:2.0:1783071643.970320:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692944128 00000100:00100000:2.0:1783071643.970482:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 10 00000100:00100000:2.0:1783071643.970507:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0391e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d5c8f6e7-f12c-493c-9545-6cf978dcf267+6:0:x1869685692944128:12345-192.168.204.38@tcp:41:mount.lustre.0 00000004:00000024:2.0:1783071643.970556:0:17086:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00080000:1.0:1783071643.970923:0:17082:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783071643.971027:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0391e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d5c8f6e7-f12c-493c-9545-6cf978dcf267+6:0:x1869685692944128:12345-192.168.204.38@tcp:41:mount.lustre.0 Request processed in 534us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071643.971036:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 10 00000100:00100000:0.0:1783071643.971147:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071643.974014:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692944256 00000100:00100000:2.0:1783071643.974030:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692944256 00000100:00100000:1.0:1783071643.974183:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11 00000100:00100000:1.0:1783071643.974199:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0391f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5c8f6e7-f12c-493c-9545-6cf978dcf267+6:14905:x1869685692944256:12345-192.168.204.38@tcp:41:mount.lustre.0 00000004:00000024:1.0:1783071643.974245:0:17087:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1783071643.974360:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0391f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5c8f6e7-f12c-493c-9545-6cf978dcf267+6:14905:x1869685692944256:12345-192.168.204.38@tcp:41:mount.lustre.0 Request processed in 165us (3213us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071643.974388:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11 00000100:00100000:3.0:1783071643.982965:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071643.983132:0:19199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692944384 00000100:00100000:2.0:1783071643.983143:0:19199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692944384 00000100:00100000:2.0:1783071643.983218:0:19199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 12 00000100:00100000:2.0:1783071643.983230:0:19199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03bd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5c8f6e7-f12c-493c-9545-6cf978dcf267+6:14905:x1869685692944384:12345-192.168.204.38@tcp:40:mount.lustre.0 00000100:00100000:1.0:1783071643.984650:0:19199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03bd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5c8f6e7-f12c-493c-9545-6cf978dcf267+6:14905:x1869685692944384:12345-192.168.204.38@tcp:40:mount.lustre.0 Request processed in 1414us (1689us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071643.984664:0:19199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 12 00000100:00100000:2.0:1783071643.995254:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071643.995304:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071643.995441:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692944768 00000100:00100000:0.0:1783071643.995453:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692944768 00000100:00100000:0.0:1783071643.995574:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3 00000100:00100000:0.0:1783071643.995586:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b078d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d5c8f6e7-f12c-493c-9545-6cf978dcf267+6:14905:x1869685692944768:12345-192.168.204.38@tcp:900:mount.lustre.0 00000100:00100000:0.0:1783071643.995694:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b078d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d5c8f6e7-f12c-493c-9545-6cf978dcf267+6:14905:x1869685692944768:12345-192.168.204.38@tcp:900:mount.lustre.0 Request processed in 111us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071643.995703:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3 00000100:00100000:2.0:1783071643.995899:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071643.997862:0:18592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692944640 00000100:00100000:1.0:1783071643.997862:0:19700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692944512 00000100:00100000:3.0:1783071643.997875:0:18592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692944640 00000100:00100000:1.0:1783071643.997888:0:19700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692944512 00000100:00100000:3.0:1783071643.997961:0:18592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 16 00000100:00100000:3.0:1783071643.997970:0:18592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b078da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2402:x1869685692944640:12345-192.168.204.38@tcp:8:mount.lustre.0 00010000:00080000:3.0:1783071643.998073:0:18592:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from d5c8f6e7-f12c-493c-9545-6cf978dcf267@192.168.204.38@tcp t0 exp 0000000000000000 cur 545 last 0 00000020:00000080:3.0:1783071643.998106:0:18592:0:(genops.c:1406:class_connect()) connect: client d5c8f6e7-f12c-493c-9545-6cf978dcf267, cookie 0x6b58994c2cbdd627 00002000:00100000:3.0:1783071643.998119:0:18592:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d5c8f6e7-f12c-493c-9545-6cf978dcf267/ffff8f8a02c16000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783071643.998143:0:18592:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783071643.998308:0:18592:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1783071643.998355:0:18592:0:(import.c:65:import_set_state_nolock()) ffff8f8a02c17800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783071643.998527:0:18589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 17 00000100:00100000:0.0:1783071643.998535:0:18589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b078db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2402:x1869685692944512:12345-192.168.204.38@tcp:8:mount.lustre.0 00010000:00080000:0.0:1783071643.998554:0:18589:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from d5c8f6e7-f12c-493c-9545-6cf978dcf267@192.168.204.38@tcp t0 exp 0000000000000000 cur 545 last 0 00000100:00100000:3.0:1783071643.998644:0:18592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b078da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d5c8f6e7-f12c-493c-9545-6cf978dcf267+6:2402:x1869685692944640:12345-192.168.204.38@tcp:8:mount.lustre.0 Request processed in 673us (2745us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071643.998652:0:18592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 16 00000020:00000080:0.0:1783071643.998870:0:18589:0:(genops.c:1406:class_connect()) connect: client d5c8f6e7-f12c-493c-9545-6cf978dcf267, cookie 0x6b58994c2cbdd62e 00002000:00100000:0.0:1783071643.998878:0:18589:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d5c8f6e7-f12c-493c-9545-6cf978dcf267/ffff8f8a010f4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783071643.998891:0:18589:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783071643.999084:0:18589:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1783071643.999104:0:18589:0:(import.c:65:import_set_state_nolock()) ffff8f8a010f5800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783071643.999138:0:18589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b078db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d5c8f6e7-f12c-493c-9545-6cf978dcf267+6:2402:x1869685692944512:12345-192.168.204.38@tcp:8:mount.lustre.0 Request processed in 603us (3833us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071643.999159:0:18589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 17 00000100:00100000:3.0:1783071644.010290:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071644.010469:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692944896 00000100:00100000:0.0:1783071644.010481:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692944896 00000100:00100000:0.0:1783071644.010561:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 0 00000100:00100000:0.0:1783071644.010573:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03af2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d5c8f6e7-f12c-493c-9545-6cf978dcf267+6:14905:x1869685692944896:12345-192.168.204.38@tcp:33:mount.lustre.0 00000004:00080000:0.0:1783071644.012179:0:17088:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1499us 00000004:00200000:1.0:1783071644.026542:0:17088:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1783071644.026745:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03af2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d5c8f6e7-f12c-493c-9545-6cf978dcf267+6:14905:x1869685692944896:12345-192.168.204.38@tcp:33:mount.lustre.0 Request processed in 16169us (16460us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071644.026761:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 0 00000100:00100000:2.0:1783071644.167749:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071644.167833:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692945024 00000100:00100000:3.0:1783071644.167845:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692945024 00000100:00100000:3.0:1783071644.167912:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 13 00000100:00100000:3.0:1783071644.167923:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b078dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d5c8f6e7-f12c-493c-9545-6cf978dcf267+6:14951:x1869685692945024:12345-192.168.204.38@tcp:101:mkdir.0 00010000:00010000:3.0:1783071644.167946:0:17086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071644.167972:0:17086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461800/0x6b58994c2cbdd635 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d991cb expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071644.168085:0:17086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460a00/0x6b58994c2cbdd63c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071644.168100:0:17086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460a00/0x6b58994c2cbdd63c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071644.168116:0:17086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460a00/0x6b58994c2cbdd63c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783071644.168173:0:17086:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783071644.168177:0:17086:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783071644.176765:0:17086:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460a00/0x6b58994c2cbdd63c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071644.177817:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461800/0x6b58994c2cbdd635 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d991cb expref: 8 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071644.177848:0:17086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460a00/0x6b58994c2cbdd63c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d991cb expref: 7 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071644.177858:0:17086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8b34e19800) 00010000:00010000:3.0:1783071644.177861:0:17086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783071644.177865:0:17086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b3c460a00, rc 0) 00000100:00100000:3.0:1783071644.177960:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b078dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d5c8f6e7-f12c-493c-9545-6cf978dcf267+7:14951:x1869685692945024:12345-192.168.204.38@tcp:101:mkdir.0 Request processed in 10037us (10219us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071644.177970:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 13 00010000:00010000:1.0:1783071644.613639:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071645.508215:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0391ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707700864:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783071645.508305:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071645.508410:0:18593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707700864 00000100:00100000:1.0:1783071645.508422:0:18593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707700864 00000100:00080000:3.0:1783071645.508469:0:17082:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783071645.508499:0:18593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783071645.508510:0:18593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03af2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707700864:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783071645.508543:0:18593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783071645.508601:0:18593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03af2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707700864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071645.508609:0:18593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783071645.508802:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0391ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707700864:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1783071645.635313:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071645.987849:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071645.988891:0:19285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692945152 00000100:00100000:0.0:1783071645.988905:0:19285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692945152 00000100:00100000:0.0:1783071645.989013:0:19285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 14 00000100:00100000:0.0:1783071645.989035:0:19285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0411ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d5c8f6e7-f12c-493c-9545-6cf978dcf267+7:15004:x1869685692945152:12345-192.168.204.38@tcp:41:lfs.0 00000004:00000024:0.0:1783071645.989087:0:19285:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1783071645.989187:0:19285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0411ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d5c8f6e7-f12c-493c-9545-6cf978dcf267+7:15004:x1869685692945152:12345-192.168.204.38@tcp:41:lfs.0 Request processed in 164us (1348us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071645.989194:0:19285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 14 00000100:00080000:3.0:1783071645.989627:0:17082:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783071645.995548:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071645.995668:0:19199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692945280 00000100:00100000:1.0:1783071645.995682:0:19199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692945280 00000100:00100000:1.0:1783071645.995771:0:19199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 15 00000100:00100000:1.0:1783071645.995782:0:19199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b078d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5c8f6e7-f12c-493c-9545-6cf978dcf267+6:15004:x1869685692945280:12345-192.168.204.38@tcp:41:lfs.0 00000004:00000024:1.0:1783071645.995827:0:19199:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1783071645.995960:0:19199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b078d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5c8f6e7-f12c-493c-9545-6cf978dcf267+6:15004:x1869685692945280:12345-192.168.204.38@tcp:41:lfs.0 Request processed in 179us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071645.995968:0:19199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 15 00000100:00080000:3.0:1783071645.996465:0:17082:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783071645.998844:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071645.998948:0:18593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692945408 00000100:00100000:1.0:1783071645.998958:0:18593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692945408 00000100:00100000:1.0:1783071645.999161:0:18593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 6 00000100:00100000:1.0:1783071645.999171:0:18593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b078da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d5c8f6e7-f12c-493c-9545-6cf978dcf267+6:15004:x1869685692945408:12345-192.168.204.38@tcp:13:lfs.0 00002000:00000024:1.0:1783071645.999197:0:18593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783071645.999298:0:18593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b078da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d5c8f6e7-f12c-493c-9545-6cf978dcf267+6:15004:x1869685692945408:12345-192.168.204.38@tcp:13:lfs.0 Request processed in 128us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071645.999306:0:18593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 6 00000100:00080000:3.0:1783071646.000176:0:17082:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783071646.001001:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071646.001199:0:18593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692945536 00000100:00100000:3.0:1783071646.001208:0:18593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692945536 00000100:00100000:3.0:1783071646.001273:0:18593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 7 00000100:00100000:3.0:1783071646.001283:0:18593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c78ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d5c8f6e7-f12c-493c-9545-6cf978dcf267+6:15004:x1869685692945536:12345-192.168.204.38@tcp:13:lfs.0 00002000:00000024:3.0:1783071646.001327:0:18593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1783071646.001443:0:18593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c78ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d5c8f6e7-f12c-493c-9545-6cf978dcf267+6:15004:x1869685692945536:12345-192.168.204.38@tcp:13:lfs.0 Request processed in 161us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071646.001451:0:18593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 7 00000100:00080000:1.0:1783071646.002575:0:17082:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783071646.019047:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b078db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707700992:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783071646.019158:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0411c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707701120:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783071646.019279:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071646.019579:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707701120 00000100:00100000:2.0:1783071646.019587:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707701120 00000100:00100000:2.0:1783071646.019796:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783071646.019807:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0391ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707701120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783071646.019835:0:17090:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1783071646.019888:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0391ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707701120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071646.019895:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783071646.019943:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0411c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707701120:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783071646.020078:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071646.020565:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707700992 00000100:00100000:2.0:1783071646.020583:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707700992 00000100:00100000:2.0:1783071646.020619:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783071646.020626:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c78e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707700992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783071646.020644:0:17091:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1783071646.020692:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c78e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707700992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 66us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071646.020699:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783071646.020889:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b078db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707700992:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783071646.155691:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071646.155968:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692945664 00000100:00100000:1.0:1783071646.155983:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692945664 00000100:00100000:1.0:1783071646.156060:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 130 00000100:00100000:1.0:1783071646.157245:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3eb93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f80a971-9117-430f-93b5-a8b601517f46+10:15038:x1869685692945664:12345-192.168.204.38@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783071646.157272:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071646.157295:0:17079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8a03bd7800/0x6b58994c2cbdd643 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d991d2 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071646.157326:0:17079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8a03bd7800/0x6b58994c2cbdd643 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d991d2 expref: 11 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071646.157337:0:17079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8a03bd7800/0x6b58994c2cbdd643 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d991d2 expref: 11 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071646.157347:0:17079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a03bd7800, rc 0) 00000100:00100000:1.0:1783071646.157431:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3eb93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f80a971-9117-430f-93b5-a8b601517f46+11:15038:x1869685692945664:12345-192.168.204.38@tcp:101:mount.lustre.0 Request processed in 1363us (1754us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071646.157439:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 130 00000100:00100000:0.0:1783071646.165532:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071646.165766:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692945792 00000100:00100000:1.0:1783071646.165777:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692945792 00000100:00100000:1.0:1783071646.165841:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 131 00000100:00100000:1.0:1783071646.165865:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3eb90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f80a971-9117-430f-93b5-a8b601517f46+11:15038:x1869685692945792:12345-192.168.204.38@tcp:501:mount.lustre.0 00000100:00100000:1.0:1783071646.166056:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3eb90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f80a971-9117-430f-93b5-a8b601517f46+11:15038:x1869685692945792:12345-192.168.204.38@tcp:501:mount.lustre.0 Request processed in 190us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071646.166066:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 131 00000100:00100000:3.0:1783071646.167223:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071646.167434:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692945920 00000100:00100000:1.0:1783071646.167442:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692945920 00000100:00100000:1.0:1783071646.167493:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 132 00000100:00100000:1.0:1783071646.167502:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3eb91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f80a971-9117-430f-93b5-a8b601517f46+11:15038:x1869685692945920:12345-192.168.204.38@tcp:503:mount.lustre.0 00000100:00100000:1.0:1783071646.167646:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3eb91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f80a971-9117-430f-93b5-a8b601517f46+11:15038:x1869685692945920:12345-192.168.204.38@tcp:503:mount.lustre.0 Request processed in 145us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071646.167654:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 132 00000100:00100000:0.0:1783071646.174985:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071646.176139:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692946048 00000100:00100000:2.0:1783071646.176153:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692946048 00000100:00100000:2.0:1783071646.176232:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 133 00000100:00100000:2.0:1783071646.176259:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3eb93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f80a971-9117-430f-93b5-a8b601517f46+11:15043:x1869685692946048:12345-192.168.204.38@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783071646.176463:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3eb93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f80a971-9117-430f-93b5-a8b601517f46+11:15043:x1869685692946048:12345-192.168.204.38@tcp:502:llog_process_th.0 Request processed in 207us (1489us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071646.176471:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 133 00000100:00100000:0.0:1783071646.201993:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071646.202115:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692946176 00000100:00100000:3.0:1783071646.202126:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692946176 00000100:00100000:3.0:1783071646.202201:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 134 00000100:00100000:3.0:1783071646.202212:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3eb92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f80a971-9117-430f-93b5-a8b601517f46+11:15043:x1869685692946176:12345-192.168.204.38@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783071646.202902:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3eb92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f80a971-9117-430f-93b5-a8b601517f46+11:15043:x1869685692946176:12345-192.168.204.38@tcp:502:llog_process_th.0 Request processed in 687us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071646.202913:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 134 00000100:00100000:0.0:1783071646.210424:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071646.210563:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692946304 00000100:00100000:3.0:1783071646.210574:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692946304 00000100:00100000:3.0:1783071646.210651:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 135 00000100:00100000:3.0:1783071646.210662:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3eb91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f80a971-9117-430f-93b5-a8b601517f46+11:15043:x1869685692946304:12345-192.168.204.38@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783071646.210955:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3eb91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f80a971-9117-430f-93b5-a8b601517f46+11:15043:x1869685692946304:12345-192.168.204.38@tcp:502:llog_process_th.0 Request processed in 293us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071646.210963:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 135 00000100:00100000:0.0:1783071646.218961:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071646.219182:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692946432 00000100:00100000:3.0:1783071646.219193:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692946432 00000100:00100000:3.0:1783071646.219256:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 136 00000100:00100000:3.0:1783071646.219267:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3eb92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f80a971-9117-430f-93b5-a8b601517f46+11:15038:x1869685692946432:12345-192.168.204.38@tcp:101:mount.lustre.0 00010000:00010000:3.0:1783071646.219284:0:17078:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071646.219301:0:17078:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b3c461800/0x6b58994c2cbdd64a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d99203 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071646.219333:0:17078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b3c461800/0x6b58994c2cbdd64a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99203 expref: 12 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071646.219344:0:17078:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b3c461800/0x6b58994c2cbdd64a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99203 expref: 12 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071646.219354:0:17078:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b3c461800, rc 0) 00000100:00100000:3.0:1783071646.219460:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3eb92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f80a971-9117-430f-93b5-a8b601517f46+12:15038:x1869685692946432:12345-192.168.204.38@tcp:101:mount.lustre.0 Request processed in 195us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071646.219468:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 136 00000100:00100000:0.0:1783071646.223026:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071646.223385:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692946560 00000100:00100000:3.0:1783071646.223395:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692946560 00000100:00100000:3.0:1783071646.223454:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 137 00000100:00100000:3.0:1783071646.223465:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03813050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f80a971-9117-430f-93b5-a8b601517f46+12:15038:x1869685692946560:12345-192.168.204.38@tcp:256:mount.lustre.0 20000000:01000000:3.0:1783071646.223520:0:17079:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1783071646.223539:0:17079:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1783071646.223544:0:17079:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1783071646.223547:0:17079:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1783071646.223549:0:17079:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1783071646.223551:0:17079:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:3.0:1783071646.226765:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03813050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f80a971-9117-430f-93b5-a8b601517f46+12:15038:x1869685692946560:12345-192.168.204.38@tcp:256:mount.lustre.0 Request processed in 3290us (3748us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071646.226780:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 137 00000100:00100000:2.0:1783071646.231427:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071646.231569:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692946688 00000100:00100000:1.0:1783071646.231579:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692946688 00000100:00100000:1.0:1783071646.231640:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 138 00000100:00100000:1.0:1783071646.231649:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03812450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f80a971-9117-430f-93b5-a8b601517f46+12:15038:x1869685692946688:12345-192.168.204.38@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783071646.231665:0:17081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071646.231681:0:17081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8a03bd7000/0x6b58994c2cbdd651 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d9920a expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071646.231707:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8a03bd7000/0x6b58994c2cbdd651 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9920a expref: 13 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071646.231716:0:17081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8a03bd7000/0x6b58994c2cbdd651 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9920a expref: 13 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071646.231725:0:17081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a03bd7000, rc 0) 00000100:00100000:1.0:1783071646.231795:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03812450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f80a971-9117-430f-93b5-a8b601517f46+13:15038:x1869685692946688:12345-192.168.204.38@tcp:101:mount.lustre.0 Request processed in 146us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071646.231802:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 138 00000100:00100000:0.0:1783071646.234350:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071646.234446:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692946816 00000100:00100000:3.0:1783071646.234454:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692946816 00000100:00100000:3.0:1783071646.234514:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 139 00000100:00100000:3.0:1783071646.234524:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03810850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f80a971-9117-430f-93b5-a8b601517f46+13:15038:x1869685692946816:12345-192.168.204.38@tcp:501:mount.lustre.0 00000100:00100000:3.0:1783071646.234724:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03810850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f80a971-9117-430f-93b5-a8b601517f46+13:15038:x1869685692946816:12345-192.168.204.38@tcp:501:mount.lustre.0 Request processed in 200us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071646.234731:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 139 00000100:00100000:3.0:1783071646.238319:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071646.239422:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692946944 00000100:00100000:0.0:1783071646.239457:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692946944 00000100:00100000:0.0:1783071646.239531:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 140 00000100:00100000:0.0:1783071646.239542:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03812050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f80a971-9117-430f-93b5-a8b601517f46+13:15038:x1869685692946944:12345-192.168.204.38@tcp:503:mount.lustre.0 00000100:00100000:0.0:1783071646.239700:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03812050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f80a971-9117-430f-93b5-a8b601517f46+13:15038:x1869685692946944:12345-192.168.204.38@tcp:503:mount.lustre.0 Request processed in 159us (1393us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071646.239708:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 140 00000100:00100000:2.0:1783071646.245511:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071646.245706:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692947072 00000100:00100000:1.0:1783071646.245717:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692947072 00000100:00100000:1.0:1783071646.245780:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 141 00000100:00100000:1.0:1783071646.245791:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03811450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f80a971-9117-430f-93b5-a8b601517f46+13:15048:x1869685692947072:12345-192.168.204.38@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783071646.245962:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03811450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f80a971-9117-430f-93b5-a8b601517f46+13:15048:x1869685692947072:12345-192.168.204.38@tcp:502:llog_process_th.0 Request processed in 171us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071646.245971:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 141 00000100:00100000:2.0:1783071646.255839:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071646.255941:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692947200 00000100:00100000:3.0:1783071646.255952:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692947200 00000100:00100000:3.0:1783071646.256025:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 142 00000100:00100000:3.0:1783071646.256036:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03812850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f80a971-9117-430f-93b5-a8b601517f46+13:15048:x1869685692947200:12345-192.168.204.38@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783071646.256218:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03812850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f80a971-9117-430f-93b5-a8b601517f46+13:15048:x1869685692947200:12345-192.168.204.38@tcp:502:llog_process_th.0 Request processed in 184us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071646.256227:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 142 00000100:00100000:3.0:1783071646.272807:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071646.273140:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071646.273489:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692947328 00000100:00100000:2.0:1783071646.273501:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692947328 00000100:00100000:2.0:1783071646.273546:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692947584 00000100:00100000:2.0:1783071646.273550:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692947584 00000100:00100000:2.0:1783071646.273576:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 16 00000100:00100000:2.0:1783071646.273584:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0411e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2402:x1869685692947328:12345-192.168.204.38@tcp:38:mount.lustre.0 00010000:00080000:2.0:1783071646.273615:0:17086:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 16c37387-7795-4f66-bf99-555c21a639fc@192.168.204.38@tcp t0 exp 0000000000000000 cur 548 last 0 00000020:00000080:2.0:1783071646.273666:0:17086:0:(genops.c:1406:class_connect()) connect: client 16c37387-7795-4f66-bf99-555c21a639fc, cookie 0x6b58994c2cbdd658 00000004:00100000:2.0:1783071646.273690:0:17086:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1783071646.273759:0:17085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 17 00000100:00100000:1.0:1783071646.273766:0:17085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0411d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2402:x1869685692947584:12345-192.168.204.38@tcp:38:mount.lustre.0 00010000:00080000:1.0:1783071646.273782:0:17085:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from 16c37387-7795-4f66-bf99-555c21a639fc@192.168.204.38@tcp t0 exp 0000000000000000 cur 548 last 0 00000100:00080000:2.0:1783071646.273793:0:17086:0:(import.c:65:import_set_state_nolock()) ffff8f8a02e02000 : changing import state from RECOVER to FULL 00000020:00000080:1.0:1783071646.273807:0:17085:0:(genops.c:1406:class_connect()) connect: client 16c37387-7795-4f66-bf99-555c21a639fc, cookie 0x6b58994c2cbdd65f 00000004:00100000:1.0:1783071646.273819:0:17085:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1783071646.273862:0:17085:0:(import.c:65:import_set_state_nolock()) ffff8f8a02dd0000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783071646.273864:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0411e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16c37387-7795-4f66-bf99-555c21a639fc+6:2402:x1869685692947328:12345-192.168.204.38@tcp:38:mount.lustre.0 Request processed in 280us (1069us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071646.273872:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 16 00000100:00100000:1.0:1783071646.273885:0:17085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0411d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16c37387-7795-4f66-bf99-555c21a639fc+6:2402:x1869685692947584:12345-192.168.204.38@tcp:38:mount.lustre.0 Request processed in 119us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071646.273892:0:17085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 17 00000100:00100000:2.0:1783071646.293436:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071646.293484:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071646.293621:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071646.294455:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692947840 00000100:00100000:3.0:1783071646.294467:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692947840 00000100:00100000:3.0:1783071646.294541:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692947712 00000100:00100000:3.0:1783071646.294545:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692947712 00000100:00100000:3.0:1783071646.294564:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692947456 00000100:00100000:3.0:1783071646.294566:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692947456 00000100:00100000:3.0:1783071646.294595:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18 00000100:00100000:3.0:1783071646.294605:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b078daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16c37387-7795-4f66-bf99-555c21a639fc+7:15038:x1869685692947840:12345-192.168.204.38@tcp:41:mount.lustre.0 00000004:00000024:3.0:1783071646.294643:0:17086:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1783071646.294714:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b078daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16c37387-7795-4f66-bf99-555c21a639fc+7:15038:x1869685692947840:12345-192.168.204.38@tcp:41:mount.lustre.0 Request processed in 110us (1288us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071646.294722:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18 00000100:00100000:3.0:1783071646.294739:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19 00000100:00100000:3.0:1783071646.294745:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b078db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16c37387-7795-4f66-bf99-555c21a639fc+6:0:x1869685692947712:12345-192.168.204.38@tcp:41:mount.lustre.0 00000004:00000024:3.0:1783071646.294763:0:17086:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1783071646.294787:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b078db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16c37387-7795-4f66-bf99-555c21a639fc+6:0:x1869685692947712:12345-192.168.204.38@tcp:41:mount.lustre.0 Request processed in 42us (1303us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071646.294793:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19 00000100:00100000:3.0:1783071646.294803:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 20 00000100:00100000:3.0:1783071646.294809:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02e40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16c37387-7795-4f66-bf99-555c21a639fc+6:0:x1869685692947456:12345-192.168.204.38@tcp:41:mount.lustre.0 00000004:00000024:3.0:1783071646.294821:0:17086:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1783071646.294841:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02e40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16c37387-7795-4f66-bf99-555c21a639fc+6:0:x1869685692947456:12345-192.168.204.38@tcp:41:mount.lustre.0 Request processed in 32us (1221us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071646.294848:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 20 00000100:00080000:2.0:1783071646.295523:0:17082:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783071646.295529:0:17082:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783071646.306420:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071646.306705:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692947968 00000100:00100000:3.0:1783071646.306716:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692947968 00000100:00100000:3.0:1783071646.306780:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 21 00000100:00100000:3.0:1783071646.306789:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02e42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16c37387-7795-4f66-bf99-555c21a639fc+6:15038:x1869685692947968:12345-192.168.204.38@tcp:40:mount.lustre.0 00000100:00100000:3.0:1783071646.306923:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02e42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16c37387-7795-4f66-bf99-555c21a639fc+6:15038:x1869685692947968:12345-192.168.204.38@tcp:40:mount.lustre.0 Request processed in 134us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071646.306940:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 21 00000100:00100000:3.0:1783071646.312621:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071646.312673:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071646.312713:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071646.312813:0:19700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692948096 00000100:00100000:0.0:1783071646.312834:0:19700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692948096 00000100:00100000:0.0:1783071646.312876:0:19700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692948224 00000100:00100000:0.0:1783071646.312880:0:19700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692948224 00000100:00100000:0.0:1783071646.312902:0:19700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18 00000100:00100000:0.0:1783071646.312911:0:19700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0411ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2402:x1869685692948096:12345-192.168.204.38@tcp:8:mount.lustre.0 00010000:00080000:0.0:1783071646.312947:0:19700:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 16c37387-7795-4f66-bf99-555c21a639fc@192.168.204.38@tcp t0 exp 0000000000000000 cur 548 last 0 00000020:00000080:0.0:1783071646.312990:0:19700:0:(genops.c:1406:class_connect()) connect: client 16c37387-7795-4f66-bf99-555c21a639fc, cookie 0x6b58994c2cbdd666 00002000:00100000:0.0:1783071646.313003:0:19700:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 16c37387-7795-4f66-bf99-555c21a639fc/ffff8f8b069d8000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783071646.313024:0:19700:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1783071646.313038:0:19286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19 00000100:00100000:2.0:1783071646.313045:0:19286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0411d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2402:x1869685692948224:12345-192.168.204.38@tcp:8:mount.lustre.0 00010000:00080000:2.0:1783071646.313062:0:19286:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 16c37387-7795-4f66-bf99-555c21a639fc@192.168.204.38@tcp t0 exp 0000000000000000 cur 548 last 0 00000020:00000080:2.0:1783071646.313080:0:19286:0:(genops.c:1406:class_connect()) connect: client 16c37387-7795-4f66-bf99-555c21a639fc, cookie 0x6b58994c2cbdd66d 00002000:00100000:2.0:1783071646.313085:0:19286:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 16c37387-7795-4f66-bf99-555c21a639fc/ffff8f8a02e03000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783071646.313091:0:19286:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783071646.313129:0:19700:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00002000:00080000:2.0:1783071646.313143:0:19286:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1783071646.313163:0:19286:0:(import.c:65:import_set_state_nolock()) ffff8f8a02e00800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1783071646.313163:0:19700:0:(import.c:65:import_set_state_nolock()) ffff8f8b2b3b7000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783071646.313229:0:19286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0411d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:16c37387-7795-4f66-bf99-555c21a639fc+6:2402:x1869685692948224:12345-192.168.204.38@tcp:8:mount.lustre.0 Request processed in 182us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071646.313237:0:19286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19 00000100:00100000:1.0:1783071646.313403:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692948352 00000100:00100000:1.0:1783071646.313408:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692948352 00000100:00100000:1.0:1783071646.313442:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 4 00000100:00100000:1.0:1783071646.313450:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0411f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:16c37387-7795-4f66-bf99-555c21a639fc+6:15038:x1869685692948352:12345-192.168.204.38@tcp:900:mount.lustre.0 00000100:00100000:0.0:1783071646.316596:0:19700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0411ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:16c37387-7795-4f66-bf99-555c21a639fc+6:2402:x1869685692948096:12345-192.168.204.38@tcp:8:mount.lustre.0 Request processed in 3671us (3908us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071646.316612:0:19700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18 00000001:00100000:3.0:1783071646.317141:0:19406:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 16c37387-7795-4f66-bf99-555c21a639fc 00000001:00100000:3.0:1783071646.317153:0:19406:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d5c8f6e7-f12c-493c-9545-6cf978dcf267 00000001:00080000:3.0:1783071646.317547:0:19406:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000100:00100000:1.0:1783071646.317681:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0411f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:16c37387-7795-4f66-bf99-555c21a639fc+6:15038:x1869685692948352:12345-192.168.204.38@tcp:900:mount.lustre.0 Request processed in 4227us (5068us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071646.317706:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 4 00000100:00100000:2.0:1783071646.320764:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071646.320891:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692948480 00000100:00100000:1.0:1783071646.320901:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692948480 00000100:00100000:1.0:1783071646.321081:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1 00000100:00100000:1.0:1783071646.321103:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:16c37387-7795-4f66-bf99-555c21a639fc+6:15038:x1869685692948480:12345-192.168.204.38@tcp:33:mount.lustre.0 00000004:00200000:1.0:1783071646.321217:0:17089:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1783071646.321318:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:16c37387-7795-4f66-bf99-555c21a639fc+6:15038:x1869685692948480:12345-192.168.204.38@tcp:33:mount.lustre.0 Request processed in 227us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071646.321326:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1 00000100:00100000:2.0:1783071646.465002:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071646.467982:0:19285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692948608 00000100:00100000:3.0:1783071646.467998:0:19285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692948608 00000100:00100000:3.0:1783071646.468100:0:19285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 22 00000100:00100000:3.0:1783071646.468111:0:19285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16c37387-7795-4f66-bf99-555c21a639fc+6:15071:x1869685692948608:12345-192.168.204.38@tcp:101:mkdir.0 00010000:00010000:3.0:1783071646.468134:0:19285:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071646.468154:0:19285:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461600/0x6b58994c2cbdd674 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d9923b expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071646.468227:0:19285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461200/0x6b58994c2cbdd67b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071646.468242:0:19285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461200/0x6b58994c2cbdd67b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071646.468254:0:19285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461200/0x6b58994c2cbdd67b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783071646.468319:0:19285:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783071646.468323:0:19285:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783071646.468343:0:19285:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461200/0x6b58994c2cbdd67b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071646.468397:0:19285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461600/0x6b58994c2cbdd674 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9923b expref: 8 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071646.468418:0:19285:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461200/0x6b58994c2cbdd67b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9923b expref: 7 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071646.468426:0:19285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8b34e19800) 00010000:00010000:3.0:1783071646.468429:0:19285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783071646.468432:0:19285:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b3c461200, rc 0) 00000100:00100000:3.0:1783071646.468587:0:19285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16c37387-7795-4f66-bf99-555c21a639fc+7:15071:x1869685692948608:12345-192.168.204.38@tcp:101:mkdir.0 Request processed in 477us (3597us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071646.468596:0:19285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 22 00000100:00100000:3.0:1783071646.530627:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0391c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ed14122-6273-4ec6-b260-6e79c239c375:3648:1869685707701376:0@lo:400:kworker.0 00000100:00100000:3.0:1783071646.530709:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071646.530759:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783071646.530980:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03a9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707701248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783071646.531026:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071646.531063:0:18593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707701248 00000100:00100000:3.0:1783071646.531070:0:18593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707701248 00000100:00100000:1.0:1783071646.531088:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707701504:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783071646.531124:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071646.531142:0:18593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783071646.531154:0:18593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0411c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707701248:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783071646.531183:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783071646.531191:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707701632:0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783071646.531213:0:18593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1783071646.531220:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071646.531251:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707701376 00000100:00100000:1.0:1783071646.531256:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707701376 00000100:00100000:3.0:1783071646.531269:0:18593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0411c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707701248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071646.531278:0:18593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783071646.531290:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1783071646.531298:0:18593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707701504 00000100:00100000:1.0:1783071646.531300:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03811050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+24:3648:x1869685707701376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071646.531304:0:18593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707701504 00000100:00100000:3.0:1783071646.531327:0:18593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707701632 00000100:00100000:3.0:1783071646.531330:0:18593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707701632 00000100:00100000:1.0:1783071646.531345:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03811050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+24:3648:x1869685707701376:12345-0@lo:400:kworker.0 Request processed in 46us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071646.531351:0:18593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783071646.531356:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1783071646.531361:0:18593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c78ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707701504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783071646.531394:0:18593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00080000:1.0:1783071646.531422:0:17082:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783071646.531432:0:18593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c78ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707701504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (306us total) trans 0 rc 0/0 00000100:00080000:1.0:1783071646.531432:0:17082:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783071646.531441:0:18593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783071646.531459:0:18593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783071646.531468:0:18593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c78e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707701632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783071646.531479:0:18593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783071646.531484:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707701504:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783071646.531516:0:18593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c78e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707701632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071646.531521:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707701632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783071646.531526:0:18593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783071646.531554:0:3648:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:3.0:1783071646.531573:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03a9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707701248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783071646.531597:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0391c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ed14122-6273-4ec6-b260-6e79c239c375:3648:1869685707701376:0@lo:400:kworker.0 00000100:00100000:0.0:1783071646.531827:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0391ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707702144:0@lo:400:kworker.0 00000100:00100000:1.0:1783071646.531852:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0391d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707702016:0@lo:400:kworker.0 00000100:00100000:0.0:1783071646.531862:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071646.531889:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0391ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1869685707702656:0@lo:400:kworker.0 00000100:00100000:1.0:1783071646.531892:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071646.531919:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0391c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1869685707702528:0@lo:400:kworker.0 00000100:00100000:0.0:1783071646.531930:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071646.531972:0:18589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707702144 00000100:00100000:0.0:1783071646.531976:0:18589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707702144 00000100:00100000:0.0:1783071646.532006:0:18589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783071646.532024:0:18589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0391d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707702144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071646.532068:0:18589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0391d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707702144:12345-0@lo:400:kworker.0 Request processed in 55us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071646.532076:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071646.532080:0:18589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783071646.532108:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0391ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707702144:0@lo:400:kworker.0 00000100:00100000:0.0:1783071646.532127:0:17085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707702656 00000100:00100000:0.0:1783071646.532144:0:17085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707702656 00000100:00100000:0.0:1783071646.532187:0:17085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707702528 00000100:00100000:0.0:1783071646.532191:0:17085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707702528 00000100:00100000:1.0:1783071646.532351:0:19199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783071646.532383:0:19199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0391fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869685707702656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071646.532386:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0391e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707701760:0@lo:400:kworker.0 00000100:00100000:0.0:1783071646.532412:0:17085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783071646.532421:0:17085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c78c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1869685707702528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071646.532431:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071646.532442:0:19199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0391fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869685707702656:12345-0@lo:400:kworker.0 Request processed in 81us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071646.532449:0:19199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1783071646.532479:0:17082:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783071646.532484:0:17082:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783071646.532496:0:17825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707702016 00000100:00100000:3.0:1783071646.532500:0:17825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707702016 00000100:00100000:1.0:1783071646.532522:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0391ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1869685707702656:0@lo:400:kworker.0 00000100:00100000:3.0:1783071646.532530:0:17825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707701760 00000100:00100000:3.0:1783071646.532540:0:17825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707701760 00000100:00100000:1.0:1783071646.532562:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783071646.532572:0:17825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783071646.532573:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c78d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707702016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071646.532586:0:17825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707701760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071646.532975:0:17085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c78c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1869685707702528:12345-0@lo:400:kworker.0 Request processed in 555us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071646.532983:0:17085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1783071646.533024:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a0391c700 x1869685707702528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071662 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071646.533035:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0391c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1869685707702528:0@lo:400:kworker.0 00000100:00100000:0.0:1783071646.533083:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0391dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869685707701888:0@lo:400:kworker.0 00000100:00100000:0.0:1783071646.533110:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071646.533189:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0391c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1869685707702400:0@lo:400:kworker.0 00000100:00100000:0.0:1783071646.533289:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071646.533319:0:19199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707701888 00000100:00100000:0.0:1783071646.533323:0:19199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707701888 00000100:00100000:0.0:1783071646.533353:0:19199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707702400 00000100:00100000:0.0:1783071646.533356:0:19199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707702400 00000100:00100000:0.0:1783071646.533408:0:19199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783071646.533413:0:19199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0391c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869685707701888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071646.533451:0:19199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0391c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869685707701888:12345-0@lo:400:kworker.0 Request processed in 37us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071646.533457:0:19199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783071646.533470:0:19199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783071646.533476:0:19199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0391ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869685707702400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071646.533501:0:19199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0391ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869685707702400:12345-0@lo:400:kworker.0 Request processed in 26us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071646.533507:0:19199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1783071646.533520:0:17082:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783071646.533541:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0391dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869685707701888:0@lo:400:kworker.0 00000100:00100000:0.0:1783071646.533551:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0391c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1869685707702400:0@lo:400:kworker.0 00000100:00100000:3.0:1783071646.534122:0:17825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707701760:12345-0@lo:400:kworker.0 Request processed in 1536us (1688us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071646.534316:0:17825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783071646.534322:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0391e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707701760:0@lo:400:kworker.0 00000100:00100000:2.0:1783071646.534333:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0391d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869685707702272:0@lo:400:kworker.0 00000100:00100000:2.0:1783071646.534391:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071646.534421:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0391f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1869685707702784:0@lo:400:kworker.0 00000100:00100000:0.0:1783071646.534430:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707702272 00000100:00100000:0.0:1783071646.534435:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707702272 00000100:00100000:2.0:1783071646.534444:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071646.534469:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707702784 00000100:00100000:0.0:1783071646.534473:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707702784 00000100:00080000:2.0:1783071646.534497:0:17082:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783071646.534499:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783071646.534505:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a032e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869685707702272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071646.534509:0:17085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783071646.534514:0:17085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0397ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869685707702784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071646.534549:0:17085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0397ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869685707702784:12345-0@lo:400:kworker.0 Request processed in 35us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071646.534551:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a032e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869685707702272:12345-0@lo:400:kworker.0 Request processed in 47us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071646.534558:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783071646.534561:0:17085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783071646.534584:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0391d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869685707702272:0@lo:400:kworker.0 00010000:00080000:2.0:1783071646.534595:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a0391f100 x1869685707702784/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071662 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071646.534606:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0391f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1869685707702784:0@lo:400:kworker.0 00000100:00100000:1.0:1783071646.534784:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c78d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707702016:12345-0@lo:400:kworker.0 Request processed in 2213us (2894us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071646.534792:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783071646.534867:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0391d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707702016:0@lo:400:kworker.0 00010000:00010000:2.0:1783071646.658779:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071647.683049:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1783071648.068971:0:18586:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 16c37387-7795-4f66-bf99-555c21a639fc 00000001:00100000:0.0:1783071648.069003:0:18586:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d5c8f6e7-f12c-493c-9545-6cf978dcf267 00000040:00080000:1.0:1783071648.131034:0:17119:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:2.0:1783071648.677015:0:19962:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1783071648.707557:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071649.730788:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783071650.116709:0:17066:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 16c37387-7795-4f66-bf99-555c21a639fc 00000001:00100000:1.0:1783071650.116723:0:17066:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d5c8f6e7-f12c-493c-9545-6cf978dcf267 00000001:00100000:0.0:1783071650.119749:0:17817:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 16c37387-7795-4f66-bf99-555c21a639fc 00000001:00100000:0.0:1783071650.119761:0:17817:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of d5c8f6e7-f12c-493c-9545-6cf978dcf267 00000100:00100000:1.0:1783071650.626845:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0411f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707702912:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783071650.626918:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071650.627025:0:18594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707702912 00000100:00100000:3.0:1783071650.627033:0:18594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707702912 00000100:00100000:3.0:1783071650.627098:0:18594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783071650.627109:0:18594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c78c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707702912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783071650.627139:0:18594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1783071650.627194:0:18594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c78c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707702912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071650.627201:0:18594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1783071650.627258:0:17082:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783071650.627521:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0411f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707702912:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1783071650.754983:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071651.138697:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0411ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707703040:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783071651.138776:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071651.138844:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707703040 00000100:00100000:0.0:1783071651.138852:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707703040 00000100:00100000:0.0:1783071651.138918:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783071651.138937:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0391d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707703040:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783071651.138978:0:17091:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1783071651.139026:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0391d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707703040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071651.139033:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783071651.139080:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0411ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707703040:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783071651.141772:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0411f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707703168:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783071651.141842:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071651.141919:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707703168 00000100:00100000:3.0:1783071651.141935:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707703168 00000100:00100000:3.0:1783071651.141980:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783071651.141988:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0411e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707703168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783071651.142020:0:17090:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1783071651.142062:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0411e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707703168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071651.142069:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783071651.142110:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0411f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707703168:0@lo:41:osp-pre-0-1.0 00000020:00000080:2.0:1783071651.153618:0:20110:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffec0e74ca0 20000000:00000080:2.0:1783071651.153636:0:20110:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f8b3af69400 uarg=0000000000000000 20000000:01000000:2.0:1783071651.153676:0:20110:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1783071651.153682:0:20110:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1783071651.153687:0:20110:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1783071651.156551:0:20111:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1783071651.156706:0:20110:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1783071651.164089:0:20110:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1783071651.164201:0:20110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f8b2fd66a00/0x6b58994c2cbdd682 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071651.164220:0:20110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8b2fd67400/0x6b58994c2cbdd317 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdd310 expref: 23 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071651.164228:0:20110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8a03bd7a00/0x6b58994c2cbdd325 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdd31e expref: 23 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071651.164235:0:20110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8a03865600/0x6b58994c2cbdd364 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdd35d expref: 23 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071651.164242:0:20110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8a01749c00/0x6b58994c2cbdd3fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdd3f7 expref: 23 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071651.164266:0:20110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8a03bd6400/0x6b58994c2cbdd612 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9919a expref: 12 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071651.164273:0:20110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8a03bd7000/0x6b58994c2cbdd651 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9920a expref: 12 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071651.164280:0:20110:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f8b2fd66a00/0x6b58994c2cbdd682 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071651.164322:0:20110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8a03bd7000/0x6b58994c2cbdd651 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9920a expref: 12 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071651.164339:0:20110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f8a03bd7000/0x6b58994c2cbdd651 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9920a expref: 12 pid: 17081 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071651.164353:0:20110:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0397c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20110:1869685707703296:192.168.204.38@tcp:104: 00010000:00010000:2.0:1783071651.164765:0:20110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8a03bd6400/0x6b58994c2cbdd612 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9919a expref: 12 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071651.164774:0:20110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f8a03bd6400/0x6b58994c2cbdd612 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9919a expref: 12 pid: 17079 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071651.164784:0:20110:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0397dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20110:1869685707703424:192.168.204.38@tcp:104: 00010000:00010000:2.0:1783071651.164813:0:20110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8a01749c00/0x6b58994c2cbdd3fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6b58994c2cbdd3f7 expref: 23 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071651.164821:0:20110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f8a01749c00/0x6b58994c2cbdd3fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6b58994c2cbdd3f7 expref: 23 pid: 17078 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071651.164843:0:20110:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0397f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20110:1869685707703552:0@lo:104: 00000100:00100000:2.0:1783071651.164881:0:20110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783071651.164942:0:20110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8a03865600/0x6b58994c2cbdd364 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6b58994c2cbdd35d expref: 23 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071651.164950:0:20110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f8a03865600/0x6b58994c2cbdd364 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6b58994c2cbdd35d expref: 23 pid: 17078 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071651.164958:0:20110:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0397c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20110:1869685707703680:0@lo:104: 00000100:00100000:2.0:1783071651.164975:0:20110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783071651.165010:0:20110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8a03bd7a00/0x6b58994c2cbdd325 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6b58994c2cbdd31e expref: 23 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071651.165018:0:20110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f8a03bd7a00/0x6b58994c2cbdd325 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6b58994c2cbdd31e expref: 23 pid: 17079 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071651.165027:0:20110:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0397d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20110:1869685707703808:0@lo:104: 00000100:00100000:2.0:1783071651.165047:0:20110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071651.165051:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707703552 00010000:00010000:2.0:1783071651.165061:0:20110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8b2fd67400/0x6b58994c2cbdd317 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6b58994c2cbdd310 expref: 23 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071651.165067:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707703552 00010000:00010000:2.0:1783071651.165071:0:20110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f8b2fd67400/0x6b58994c2cbdd317 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6b58994c2cbdd310 expref: 23 pid: 17078 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071651.165080:0:20110:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0397c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20110:1869685707703936:0@lo:104: 00000100:00100000:2.0:1783071651.165097:0:20110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071651.165107:0:20110:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a01c9a000 going to sleep for 11 seconds 00000100:00100000:3.0:1783071651.165113:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707703680 00000100:00100000:3.0:1783071651.165117:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707703680 00000100:00100000:3.0:1783071651.165131:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707703808 00000100:00100000:3.0:1783071651.165133:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707703808 00000100:00100000:3.0:1783071651.165143:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707703936 00000100:00100000:3.0:1783071651.165146:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707703936 00000100:00100000:3.0:1783071651.165159:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783071651.165167:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0397f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5ed14122-6273-4ec6-b260-6e79c239c375+6:20110:x1869685707703552:12345-0@lo:104: 00010000:00010000:3.0:1783071651.165181:0:17069:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd7600/0x6b58994c2cbdd3f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdd3fe expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071651.165793:0:20110:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0397f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20110:1869685707703552:0@lo:104: 00010000:00010000:3.0:1783071651.165799:0:17069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783071651.165808:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0397f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5ed14122-6273-4ec6-b260-6e79c239c375+6:20110:x1869685707703552:12345-0@lo:104: Request processed in 641us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071651.165816:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783071651.165837:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783071651.165844:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0397fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5ed14122-6273-4ec6-b260-6e79c239c375+5:20110:x1869685707703680:12345-0@lo:104: 00010000:00010000:0.0:1783071651.165847:0:17074:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783071651.165853:0:17069:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd7400/0x6b58994c2cbdd35d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdd364 expref: -99 pid: 18585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071651.165855:0:17074:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd7600/0x6b58994c2cbdd3f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdd3fe expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071651.165873:0:17074:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03bd7600 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:0.0:1783071651.165877:0:17074:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd7600/0x6b58994c2cbdd3f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x6b58994c2cbdd3fe expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071651.165886:0:17074:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd7600/0x6b58994c2cbdd3f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x6b58994c2cbdd3fe expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783071651.165906:0:17074:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd7600/0x6b58994c2cbdd3f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x6b58994c2cbdd3fe expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783071651.165913:0:17074:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783071651.165915:0:17069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783071651.165922:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0397fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5ed14122-6273-4ec6-b260-6e79c239c375+5:20110:x1869685707703680:12345-0@lo:104: Request processed in 79us (945us total) trans 0 rc 0/0 00010000:00010000:0.0:1783071651.165957:0:17074:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd7600/0x6b58994c2cbdd3f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdd3fe expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071651.165964:0:17074:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783071651.165985:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783071651.165987:0:17074:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd7600/0x6b58994c2cbdd3f7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdd3fe expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071651.165995:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd7400/0x6b58994c2cbdd35d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdd364 expref: -99 pid: 18585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071651.165995:0:17074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd7600/0x6b58994c2cbdd3f7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdd3fe expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071651.166008:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071651.166009:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071651.166011:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03bd7400 already unused, calling callback (ffffffffc1183c20) 00010000:00010000:0.0:1783071651.166011:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:2.0:1783071651.166014:0:17075:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd7400/0x6b58994c2cbdd35d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6b58994c2cbdd364 expref: -99 pid: 18585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071651.166021:0:17075:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd7400/0x6b58994c2cbdd35d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6b58994c2cbdd364 expref: -99 pid: 18585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071651.166025:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 10000000:00010000:2.0:1783071651.166027:0:17075:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd7400/0x6b58994c2cbdd35d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6b58994c2cbdd364 expref: -99 pid: 18585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071651.166032:0:17075:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1783071651.166035:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0391c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ed14122-6273-4ec6-b260-6e79c239c375:3648:1869685707704064:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783071651.166051:0:17075:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd7400/0x6b58994c2cbdd35d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdd364 expref: -99 pid: 18585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071651.166057:0:17075:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783071651.166063:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd7400/0x6b58994c2cbdd35d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdd364 expref: -99 pid: 18585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071651.166065:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783071651.166070:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd7400/0x6b58994c2cbdd35d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdd364 expref: -99 pid: 18585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071651.166079:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071651.166081:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071651.166082:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071651.166088:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783071651.166096:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0397f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ed14122-6273-4ec6-b260-6e79c239c375:3647:1869685707704192:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783071651.166098:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707704064 00000100:00100000:0.0:1783071651.166102:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707704064 00000100:00100000:2.0:1783071651.166120:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783071651.166121:0:17072:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8a01749c00/0x6b58994c2cbdd3fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdd3f7 expref: 24 pid: 17078 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071651.166138:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707704192 00000100:00100000:0.0:1783071651.166141:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707704192 00000100:00100000:2.0:1783071651.166150:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1783071651.166151:0:17072:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8a03865600/0x6b58994c2cbdd364 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdd35d expref: 25 pid: 17078 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071651.166162:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0391dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ed14122-6273-4ec6-b260-6e79c239c375+25:3648:x1869685707704064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783071651.166172:0:17073:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1783071651.166173:0:17072:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:2.0:1783071651.166177:0:17073:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8a01749c00/0x6b58994c2cbdd3fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdd3f7 expref: 25 pid: 17078 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071651.166178:0:17072:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1783071651.166186:0:17073:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8a01749c00/0x6b58994c2cbdd3fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6b58994c2cbdd3f7 expref: 25 pid: 17078 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071651.166192:0:17071:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1783071651.166198:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1783071651.166199:0:17073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8a01749c00/0x6b58994c2cbdd3fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6b58994c2cbdd3f7 expref: 25 pid: 17078 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071651.166203:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0397d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5ed14122-6273-4ec6-b260-6e79c239c375+25:3647:x1869685707704192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783071651.166210:0:17071:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071651.166211:0:17073:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783071651.166214:0:17071:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8a03865600/0x6b58994c2cbdd364 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdd35d expref: 24 pid: 17078 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071651.166222:0:17071:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8a03865600/0x6b58994c2cbdd364 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6b58994c2cbdd35d expref: 24 pid: 17078 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071651.166231:0:17071:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071651.166237:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0391dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ed14122-6273-4ec6-b260-6e79c239c375+24:3648:x1869685707704064:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071651.166243:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783071651.166252:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0397d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5ed14122-6273-4ec6-b260-6e79c239c375+23:3647:x1869685707704192:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071651.166258:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783071651.166268:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0391c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ed14122-6273-4ec6-b260-6e79c239c375:3648:1869685707704064:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783071651.166291:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0397f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ed14122-6273-4ec6-b260-6e79c239c375:3647:1869685707704192:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783071651.166428:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783071651.166443:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783071651.166449:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0397df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5ed14122-6273-4ec6-b260-6e79c239c375+4:20110:x1869685707703808:12345-0@lo:104: 00010000:00010000:3.0:1783071651.166457:0:17069:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8f8a03865c00/0x6b58994c2cbdd31e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdd325 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071651.166508:0:20110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8a03865600/0x6b58994c2cbdd364 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6b58994c2cbdd35d expref: 22 pid: 17078 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071651.166519:0:17069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783071651.166520:0:20110:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0397c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20110:1869685707703680:0@lo:104: 00000100:00100000:3.0:1783071651.166531:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0397df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5ed14122-6273-4ec6-b260-6e79c239c375+4:20110:x1869685707703808:12345-0@lo:104: Request processed in 80us (1482us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071651.166535:0:20110:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0397d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20110:1869685707703808:0@lo:104: 00000100:00100000:3.0:1783071651.166544:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783071651.166560:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783071651.166567:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0397ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5ed14122-6273-4ec6-b260-6e79c239c375+3:20110:x1869685707703936:12345-0@lo:104: 00010000:00010000:3.0:1783071651.166575:0:17069:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd6000/0x6b58994c2cbdd310 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdd317 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071651.166620:0:17069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1783071651.166625:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0397ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5ed14122-6273-4ec6-b260-6e79c239c375+3:20110:x1869685707703936:12345-0@lo:104: Request processed in 60us (1528us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071651.166630:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1783071651.166649:0:19422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783071651.166654:0:19422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8a03865c00/0x6b58994c2cbdd31e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdd325 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071651.166656:0:20110:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0397c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20110:1869685707703936:0@lo:104: 00010000:00010000:3.0:1783071651.166668:0:19422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03865c00 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:3.0:1783071651.166672:0:19422:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8a03865c00/0x6b58994c2cbdd31e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6b58994c2cbdd325 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071651.166680:0:19422:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8a03865c00/0x6b58994c2cbdd31e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6b58994c2cbdd325 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783071651.166686:0:19422:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8a03865c00/0x6b58994c2cbdd31e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6b58994c2cbdd325 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783071651.166692:0:19422:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783071651.166733:0:19422:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8f8a03865c00/0x6b58994c2cbdd31e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdd325 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071651.166740:0:19422:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783071651.166762:0:19422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8a03865c00/0x6b58994c2cbdd31e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdd325 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071651.166769:0:19422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8a03865c00/0x6b58994c2cbdd31e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdd325 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071651.166774:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0411f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ed14122-6273-4ec6-b260-6e79c239c375:3645:1869685707704320:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783071651.166781:0:19422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783071651.166785:0:19422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd6000/0x6b58994c2cbdd310 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6b58994c2cbdd317 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071651.166792:0:19422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03bd6000 already unused, calling callback (ffffffffc1183c20) 10000000:00010000:3.0:1783071651.166795:0:19422:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd6000/0x6b58994c2cbdd310 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6b58994c2cbdd317 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071651.166803:0:19422:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd6000/0x6b58994c2cbdd310 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6b58994c2cbdd317 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071651.166808:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:3.0:1783071651.166816:0:19422:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd6000/0x6b58994c2cbdd310 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6b58994c2cbdd317 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783071651.166821:0:19422:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783071651.166839:0:19422:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd6000/0x6b58994c2cbdd310 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdd317 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071651.166845:0:19422:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783071651.166850:0:19422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd6000/0x6b58994c2cbdd310 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdd317 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071651.166867:0:19422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd6000/0x6b58994c2cbdd310 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6b58994c2cbdd317 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071651.166880:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071651.166882:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071651.166884:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071651.166894:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0411c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ed14122-6273-4ec6-b260-6e79c239c375:3646:1869685707704448:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783071651.167195:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071651.167691:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071651.167765:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707704320 00000100:00100000:3.0:1783071651.167771:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707704320 00010000:00010000:3.0:1783071651.167793:0:17073:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8a03bd7a00/0x6b58994c2cbdd325 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdd31e expref: 22 pid: 17079 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071651.167810:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707704448 00000100:00100000:3.0:1783071651.167813:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707704448 00000100:00100000:0.0:1783071651.167816:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1783071651.167823:0:17073:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8b2fd67400/0x6b58994c2cbdd317 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdd310 expref: 23 pid: 17078 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071651.167823:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c78ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5ed14122-6273-4ec6-b260-6e79c239c375+23:3645:x1869685707704320:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783071651.167833:0:17073:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:0.0:1783071651.167834:0:17071:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071651.167839:0:17071:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8a03bd7a00/0x6b58994c2cbdd325 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdd31e expref: 23 pid: 17079 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071651.167840:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783071651.167845:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0411df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ed14122-6273-4ec6-b260-6e79c239c375+23:3646:x1869685707704448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783071651.167849:0:17071:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8a03bd7a00/0x6b58994c2cbdd325 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6b58994c2cbdd31e expref: 23 pid: 17079 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071651.167850:0:17073:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071651.167854:0:17073:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8b2fd67400/0x6b58994c2cbdd317 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6b58994c2cbdd310 expref: 23 pid: 17078 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071651.167862:0:17071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8a03bd7a00/0x6b58994c2cbdd325 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6b58994c2cbdd31e expref: 23 pid: 17079 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071651.168089:0:17073:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8b2fd67400/0x6b58994c2cbdd317 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6b58994c2cbdd310 expref: 22 pid: 17078 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071651.168102:0:17073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b2fd67400/0x6b58994c2cbdd317 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6b58994c2cbdd310 expref: 22 pid: 17078 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071651.168119:0:17073:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783071651.168195:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0411df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ed14122-6273-4ec6-b260-6e79c239c375+21:3646:x1869685707704448:12345-0@lo:103:ldlm_bl.0 Request processed in 349us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071651.168203:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783071651.168327:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0411c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ed14122-6273-4ec6-b260-6e79c239c375:3646:1869685707704448:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783071651.168547:0:17071:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071651.168673:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c78ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5ed14122-6273-4ec6-b260-6e79c239c375+20:3645:x1869685707704320:12345-0@lo:103:ldlm_bl.0 Request processed in 848us (1865us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071651.168681:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783071651.168727:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0411f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ed14122-6273-4ec6-b260-6e79c239c375:3645:1869685707704320:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783071651.170795:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071651.170874:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071651.170914:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692948736 00000100:00100000:1.0:1783071651.170930:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692948736 00010000:00010000:1.0:1783071651.170962:0:17073:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8a03bd7000/0x6b58994c2cbdd651 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9920a expref: 13 pid: 17081 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071651.170988:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692948864 00000100:00100000:1.0:1783071651.170990:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692948864 00010000:00010000:1.0:1783071651.171001:0:17073:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8a03bd6400/0x6b58994c2cbdd612 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9919a expref: 14 pid: 17079 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071651.171027:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 13 00000100:00100000:1.0:1783071651.171036:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3eb8d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f80a971-9117-430f-93b5-a8b601517f46+14:2406:x1869685692948736:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783071651.171064:0:17073:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071651.171070:0:17073:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8a03bd7000/0x6b58994c2cbdd651 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9920a expref: 14 pid: 17081 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071651.171082:0:17073:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8a03bd7000/0x6b58994c2cbdd651 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9920a expref: 14 pid: 17081 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071651.171100:0:17073:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071651.171141:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3eb8d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f80a971-9117-430f-93b5-a8b601517f46+14:2406:x1869685692948736:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 107us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071651.171149:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 13 00000100:00100000:1.0:1783071651.171192:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 14 00000100:00100000:1.0:1783071651.171198:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c78d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f80a971-9117-430f-93b5-a8b601517f46+13:2405:x1869685692948864:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783071651.171205:0:17073:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071651.171210:0:17073:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8a03bd6400/0x6b58994c2cbdd612 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9919a expref: 13 pid: 17079 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071651.171218:0:17073:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8a03bd6400/0x6b58994c2cbdd612 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9919a expref: 13 pid: 17079 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071651.171231:0:17073:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f8b2fd66a00/0x6b58994c2cbdd682 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071651.171239:0:17073:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b2fd66a00/0x6b58994c2cbdd682 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071651.171253:0:17073:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f8b2fd66a00/0x6b58994c2cbdd682 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071651.171270:0:17073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f8b2fd66a00/0x6b58994c2cbdd682 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071651.171276:0:17073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f8b2fd66a00/0x6b58994c2cbdd682 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071651.171281:0:17073:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f8b2fd66a00/0x6b58994c2cbdd682 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071651.171287:0:17073:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd66a00 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:1.0:1783071651.171291:0:17073:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f8b2fd66a00/0x6b58994c2cbdd682 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071651.171299:0:17073:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f8b2fd66a00/0x6b58994c2cbdd682 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071651.171307:0:17073:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f8b2fd66a00/0x6b58994c2cbdd682 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071651.171316:0:17073:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071651.171347:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c78d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f80a971-9117-430f-93b5-a8b601517f46+13:2405:x1869685692948864:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 147us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071651.171354:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 14 00010000:00010000:3.0:1783071651.171470:0:20110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8a03bd7000/0x6b58994c2cbdd651 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9920a expref: 12 pid: 17081 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071651.171485:0:20110:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0397c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20110:1869685707703296:192.168.204.38@tcp:104: 00010000:00010000:3.0:1783071651.171496:0:20110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8a03bd6400/0x6b58994c2cbdd612 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9919a expref: 11 pid: 17079 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071651.171505:0:20110:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0397dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20110:1869685707703424:192.168.204.38@tcp:104: 00010000:00010000:3.0:1783071651.171534:0:20110:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f8b2fd66a00/0x6b58994c2cbdd682 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071651.171544:0:20110:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f8b2fd66a00/0x6b58994c2cbdd682 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071651.171550:0:20110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f8b2fd66a00/0x6b58994c2cbdd682 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071651.171556:0:20110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b2fd66a00/0x6b58994c2cbdd682 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071651.602040:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071651.602155:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071651.602190:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071651.602243:0:18592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692949376 00000100:00100000:2.0:1783071651.602254:0:18592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692949376 00000100:00100000:2.0:1783071651.602330:0:18592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2 00000100:00100000:2.0:1783071651.602340:0:18592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0391df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d5c8f6e7-f12c-493c-9545-6cf978dcf267+5:2404:x1869685692949376:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1783071651.602439:0:18592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0391df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d5c8f6e7-f12c-493c-9545-6cf978dcf267+5:2404:x1869685692949376:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 100us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071651.602446:0:18592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2 00000100:00080000:1.0:1783071651.603944:0:17082:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783071651.605181:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692949120 00000100:00100000:1.0:1783071651.605193:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692949120 00000100:00080000:0.0:1783071651.605243:0:17082:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783071651.605256:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692948992 00000100:00100000:1.0:1783071651.605259:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692948992 00000100:00100000:1.0:1783071651.605287:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 38 00000100:00100000:1.0:1783071651.605296:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0391f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d5c8f6e7-f12c-493c-9545-6cf978dcf267+5:2404:x1869685692949120:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1783071651.605298:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071651.605318:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071651.605334:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071651.605348:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071651.605394:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071651.605397:0:17085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692949504 00000100:00100000:2.0:1783071651.605406:0:17085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692949504 00000100:00100000:0.0:1783071651.605414:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692949632 00000100:00100000:0.0:1783071651.605416:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692949632 00000100:00100000:2.0:1783071651.605427:0:17085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 39 00000100:00100000:2.0:1783071651.605433:0:17085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0391dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5c8f6e7-f12c-493c-9545-6cf978dcf267+6:2403:x1869685692948992:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1783071651.605436:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 40 00000100:00100000:0.0:1783071651.605441:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0391f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16c37387-7795-4f66-bf99-555c21a639fc+6:2403:x1869685692949504:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1783071651.605476:0:17085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0391dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5c8f6e7-f12c-493c-9545-6cf978dcf267+6:2403:x1869685692948992:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 39us (3282us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071651.605479:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0391f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16c37387-7795-4f66-bf99-555c21a639fc+6:2403:x1869685692949504:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 38us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071651.605484:0:17085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 39 00000100:00100000:0.0:1783071651.605487:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 40 00000100:00100000:2.0:1783071651.605500:0:17085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 41 00000100:00100000:2.0:1783071651.605506:0:17085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0391e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16c37387-7795-4f66-bf99-555c21a639fc+5:2404:x1869685692949632:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1783071651.605511:0:19700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692949248 00000100:00100000:0.0:1783071651.605514:0:19700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692949248 00000100:00100000:2.0:1783071651.605528:0:17085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0391e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16c37387-7795-4f66-bf99-555c21a639fc+5:2404:x1869685692949632:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 23us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071651.605534:0:17085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 41 00000100:00100000:0.0:1783071651.605536:0:19700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692949760 00000100:00100000:0.0:1783071651.605539:0:19700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692949760 00000100:00100000:0.0:1783071651.605554:0:19700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692949888 00000100:00100000:0.0:1783071651.605557:0:19700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692949888 00000100:00100000:0.0:1783071651.605570:0:19700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3 00000100:00100000:0.0:1783071651.605575:0:19700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0391c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d5c8f6e7-f12c-493c-9545-6cf978dcf267+5:2403:x1869685692949248:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1783071651.605610:0:19700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0391c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d5c8f6e7-f12c-493c-9545-6cf978dcf267+5:2403:x1869685692949248:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 34us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071651.605617:0:19700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3 00000100:00100000:0.0:1783071651.605627:0:19700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 4 00000100:00100000:0.0:1783071651.605633:0:19700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0391d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:16c37387-7795-4f66-bf99-555c21a639fc+5:2403:x1869685692949760:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1783071651.605654:0:19700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0391d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:16c37387-7795-4f66-bf99-555c21a639fc+5:2403:x1869685692949760:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 20us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071651.605660:0:19700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 4 00000100:00100000:0.0:1783071651.605670:0:19700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 5 00000100:00100000:0.0:1783071651.605676:0:19700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0391ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:16c37387-7795-4f66-bf99-555c21a639fc+5:2404:x1869685692949888:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1783071651.605700:0:19700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0391ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:16c37387-7795-4f66-bf99-555c21a639fc+5:2404:x1869685692949888:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 24us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071651.605706:0:19700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 5 00000100:00080000:0.0:1783071651.605727:0:17082:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783071651.605729:0:17082:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783071651.605731:0:17082:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783071651.605733:0:17082:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783071651.605775:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0391f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d5c8f6e7-f12c-493c-9545-6cf978dcf267+5:2404:x1869685692949120:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 480us (3744us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071651.605782:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 38 00000100:00100000:3.0:1783071651.650865:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0411d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707704704:0@lo:400:kworker.0 00000100:00100000:3.0:1783071651.650948:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071651.650980:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0411f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707705216:0@lo:400:kworker.0 00000100:00100000:3.0:1783071651.651014:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071651.651031:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0411c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1869685707705728:0@lo:400:kworker.0 00000100:00100000:3.0:1783071651.651056:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071651.651079:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1783071651.651084:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0411ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ed14122-6273-4ec6-b260-6e79c239c375:3648:1869685707704576:0@lo:400:kworker.0 00000100:00100000:3.0:1783071651.651109:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071651.651136:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0411df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869685707705088:0@lo:400:kworker.0 00000100:00100000:3.0:1783071651.651156:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071651.651174:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0411f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869685707705600:0@lo:400:kworker.0 00000100:00100000:3.0:1783071651.651197:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071651.651216:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1869685707706112:0@lo:400:kworker.0 00000100:00100000:3.0:1783071651.651242:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071651.651274:0:17825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707704704 00000100:00100000:3.0:1783071651.651281:0:17825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707704704 00000100:00100000:3.0:1783071651.651321:0:17825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707705216 00000100:00100000:3.0:1783071651.651324:0:17825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707705216 00000100:00100000:3.0:1783071651.651341:0:17825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783071651.651350:0:17825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707704704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071651.651446:0:17825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707704704:12345-0@lo:400:kworker.0 Request processed in 95us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071651.651454:0:17825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783071651.651474:0:17825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1783071651.651480:0:17825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707705216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071651.651507:0:17825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707705216:12345-0@lo:400:kworker.0 Request processed in 28us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071651.651522:0:17825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1783071651.651550:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707705728 00000100:00100000:3.0:1783071651.651556:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707705728 00000100:00100000:1.0:1783071651.651605:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707704576 00000100:00100000:1.0:1783071651.651612:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707704576 00000100:00100000:0.0:1783071651.651643:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0411dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707704832:0@lo:400:kworker.0 00000100:00100000:1.0:1783071651.651645:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1783071651.651656:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03810050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+20:3648:x1869685707704576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071651.651687:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071651.651701:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03810050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+20:3648:x1869685707704576:12345-0@lo:400:kworker.0 Request processed in 46us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071651.651709:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1783071651.651714:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0411c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707705344:0@lo:400:kworker.0 00000100:00100000:0.0:1783071651.651742:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071651.651801:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783071651.651812:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707706240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783071651.651845:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071651.651874:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0411fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707704960:0@lo:400:kworker.0 00000100:00100000:2.0:1783071651.651898:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071651.651926:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0411ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707705472:0@lo:400:kworker.0 00000100:00100000:2.0:1783071651.651947:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071651.651964:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1869685707705984:0@lo:400:kworker.0 00000100:00100000:0.0:1783071651.652000:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a01767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1869685707705856:0@lo:400:kworker.0 00000100:00100000:0.0:1783071651.652034:0:19700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707704832 00000100:00100000:0.0:1783071651.652039:0:19700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707704832 00000100:00100000:0.0:1783071651.652072:0:19700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707705344 00000100:00100000:0.0:1783071651.652075:0:19700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707705344 00000100:00100000:0.0:1783071651.652085:0:19700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707704960 00000100:00100000:0.0:1783071651.652087:0:19700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707704960 00000100:00100000:0.0:1783071651.652099:0:19700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707705472 00000100:00100000:0.0:1783071651.652101:0:19700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707705472 00000100:00100000:0.0:1783071651.652114:0:19700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783071651.652120:0:19700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0391c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707704832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071651.652157:0:19700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0391c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707704832:12345-0@lo:400:kworker.0 Request processed in 36us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071651.652164:0:19700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783071651.652177:0:19700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783071651.652183:0:19700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0391ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707705344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071651.652210:0:19700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0391ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707705344:12345-0@lo:400:kworker.0 Request processed in 27us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071651.652215:0:19700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783071651.652227:0:19700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783071651.652233:0:19700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0397e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707704960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071651.652259:0:19700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0397e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707704960:12345-0@lo:400:kworker.0 Request processed in 27us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071651.652265:0:19700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783071651.652275:0:19700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783071651.652280:0:19700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0397ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707705472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071651.652304:0:19700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0397ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707705472:12345-0@lo:400:kworker.0 Request processed in 25us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071651.652310:0:19700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783071651.652384:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071651.655324:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0411fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707704960:0@lo:400:kworker.0 00000100:00100000:2.0:1783071651.655341:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0411ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707705472:0@lo:400:kworker.0 00000100:00080000:2.0:1783071651.655470:0:17082:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783071651.655475:0:17082:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783071651.655494:0:17082:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783071651.655512:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0397e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707706496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783071651.655566:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071651.655607:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0411ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ed14122-6273-4ec6-b260-6e79c239c375:3648:1869685707704576:0@lo:400:kworker.0 00000100:00100000:2.0:1783071651.655622:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0411d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707704704:0@lo:400:kworker.0 00000100:00100000:2.0:1783071651.655634:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0411f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707705216:0@lo:400:kworker.0 00000100:00100000:3.0:1783071651.657291:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707705088 00000100:00100000:1.0:1783071651.657292:0:19199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707705600 00000100:00100000:0.0:1783071651.657293:0:17085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707706112 00000100:00100000:3.0:1783071651.657305:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707705088 00000100:00100000:1.0:1783071651.657306:0:19199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707705600 00000100:00100000:0.0:1783071651.657313:0:17085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707706112 00000100:00100000:0.0:1783071651.657360:0:17085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707705984 00000100:00100000:0.0:1783071651.657379:0:17085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707705984 00000100:00100000:3.0:1783071651.657383:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783071651.657396:0:19199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783071651.657397:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869685707705728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071651.657411:0:19199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869685707705088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071651.657412:0:17085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783071651.657423:0:17085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869685707706112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071651.657494:0:17085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869685707706112:12345-0@lo:400:kworker.0 Request processed in 72us (6249us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071651.657497:0:19199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869685707705088:12345-0@lo:400:kworker.0 Request processed in 90us (6338us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071651.657508:0:17085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783071651.657514:0:19199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783071651.657533:0:17085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783071651.657539:0:19199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783071651.657544:0:17085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869685707705600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071651.657553:0:19199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0397d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869685707705984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071651.657584:0:17085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869685707705600:12345-0@lo:400:kworker.0 Request processed in 44us (6387us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071651.657591:0:17085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783071651.657606:0:19199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0397d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869685707705984:12345-0@lo:400:kworker.0 Request processed in 56us (5620us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071651.657613:0:19199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:0.0:1783071651.657621:0:17082:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783071651.657626:0:17082:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783071651.657642:0:18593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707706240 00000100:00100000:1.0:1783071651.657647:0:18593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707706240 00000100:00100000:0.0:1783071651.657652:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071651.657672:0:18593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707706496 00000100:00100000:1.0:1783071651.657676:0:18593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707706496 00000100:00100000:0.0:1783071651.657688:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707706368:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783071651.657703:0:18593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783071651.657710:0:18593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0397f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707706240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783071651.657727:0:18593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1783071651.657731:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071651.657777:0:18593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0397f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707706240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (5930us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071651.657787:0:18593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783071651.657787:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0411dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707704832:0@lo:400:kworker.0 00000100:00100000:1.0:1783071651.657802:0:18593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707706368 00000100:00100000:1.0:1783071651.657806:0:18593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707706368 00000100:00100000:0.0:1783071651.657811:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0411c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707705344:0@lo:400:kworker.0 00000100:00100000:3.0:1783071651.657843:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869685707705728:12345-0@lo:400:kworker.0 Request processed in 450us (6784us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071651.657848:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0411df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869685707705088:0@lo:400:kworker.0 00000100:00100000:3.0:1783071651.657849:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783071651.657858:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0411f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869685707705600:0@lo:400:kworker.0 00000100:00100000:3.0:1783071651.657861:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707705856 00000100:00100000:3.0:1783071651.657864:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707705856 00010000:00080000:0.0:1783071651.657874:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b3c6aaa00 x1869685707706112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071651.657885:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1869685707706112:0@lo:400:kworker.0 00000100:00100000:3.0:1783071651.657888:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1783071651.657893:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1869685707705856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071651.657904:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0411c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1869685707705728:0@lo:400:kworker.0 00000100:00100000:3.0:1783071651.657936:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1869685707705856:12345-0@lo:400:kworker.0 Request processed in 41us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071651.657942:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1783071651.657946:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a01767480 x1869685707705856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071651.657956:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a01767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1869685707705856:0@lo:400:kworker.0 00000100:00100000:0.0:1783071651.657998:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1869685707705984:0@lo:400:kworker.0 00000100:00100000:0.0:1783071651.658031:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707706240:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783071651.658101:0:18593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783071651.658113:0:18593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0397ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707706496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783071651.658132:0:18593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1783071651.658308:0:18593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0397ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869685707706496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 197us (2741us total) trans 0 rc 0/0 00000100:00080000:2.0:1783071651.658423:0:17082:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783071651.658436:0:18593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783071651.658454:0:18593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783071651.658462:0:18593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707706368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783071651.658472:0:18593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1783071651.658518:0:18593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707706368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071651.658521:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0397e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707706496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783071651.658530:0:18593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783071651.658594:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707706368:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1783071651.779695:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071652.805001:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071652.949314:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071652.949418:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692950016 00000100:00100000:1.0:1783071652.949428:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692950016 00000100:00100000:1.0:1783071652.949488:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 145 00000100:00100000:1.0:1783071652.949499:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03810c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f80a971-9117-430f-93b5-a8b601517f46+11:14919:x1869685692950016:12345-192.168.204.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783071652.949517:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071652.949538:0:17079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8a03bd6200/0x6b58994c2cbdd689 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d99242 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071652.949574:0:17079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8a03bd6200/0x6b58994c2cbdd689 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99242 expref: 12 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071652.949586:0:17079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8a03bd6200/0x6b58994c2cbdd689 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99242 expref: 12 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071652.949594:0:17079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a03bd6200, rc 0) 00000100:00100000:1.0:1783071652.949646:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03810c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f80a971-9117-430f-93b5-a8b601517f46+12:14919:x1869685692950016:12345-192.168.204.38@tcp:101:ll_cfg_requeue.0 Request processed in 148us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071652.949654:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 145 00000100:00100000:0.0:1783071652.953110:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071652.955794:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692950144 00000100:00100000:1.0:1783071652.955809:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692950144 00000100:00100000:1.0:1783071652.955862:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 146 00000100:00100000:1.0:1783071652.955872:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03813850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f80a971-9117-430f-93b5-a8b601517f46+12:14919:x1869685692950144:12345-192.168.204.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783071652.956047:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03813850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f80a971-9117-430f-93b5-a8b601517f46+12:14919:x1869685692950144:12345-192.168.204.38@tcp:501:ll_cfg_requeue.0 Request processed in 175us (2944us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071652.956056:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 146 00000100:00100000:1.0:1783071652.960323:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071652.960355:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692950272 00000100:00100000:1.0:1783071652.960380:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692950272 00000100:00100000:1.0:1783071652.960446:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 147 00000100:00100000:1.0:1783071652.960457:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03811850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f80a971-9117-430f-93b5-a8b601517f46+12:14919:x1869685692950272:12345-192.168.204.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783071652.962785:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03811850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f80a971-9117-430f-93b5-a8b601517f46+12:14919:x1869685692950272:12345-192.168.204.38@tcp:503:ll_cfg_requeue.0 Request processed in 2321us (2464us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071652.962882:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 147 00000100:00100000:1.0:1783071652.969922:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071652.970000:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692950400 00000100:00100000:2.0:1783071652.970011:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692950400 00000100:00100000:2.0:1783071652.970100:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 148 00000100:00100000:2.0:1783071652.970112:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03811c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f80a971-9117-430f-93b5-a8b601517f46+12:14919:x1869685692950400:12345-192.168.204.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783071652.970133:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071652.970153:0:17079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b2fd66e00/0x6b58994c2cbdd690 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d99249 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071652.970191:0:17079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b2fd66e00/0x6b58994c2cbdd690 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99249 expref: 13 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071652.970204:0:17079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b2fd66e00/0x6b58994c2cbdd690 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99249 expref: 13 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071652.970213:0:17079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b2fd66e00, rc 0) 00000100:00100000:2.0:1783071652.970273:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03811c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f80a971-9117-430f-93b5-a8b601517f46+13:14919:x1869685692950400:12345-192.168.204.38@tcp:101:ll_cfg_requeue.0 Request processed in 163us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071652.970286:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 148 00000100:00100000:0.0:1783071652.977208:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071652.977390:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692950528 00000100:00100000:1.0:1783071652.977400:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692950528 00000100:00100000:1.0:1783071652.977459:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 149 00000100:00100000:1.0:1783071652.977470:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03813450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f80a971-9117-430f-93b5-a8b601517f46+13:14919:x1869685692950528:12345-192.168.204.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783071652.977655:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03813450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f80a971-9117-430f-93b5-a8b601517f46+13:14919:x1869685692950528:12345-192.168.204.38@tcp:501:ll_cfg_requeue.0 Request processed in 185us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071652.977664:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 149 00000100:00100000:3.0:1783071652.985002:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071652.985038:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692950656 00000100:00100000:3.0:1783071652.985048:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692950656 00000100:00100000:3.0:1783071652.985096:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 150 00000100:00100000:3.0:1783071652.985106:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03813c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f80a971-9117-430f-93b5-a8b601517f46+13:14919:x1869685692950656:12345-192.168.204.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783071652.985276:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03813c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f80a971-9117-430f-93b5-a8b601517f46+13:14919:x1869685692950656:12345-192.168.204.38@tcp:503:ll_cfg_requeue.0 Request processed in 170us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071652.985284:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 150 00000040:00080000:1.0:1783071652.996444:0:17836:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1783071653.058481:0:17083:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783071653.058490:0:17083:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8f8b069dc800 from 13 10000000:01000000:3.0:1783071653.058496:0:17083:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783071653.058547:0:17083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461600/0x6b58994c2cbdd697 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071653.058559:0:17083:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461600/0x6b58994c2cbdd697 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071653.058569:0:17083:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461600/0x6b58994c2cbdd697 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071653.058596:0:17083:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ed14122-6273-4ec6-b260-6e79c239c375:17083:1869685707706624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783071653.058668:0:17083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071653.058737:0:17083:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a01f2c000 going to sleep for 11 seconds 00000100:00100000:2.0:1783071653.058998:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707706624 00000100:00100000:2.0:1783071653.059007:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707706624 00000100:00100000:2.0:1783071653.059098:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1783071653.059109:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03812c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+20:17083:x1869685707706624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783071653.059122:0:17081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071653.059134:0:17081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b2fd66c00/0x6b58994c2cbdd69e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdd697 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071653.059170:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b2fd66c00/0x6b58994c2cbdd69e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdd697 expref: 21 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071653.059179:0:17081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b2fd66c00/0x6b58994c2cbdd69e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdd697 expref: 21 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071653.059187:0:17081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b2fd66c00, rc 0) 00000100:00100000:2.0:1783071653.059247:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03812c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+21:17083:x1869685707706624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071653.059253:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1783071653.059300:0:17083:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ed14122-6273-4ec6-b260-6e79c239c375:17083:1869685707706624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783071653.059328:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461600/0x6b58994c2cbdd697 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd69e expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071653.059338:0:17083:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461600/0x6b58994c2cbdd697 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdd69e expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071653.059441:0:17083:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ed14122-6273-4ec6-b260-6e79c239c375:17083:1869685707706752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783071653.059471:0:17083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071653.060080:0:17083:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b18027480 going to sleep for 11 seconds 00000100:00100000:3.0:1783071653.060122:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707706752 00000100:00100000:3.0:1783071653.060127:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707706752 00000100:00100000:2.0:1783071653.060771:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1783071653.060784:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+21:17083:x1869685707706752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783071653.061059:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+21:17083:x1869685707706752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 278us (1585us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071653.061066:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1783071653.061124:0:17083:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ed14122-6273-4ec6-b260-6e79c239c375:17083:1869685707706752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783071653.061167:0:17083:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ed14122-6273-4ec6-b260-6e79c239c375:17083:1869685707706880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783071653.061215:0:17083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071653.061243:0:17083:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b18027480 going to sleep for 11 seconds 00000100:00100000:3.0:1783071653.061493:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707706880 00000100:00100000:3.0:1783071653.061499:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707706880 00000100:00100000:3.0:1783071653.061522:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1783071653.061529:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+21:17083:x1869685707706880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783071653.062163:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+21:17083:x1869685707706880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 632us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071653.062171:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1783071653.062265:0:17083:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ed14122-6273-4ec6-b260-6e79c239c375:17083:1869685707706880:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783071653.064682:0:20220:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1783071653.065106:0:17083:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1783071653.065144:0:17083:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783071653.065156:0:17083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461600/0x6b58994c2cbdd697 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd69e expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071653.065167:0:17083:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8b3c461600/0x6b58994c2cbdd697 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd69e expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783071653.065178:0:17083:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783071653.065181:0:17083:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8f8a038e5000 from 13 10000000:01000000:1.0:1783071653.065183:0:17083:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783071653.065216:0:17083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd7600/0x6b58994c2cbdd6a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071653.065221:0:17083:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd7600/0x6b58994c2cbdd6a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071653.065229:0:17083:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd7600/0x6b58994c2cbdd6a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071653.065254:0:17083:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ed14122-6273-4ec6-b260-6e79c239c375:17083:1869685707707008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783071653.065321:0:17083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071653.065390:0:17083:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b05e0b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783071653.065457:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707707008 00000100:00100000:0.0:1783071653.065465:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707707008 00000100:00100000:0.0:1783071653.065523:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1783071653.065534:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+21:17083:x1869685707707008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783071653.065547:0:17078:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071653.065560:0:17078:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8a02ce8600/0x6b58994c2cbdd6ac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdd6a5 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071653.065587:0:17078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8a02ce8600/0x6b58994c2cbdd6ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdd6a5 expref: 22 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071653.065599:0:17078:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8a02ce8600/0x6b58994c2cbdd6ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdd6a5 expref: 22 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071653.065607:0:17078:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a02ce8600, rc 0) 00000100:00100000:0.0:1783071653.065665:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+22:17083:x1869685707707008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071653.065680:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1783071653.065771:0:17083:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ed14122-6273-4ec6-b260-6e79c239c375:17083:1869685707707008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783071653.065785:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd7600/0x6b58994c2cbdd6a5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd6ac expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071653.065794:0:17083:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd7600/0x6b58994c2cbdd6a5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdd6ac expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071653.065847:0:17083:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ed14122-6273-4ec6-b260-6e79c239c375:17083:1869685707707136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783071653.065880:0:17083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071653.065911:0:17083:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b05e0b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783071653.065975:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707707136 00000100:00100000:2.0:1783071653.065980:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707707136 00000100:00100000:2.0:1783071653.066010:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1783071653.066023:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+22:17083:x1869685707707136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783071653.066134:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+22:17083:x1869685707707136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 111us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071653.066141:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1783071653.066400:0:17083:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ed14122-6273-4ec6-b260-6e79c239c375:17083:1869685707707136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783071653.066429:0:17083:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ed14122-6273-4ec6-b260-6e79c239c375:17083:1869685707707264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783071653.066465:0:17083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071653.066485:0:17083:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b05e0b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071653.066592:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707707264 00000100:00100000:3.0:1783071653.066596:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707707264 00000100:00100000:3.0:1783071653.066626:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1783071653.066633:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+22:17083:x1869685707707264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783071653.066876:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+22:17083:x1869685707707264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 243us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071653.066883:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1783071653.066953:0:17083:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ed14122-6273-4ec6-b260-6e79c239c375:17083:1869685707707264:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783071653.068082:0:20221:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1783071653.068429:0:17083:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1783071653.068450:0:17083:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783071653.068459:0:17083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd7600/0x6b58994c2cbdd6a5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd6ac expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071653.068470:0:17083:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd7600/0x6b58994c2cbdd6a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd6ac expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783071653.068478:0:17083:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783071653.068481:0:17083:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8f8b10f78000 from 13 10000000:01000000:1.0:1783071653.068483:0:17083:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783071653.068512:0:17083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd7400/0x6b58994c2cbdd6b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071653.068519:0:17083:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd7400/0x6b58994c2cbdd6b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071653.068528:0:17083:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd7400/0x6b58994c2cbdd6b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071653.068557:0:17083:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ed14122-6273-4ec6-b260-6e79c239c375:17083:1869685707707392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783071653.068626:0:17083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071653.068662:0:17083:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b05e0b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783071653.068898:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707707392 00000100:00100000:0.0:1783071653.068904:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707707392 00000100:00100000:0.0:1783071653.068955:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1783071653.068963:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+22:17083:x1869685707707392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783071653.068975:0:17078:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071653.068988:0:17078:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8a02ce9c00/0x6b58994c2cbdd6ba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdd6b3 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071653.069010:0:17078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8a02ce9c00/0x6b58994c2cbdd6ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdd6b3 expref: 23 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071653.069020:0:17078:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8a02ce9c00/0x6b58994c2cbdd6ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdd6b3 expref: 23 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071653.069028:0:17078:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a02ce9c00, rc 0) 00000100:00100000:0.0:1783071653.069166:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+23:17083:x1869685707707392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 203us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071653.069173:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1783071653.069627:0:17083:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ed14122-6273-4ec6-b260-6e79c239c375:17083:1869685707707392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783071653.069643:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd7400/0x6b58994c2cbdd6b3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd6ba expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071653.069653:0:17083:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd7400/0x6b58994c2cbdd6b3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdd6ba expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071653.069713:0:17083:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ed14122-6273-4ec6-b260-6e79c239c375:17083:1869685707707520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783071653.069747:0:17083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071653.069814:0:17083:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b05e0b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071653.069855:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707707520 00000100:00100000:3.0:1783071653.069861:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707707520 00000100:00100000:3.0:1783071653.069948:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1783071653.069957:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+23:17083:x1869685707707520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783071653.070073:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+23:17083:x1869685707707520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071653.070081:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1783071653.070137:0:17083:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ed14122-6273-4ec6-b260-6e79c239c375:17083:1869685707707520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783071653.070163:0:17083:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ed14122-6273-4ec6-b260-6e79c239c375:17083:1869685707707648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783071653.070207:0:17083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071653.070298:0:17083:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b05e0b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783071653.070402:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707707648 00000100:00100000:2.0:1783071653.070408:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707707648 00000100:00100000:2.0:1783071653.070431:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1783071653.070438:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+23:17083:x1869685707707648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783071653.070521:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+23:17083:x1869685707707648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071653.070527:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1783071653.070678:0:17083:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ed14122-6273-4ec6-b260-6e79c239c375:17083:1869685707707648:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783071653.071679:0:20222:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1783071653.071972:0:17083:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1783071653.072117:0:17083:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783071653.072128:0:17083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd7400/0x6b58994c2cbdd6b3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd6ba expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071653.072140:0:17083:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd7400/0x6b58994c2cbdd6b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd6ba expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783071653.072150:0:17083:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783071653.072164:0:17083:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8f8a041ea000 from 13 10000000:01000000:1.0:1783071653.072166:0:17083:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783071653.072197:0:17083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd7a00/0x6b58994c2cbdd6c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071653.072205:0:17083:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd7a00/0x6b58994c2cbdd6c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071653.072215:0:17083:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd7a00/0x6b58994c2cbdd6c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071653.072233:0:17083:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ed14122-6273-4ec6-b260-6e79c239c375:17083:1869685707707776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783071653.072286:0:17083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071653.072360:0:17083:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b05e0b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783071653.072493:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707707776 00000100:00100000:2.0:1783071653.072499:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707707776 00000100:00100000:2.0:1783071653.072975:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1783071653.072986:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+23:17083:x1869685707707776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783071653.073000:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071653.073013:0:17079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b2fd67800/0x6b58994c2cbdd6c8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b58994c2cbdd6c1 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071653.073036:0:17079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b2fd67800/0x6b58994c2cbdd6c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6b58994c2cbdd6c1 expref: 24 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071653.073046:0:17079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b2fd67800/0x6b58994c2cbdd6c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6b58994c2cbdd6c1 expref: 24 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071653.073055:0:17079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b2fd67800, rc 0) 00000100:00100000:2.0:1783071653.073104:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ed14122-6273-4ec6-b260-6e79c239c375+24:17083:x1869685707707776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071653.073119:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1783071653.073201:0:17083:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ed14122-6273-4ec6-b260-6e79c239c375:17083:1869685707707776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783071653.073216:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd7a00/0x6b58994c2cbdd6c1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd6c8 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071653.073225:0:17083:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd7a00/0x6b58994c2cbdd6c1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6b58994c2cbdd6c8 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071653.073290:0:17083:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ed14122-6273-4ec6-b260-6e79c239c375:17083:1869685707707904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783071653.073320:0:17083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071653.075776:0:17083:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b05e0b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071653.076043:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707707904 00000100:00100000:3.0:1783071653.076052:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707707904 00000100:00100000:3.0:1783071653.076109:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1783071653.076118:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+24:17083:x1869685707707904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783071653.076274:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+24:17083:x1869685707707904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 156us (2952us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071653.076281:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1783071653.076453:0:17083:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ed14122-6273-4ec6-b260-6e79c239c375:17083:1869685707707904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783071653.076502:0:17083:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ed14122-6273-4ec6-b260-6e79c239c375:17083:1869685707708032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783071653.076557:0:17083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071653.076581:0:17083:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b05e0b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071653.076652:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707708032 00000100:00100000:3.0:1783071653.076656:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707708032 00000100:00100000:3.0:1783071653.076677:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1783071653.076683:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+24:17083:x1869685707708032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783071653.076770:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ed14122-6273-4ec6-b260-6e79c239c375+24:17083:x1869685707708032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071653.076777:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1783071653.076885:0:17083:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ed14122-6273-4ec6-b260-6e79c239c375:17083:1869685707708032:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783071653.077702:0:20223:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1783071653.078694:0:17083:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1783071653.078719:0:17083:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783071653.078731:0:17083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd7a00/0x6b58994c2cbdd6c1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd6c8 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071653.078742:0:17083:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8f8a03bd7a00/0x6b58994c2cbdd6c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6b58994c2cbdd6c8 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071653.827156:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071654.043020:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071654.043227:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692950784 00000100:00100000:1.0:1783071654.043238:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692950784 00000100:00080000:2.0:1783071654.043454:0:17082:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783071654.043816:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 23 00000100:00100000:1.0:1783071654.043829:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d5c8f6e7-f12c-493c-9545-6cf978dcf267+6:15586:x1869685692950784:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783071654.043851:0:17086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071654.043926:0:17086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03bd7000/0x6b58994c2cbdd6cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d99250 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071654.044007:0:17086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03bd6400/0x6b58994c2cbdd6d6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071654.044022:0:17086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03bd6400/0x6b58994c2cbdd6d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071654.044035:0:17086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03bd6400/0x6b58994c2cbdd6d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071654.044190:0:17086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03bd6000/0x6b58994c2cbdd6dd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071654.044200:0:17086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03bd6000/0x6b58994c2cbdd6dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071654.044208:0:17086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03bd6000/0x6b58994c2cbdd6dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071654.044319:0:17086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03bd6e00/0x6b58994c2cbdd6e4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071654.044356:0:17086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03bd6e00/0x6b58994c2cbdd6e4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071654.044386:0:17086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03bd6e00/0x6b58994c2cbdd6e4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783071654.044427:0:17086:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1783071654.044431:0:17086:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783071654.044469:0:17086:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03bd6e00/0x6b58994c2cbdd6e4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071654.044481:0:17086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03bd6400/0x6b58994c2cbdd6d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071654.044488:0:17086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03bd6400/0x6b58994c2cbdd6d6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071654.044494:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03bd6400/0x6b58994c2cbdd6d6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071654.044502:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03bd6400 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:1.0:1783071654.044506:0:17086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03bd6400/0x6b58994c2cbdd6d6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071654.044513:0:17086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03bd6400/0x6b58994c2cbdd6d6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071654.044525:0:17086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8b34e19800) 00010000:00010000:1.0:1783071654.044528:0:17086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071654.044536:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03bd6400/0x6b58994c2cbdd6d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071654.044554:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03bd6400/0x6b58994c2cbdd6d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071654.044568:0:17086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03bd6000/0x6b58994c2cbdd6dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071654.044574:0:17086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03bd6000/0x6b58994c2cbdd6dd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071654.044579:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03bd6000/0x6b58994c2cbdd6dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071654.044585:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a03bd6000 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:1.0:1783071654.044588:0:17086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03bd6000/0x6b58994c2cbdd6dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071654.044594:0:17086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03bd6000/0x6b58994c2cbdd6dd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071654.044602:0:17086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8f8b05a06800) 00010000:00010000:1.0:1783071654.044604:0:17086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071654.044607:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03bd6000/0x6b58994c2cbdd6dd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071654.044612:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03bd6000/0x6b58994c2cbdd6dd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071654.044902:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03bd7000/0x6b58994c2cbdd6cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99250 expref: 8 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071654.044929:0:17086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03bd6e00/0x6b58994c2cbdd6e4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99250 expref: 7 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071654.044938:0:17086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8f8b05a06500) 00010000:00010000:1.0:1783071654.044940:0:17086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783071654.044942:0:17086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a03bd6e00, rc 0) 00000100:00100000:1.0:1783071654.046160:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d5c8f6e7-f12c-493c-9545-6cf978dcf267+7:15586:x1869685692950784:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 2323us (3143us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071654.046172:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 23 00000100:00100000:3.0:1783071654.050699:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071654.050934:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692950912 00000100:00100000:1.0:1783071654.050946:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692950912 00000100:00100000:1.0:1783071654.051023:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 5 00000100:00100000:1.0:1783071654.051034:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:d5c8f6e7-f12c-493c-9545-6cf978dcf267+7:15586:x1869685692950912:12345-192.168.204.38@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1783071654.051122:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:d5c8f6e7-f12c-493c-9545-6cf978dcf267+7:15586:x1869685692950912:12345-192.168.204.38@tcp:900:lhsmtool_posix.0 Request processed in 90us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071654.051130:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 5 00000100:00100000:0.0:1783071654.053452:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071654.056696:0:17085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692951168 00000100:00100000:2.0:1783071654.056713:0:17085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692951168 00000100:00100000:2.0:1783071654.056804:0:17085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 24 00000100:00100000:2.0:1783071654.056815:0:17085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5c8f6e7-f12c-493c-9545-6cf978dcf267+7:15586:x1869685692951168:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783071654.056840:0:17085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071654.056865:0:17085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67000/0x6b58994c2cbdd6eb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d99257 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.056954:0:17085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdd6f2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.056968:0:17085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdd6f2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.056982:0:17085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdd6f2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.057035:0:17085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdd6f9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.057043:0:17085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdd6f9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.057049:0:17085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdd6f9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.057169:0:17085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdd700 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.057200:0:17085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdd700 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.057207:0:17085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdd700 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071654.057219:0:17085:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1783071654.058058:0:17085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdd6f2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.058070:0:17085:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdd6f2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.058077:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdd6f2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.058084:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd66a00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:2.0:1783071654.058088:0:17085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdd6f2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.058095:0:17085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdd6f2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.058109:0:17085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8f8b05a06500) 00010000:00010000:2.0:1783071654.058112:0:17085:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071654.058116:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdd6f2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.058122:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdd6f2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.058136:0:17085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdd6f9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.058151:0:17085:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdd6f9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.058157:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdd6f9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.058162:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd67400 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:2.0:1783071654.058165:0:17085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdd6f9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.058171:0:17085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdd6f9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.058179:0:17085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8f8b1093b900) 00010000:00010000:2.0:1783071654.058182:0:17085:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071654.058185:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdd6f9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.058191:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdd6f9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.060101:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67000/0x6b58994c2cbdd6eb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99257 expref: 10 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.060134:0:17085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66600/0x6b58994c2cbdd700 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99257 expref: 9 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.060143:0:17085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f8b1093ba00) 00010000:00010000:2.0:1783071654.060147:0:17085:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071654.060164:0:17085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b2fd66600, rc 0) 00000100:00100000:2.0:1783071654.060855:0:17085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5c8f6e7-f12c-493c-9545-6cf978dcf267+9:15586:x1869685692951168:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 4036us (7405us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1783071654.060867:0:17085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 24 00000100:00100000:0.0:1783071654.078038:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071654.078425:0:19199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692951296 00000100:00100000:2.0:1783071654.078438:0:19199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692951296 00000100:00100000:2.0:1783071654.078494:0:19199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 25 00000100:00100000:2.0:1783071654.078504:0:19199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5c8f6e7-f12c-493c-9545-6cf978dcf267+9:15586:x1869685692951296:12345-192.168.204.38@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1783071654.078610:0:19199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5c8f6e7-f12c-493c-9545-6cf978dcf267+9:15586:x1869685692951296:12345-192.168.204.38@tcp:59:lhsmtool_posix.0 Request processed in 107us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071654.078618:0:19199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 25 00000100:00100000:0.0:1783071654.088179:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071654.088425:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692951424 00000100:00100000:1.0:1783071654.088436:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692951424 00000100:00100000:1.0:1783071654.088524:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 26 00000100:00100000:1.0:1783071654.088535:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d5c8f6e7-f12c-493c-9545-6cf978dcf267+5:15586:x1869685692951424:12345-192.168.204.38@tcp:59:lhsmtool_posix.0 00000100:00080000:2.0:1783071654.088662:0:17082:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:1.0:1783071654.100057:0:17086:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 11475us 00000100:00100000:0.0:1783071654.125084:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d5c8f6e7-f12c-493c-9545-6cf978dcf267+5:15586:x1869685692951424:12345-192.168.204.38@tcp:59:lhsmtool_posix.0 Request processed in 36541us (36917us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071654.125101:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 26 00000100:00100000:1.0:1783071654.125980:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071654.129123:0:17085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692951552 00000100:00100000:3.0:1783071654.129141:0:17085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692951552 00000100:00100000:3.0:1783071654.129986:0:17085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 27 00000100:00100000:3.0:1783071654.129999:0:17085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c78f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5c8f6e7-f12c-493c-9545-6cf978dcf267+9:15592:x1869685692951552:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1783071654.130022:0:17085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071654.130043:0:17085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460800/0x6b58994c2cbdd70e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d9925e expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.130115:0:17085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460000/0x6b58994c2cbdd715 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.130131:0:17085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460000/0x6b58994c2cbdd715 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.130143:0:17085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460000/0x6b58994c2cbdd715 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.130156:0:17085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460c00/0x6b58994c2cbdd71c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.130163:0:17085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460c00/0x6b58994c2cbdd71c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.130201:0:17085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460c00/0x6b58994c2cbdd71c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.130248:0:17085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460000/0x6b58994c2cbdd715 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.130255:0:17085:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460000/0x6b58994c2cbdd715 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.130262:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460000/0x6b58994c2cbdd715 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.130268:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b3c460000 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071654.130272:0:17085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460000/0x6b58994c2cbdd715 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.130279:0:17085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460000/0x6b58994c2cbdd715 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.130290:0:17085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8b34e19800) 00010000:00010000:3.0:1783071654.130293:0:17085:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071654.130297:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460000/0x6b58994c2cbdd715 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.130304:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460000/0x6b58994c2cbdd715 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.130315:0:17085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460c00/0x6b58994c2cbdd71c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.130322:0:17085:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460c00/0x6b58994c2cbdd71c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.130334:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460c00/0x6b58994c2cbdd71c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.130340:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b3c460c00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071654.130343:0:17085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460c00/0x6b58994c2cbdd71c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.130349:0:17085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460c00/0x6b58994c2cbdd71c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.130357:0:17085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8f8a021bdf00) 00010000:00010000:3.0:1783071654.130360:0:17085:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071654.130390:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460c00/0x6b58994c2cbdd71c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.130397:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460c00/0x6b58994c2cbdd71c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.130429:0:17085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460800/0x6b58994c2cbdd70e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9925e expref: 10 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.130439:0:17085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8b34e19800) 00010000:00010000:3.0:1783071654.130441:0:17085:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071654.130445:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460800/0x6b58994c2cbdd70e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9925e expref: 10 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.130454:0:17085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b3c460800, rc 0) 00000100:00100000:3.0:1783071654.130531:0:17085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c78f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5c8f6e7-f12c-493c-9545-6cf978dcf267+9:15592:x1869685692951552:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 535us (4554us total) trans 0 rc 301/301 00000100:00100000:3.0:1783071654.130549:0:17085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 27 00000100:00100000:1.0:1783071654.134558:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071654.134809:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692951680 00000100:00100000:0.0:1783071654.134819:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692951680 00000100:00100000:0.0:1783071654.134885:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 0 00000100:00100000:0.0:1783071654.134896:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c78fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:d5c8f6e7-f12c-493c-9545-6cf978dcf267+9:15592:x1869685692951680:12345-192.168.204.38@tcp:700:lfs.0 00000100:00100000:0.0:1783071654.135297:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c78fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:d5c8f6e7-f12c-493c-9545-6cf978dcf267+9:15592:x1869685692951680:12345-192.168.204.38@tcp:700:lfs.0 Request processed in 401us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071654.135306:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 0 00000100:00100000:0.0:1783071654.139285:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071654.139440:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692951936 00000100:00100000:3.0:1783071654.139451:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692951936 00000100:00100000:3.0:1783071654.139510:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 28 00000100:00100000:3.0:1783071654.139520:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5c8f6e7-f12c-493c-9545-6cf978dcf267+9:15592:x1869685692951936:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:3.0:1783071654.139581:0:17087:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071654.139618:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460a00/0x6b58994c2cbdd63c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d991cb expref: 9 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.139636:0:17087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8b34e19800) 00010000:00010000:3.0:1783071654.139641:0:17087:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783071654.139704:0:17087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461a00/0x6b58994c2cbdd723 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.139718:0:17087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461200/0x6b58994c2cbdd67b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9923b expref: 5 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.139727:0:17087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461a00/0x6b58994c2cbdd723 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.139772:0:17087:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461200/0x6b58994c2cbdd67b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9923b expref: 5 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.139788:0:17087:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461200/0x6b58994c2cbdd67b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9923b expref: 5 pid: 19285 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071654.139803:0:17087:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c6ab800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17087:1869685707708160:192.168.204.38@tcp:104: 00000100:00100000:3.0:1783071654.139916:0:17087:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a01f2c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071654.143748:0:17087:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c6ab800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17087:1869685707708160:192.168.204.38@tcp:104: 00010000:00010000:3.0:1783071654.143777:0:17087:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461a00/0x6b58994c2cbdd723 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071654.143952:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071654.144149:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692952064 00000100:00100000:1.0:1783071654.144166:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692952064 00010000:00010000:1.0:1783071654.144219:0:17073:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461200/0x6b58994c2cbdd67b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9923b expref: 6 pid: 19285 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071654.144255:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 15 00000100:00100000:1.0:1783071654.144264:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab62680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16c37387-7795-4f66-bf99-555c21a639fc+6:2405:x1869685692952064:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783071654.144289:0:17073:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071654.144295:0:17073:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461200/0x6b58994c2cbdd67b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9923b expref: 6 pid: 19285 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071654.144308:0:17073:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461200/0x6b58994c2cbdd67b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9923b expref: 6 pid: 19285 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071654.144330:0:17073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461200/0x6b58994c2cbdd67b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9923b expref: 6 pid: 19285 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071654.144346:0:17073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8b34e19800) 00010000:00010000:1.0:1783071654.144350:0:17073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461a00/0x6b58994c2cbdd723 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071654.144360:0:17073:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461a00/0x6b58994c2cbdd723 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071654.144392:0:17073:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461a00/0x6b58994c2cbdd723 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071654.144419:0:17073:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071654.144466:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab62680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16c37387-7795-4f66-bf99-555c21a639fc+5:2405:x1869685692952064:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 202us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071654.144481:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 15 00010000:00010000:0.0:1783071654.144922:0:17087:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461a00/0x6b58994c2cbdd723 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071654.144930:0:17087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461a00/0x6b58994c2cbdd723 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071654.144966:0:17087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce8800/0x6b58994c2cbdd72a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071654.144977:0:17087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce8800/0x6b58994c2cbdd72a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071654.144984:0:17087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce8800/0x6b58994c2cbdd72a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1783071654.147358:0:17082:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783071654.149206:0:17087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce8c00/0x6b58994c2cbdd731 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071654.149228:0:17087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce8c00/0x6b58994c2cbdd731 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071654.149239:0:17087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce8c00/0x6b58994c2cbdd731 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783071654.149265:0:17087:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000054de5b1a reply state 00000000facc2e03 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce8c00/0x6b58994c2cbdd731 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071654.149277:0:17087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce8c00/0x6b58994c2cbdd731 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071654.149284:0:17087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f8a02124d00) 00010000:00010000:0.0:1783071654.149287:0:17087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783071654.149291:0:17087:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1783071654.149296:0:17087:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1783071654.149304:0:17087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461a00/0x6b58994c2cbdd723 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071654.149310:0:17087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461a00/0x6b58994c2cbdd723 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071654.149316:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461a00/0x6b58994c2cbdd723 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071654.149323:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b3c461a00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:0.0:1783071654.149327:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461a00/0x6b58994c2cbdd723 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071654.149333:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461a00/0x6b58994c2cbdd723 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071654.149342:0:17087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8b34e19800) 00010000:00010000:0.0:1783071654.149345:0:17087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071654.149348:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461a00/0x6b58994c2cbdd723 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071654.149479:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461a00/0x6b58994c2cbdd723 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783071654.149501:0:17087:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000054de5b1a reply state 00000000facc2e03 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce8800/0x6b58994c2cbdd72a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071654.149511:0:17087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce8800/0x6b58994c2cbdd72a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071654.149517:0:17087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8f8a02124400) 00010000:00010000:0.0:1783071654.149519:0:17087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783071654.149521:0:17087:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1783071654.149667:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5c8f6e7-f12c-493c-9545-6cf978dcf267+10:15592:x1869685692951936:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 10144us (10387us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1783071654.149677:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 28 00000100:00100000:0.0:1783071654.220474:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071654.221680:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692952192 00000100:00100000:1.0:1783071654.221692:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692952192 00000100:00100000:1.0:1783071654.221763:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 29 00000100:00100000:1.0:1783071654.221775:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d5c8f6e7-f12c-493c-9545-6cf978dcf267+10:15599:x1869685692952192:12345-192.168.204.38@tcp:101:lctl.0 00010000:00010000:1.0:1783071654.221806:0:17086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071654.221831:0:17086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03bd6400/0x6b58994c2cbdd738 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d99265 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071654.221911:0:17086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03bd6000/0x6b58994c2cbdd73f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071654.221925:0:17086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03bd6000/0x6b58994c2cbdd73f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071654.221939:0:17086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03bd6000/0x6b58994c2cbdd73f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783071654.221984:0:17086:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1783071654.221988:0:17086:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783071654.222043:0:17086:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03bd6000/0x6b58994c2cbdd73f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071654.222071:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03bd6400/0x6b58994c2cbdd738 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99265 expref: 12 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071654.222091:0:17086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03bd6000/0x6b58994c2cbdd73f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99265 expref: 11 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071654.222111:0:17086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8b05a06800) 00010000:00010000:1.0:1783071654.222113:0:17086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783071654.222116:0:17086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a03bd6000, rc 0) 00000100:00100000:1.0:1783071654.222188:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d5c8f6e7-f12c-493c-9545-6cf978dcf267+11:15599:x1869685692952192:12345-192.168.204.38@tcp:101:lctl.0 Request processed in 415us (1724us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071654.222196:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 29 00000100:00100000:3.0:1783071654.255069:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071654.258847:0:17085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692952320 00000100:00100000:2.0:1783071654.258874:0:17085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692952320 00000100:00100000:2.0:1783071654.259407:0:17085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30 00000100:00100000:2.0:1783071654.259423:0:17085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16c37387-7795-4f66-bf99-555c21a639fc+5:15601:x1869685692952320:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1783071654.259452:0:17085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071654.259473:0:17085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdd746 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d9926c expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.259542:0:17085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdd74d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.259556:0:17085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdd74d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.259566:0:17085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdd74d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071654.259628:0:17085:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783071654.259632:0:17085:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783071654.259656:0:17085:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdd74d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.259693:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdd746 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9926c expref: 7 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.259714:0:17085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66a00/0x6b58994c2cbdd74d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9926c expref: 6 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.259723:0:17085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8b05a06800) 00010000:00010000:2.0:1783071654.259726:0:17085:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783071654.259730:0:17085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b2fd66a00, rc 0) 00000100:00100000:2.0:1783071654.259800:0:17085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16c37387-7795-4f66-bf99-555c21a639fc+6:15601:x1869685692952320:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 383us (4741us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071654.259808:0:17085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30 00000100:00100000:2.0:1783071654.263586:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071654.263688:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692952448 00000100:00100000:0.0:1783071654.263698:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692952448 00000100:00100000:0.0:1783071654.263756:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 31 00000100:00100000:0.0:1783071654.263764:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0397e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16c37387-7795-4f66-bf99-555c21a639fc+6:15601:x1869685692952448:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1783071654.263790:0:17087:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071654.263807:0:17087:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce8000/0x6b58994c2cbdd754 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d99273 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071654.263861:0:17087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce8400/0x6b58994c2cbdd75b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071654.263882:0:17087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce8400/0x6b58994c2cbdd75b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071654.263912:0:17087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce8400/0x6b58994c2cbdd75b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071654.263925:0:17087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce9800/0x6b58994c2cbdd762 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071654.263932:0:17087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce9800/0x6b58994c2cbdd762 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071654.263939:0:17087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce9800/0x6b58994c2cbdd762 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071654.264012:0:17087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce9000/0x6b58994c2cbdd769 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071654.264140:0:17087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce9000/0x6b58994c2cbdd769 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071654.264233:0:17087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce9000/0x6b58994c2cbdd769 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783071654.264273:0:17087:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783071654.264276:0:17087:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783071654.264294:0:17087:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce9000/0x6b58994c2cbdd769 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071654.264307:0:17087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce8400/0x6b58994c2cbdd75b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071654.264314:0:17087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce8400/0x6b58994c2cbdd75b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071654.264331:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce8400/0x6b58994c2cbdd75b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071654.264337:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a02ce8400 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:0.0:1783071654.264342:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce8400/0x6b58994c2cbdd75b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071654.264350:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce8400/0x6b58994c2cbdd75b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071654.264404:0:17087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8b05a06800) 00010000:00010000:0.0:1783071654.264407:0:17087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071654.264413:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce8400/0x6b58994c2cbdd75b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071654.264419:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce8400/0x6b58994c2cbdd75b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071654.264432:0:17087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce9800/0x6b58994c2cbdd762 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071654.264438:0:17087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce9800/0x6b58994c2cbdd762 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071654.264443:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce9800/0x6b58994c2cbdd762 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071654.264449:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a02ce9800 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:0.0:1783071654.264451:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce9800/0x6b58994c2cbdd762 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071654.264467:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce9800/0x6b58994c2cbdd762 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071654.264475:0:17087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8f8a02124400) 00010000:00010000:0.0:1783071654.264477:0:17087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071654.264480:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce9800/0x6b58994c2cbdd762 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071654.264486:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce9800/0x6b58994c2cbdd762 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071654.264512:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce8000/0x6b58994c2cbdd754 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99273 expref: 8 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071654.264526:0:17087:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce9000/0x6b58994c2cbdd769 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99273 expref: 7 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071654.264532:0:17087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f8a02124d00) 00010000:00010000:0.0:1783071654.264534:0:17087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783071654.264537:0:17087:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a02ce9000, rc 0) 00000100:00100000:0.0:1783071654.264652:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0397e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16c37387-7795-4f66-bf99-555c21a639fc+7:15601:x1869685692952448:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 887us (1075us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071654.264670:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 31 00000100:00100000:0.0:1783071654.272187:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071654.272402:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692952576 00000100:00100000:3.0:1783071654.272413:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692952576 00000100:00100000:3.0:1783071654.272479:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 6 00000100:00100000:3.0:1783071654.272490:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:16c37387-7795-4f66-bf99-555c21a639fc+5:15601:x1869685692952576:12345-192.168.204.38@tcp:900:lfs.0 00000100:00100000:3.0:1783071654.272579:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:16c37387-7795-4f66-bf99-555c21a639fc+5:15601:x1869685692952576:12345-192.168.204.38@tcp:900:lfs.0 Request processed in 90us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071654.272586:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 6 00000100:00080000:2.0:1783071654.272650:0:17082:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:0.0:1783071654.274998:0:17119:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1783071654.281204:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071654.281352:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692952832 00000100:00100000:1.0:1783071654.281396:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692952832 00000100:00100000:1.0:1783071654.281470:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 32 00000100:00100000:1.0:1783071654.281480:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16c37387-7795-4f66-bf99-555c21a639fc+7:15601:x1869685692952832:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1783071654.281520:0:17086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071654.281542:0:17086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03bd6400/0x6b58994c2cbdd770 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d9927a expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783071654.281652:0:17086:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1783071654.281759:0:17086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03bd6400/0x6b58994c2cbdd770 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9927a expref: 9 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071654.281773:0:17086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8b05a06800) 00010000:00010000:1.0:1783071654.281776:0:17086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783071654.282253:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03bd6400/0x6b58994c2cbdd770 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9927a expref: 9 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071654.282272:0:17086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a03bd6400, rc 0) 00000100:00100000:1.0:1783071654.282345:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16c37387-7795-4f66-bf99-555c21a639fc+8:15601:x1869685692952832:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 867us (1152us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1783071654.282424:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 32 00000100:00100000:0.0:1783071654.288586:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071654.289695:0:17085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692953088 00000100:00100000:2.0:1783071654.289709:0:17085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692953088 00000100:00100000:2.0:1783071654.289820:0:17085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 33 00000100:00100000:2.0:1783071654.289830:0:17085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16c37387-7795-4f66-bf99-555c21a639fc+8:15601:x1869685692953088:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:2.0:1783071654.289898:0:17085:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071654.289925:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce9000/0x6b58994c2cbdd769 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99273 expref: 8 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.289976:0:17085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f8a02124d00) 00010000:00010000:2.0:1783071654.289980:0:17085:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783071654.290004:0:17085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdd77e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.290017:0:17085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdd77e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.290025:0:17085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdd77e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783071654.290611:0:17085:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006bac2b66 reply state 00000000876d569c transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdd77e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.290626:0:17085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdd77e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.290632:0:17085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f8a02124d00) 00010000:00010000:2.0:1783071654.290635:0:17085:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1783071654.290638:0:17085:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1783071654.290656:0:17085:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1783071654.290752:0:17085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16c37387-7795-4f66-bf99-555c21a639fc+9:15601:x1869685692953088:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 921us (2175us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1783071654.290759:0:17085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 33 00000100:00100000:0.0:1783071654.296542:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071654.296845:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692953344 00000100:00100000:2.0:1783071654.296855:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692953344 00000100:00100000:2.0:1783071654.296920:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2 00000100:00100000:2.0:1783071654.296931:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:16c37387-7795-4f66-bf99-555c21a639fc+9:15601:x1869685692953344:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1783071654.297163:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:16c37387-7795-4f66-bf99-555c21a639fc+10:15601:x1869685692953344:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 233us (629us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1783071654.297191:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2 00000100:00100000:3.0:1783071654.300525:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071654.300642:0:19199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692953600 00000100:00100000:2.0:1783071654.300651:0:19199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692953600 00000100:00100000:2.0:1783071654.300711:0:19199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 34 00000100:00100000:2.0:1783071654.300721:0:19199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16c37387-7795-4f66-bf99-555c21a639fc+10:15601:x1869685692953600:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1783071654.300745:0:19199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071654.300765:0:19199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66400/0x6b58994c2cbdd785 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d99281 expref: -99 pid: 19199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.300839:0:19199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66800/0x6b58994c2cbdd78c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.300854:0:19199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66800/0x6b58994c2cbdd78c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.300879:0:19199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66800/0x6b58994c2cbdd78c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.300892:0:19199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdd793 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.300899:0:19199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdd793 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.300906:0:19199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdd793 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071654.301032:0:19199:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1783071654.301101:0:19199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66800/0x6b58994c2cbdd78c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.301129:0:19199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66800/0x6b58994c2cbdd78c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.301136:0:19199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66800/0x6b58994c2cbdd78c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.301142:0:19199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd66800 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:2.0:1783071654.301147:0:19199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66800/0x6b58994c2cbdd78c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.301155:0:19199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66800/0x6b58994c2cbdd78c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.301167:0:19199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8b05a06800) 00010000:00010000:2.0:1783071654.301170:0:19199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071654.301175:0:19199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66800/0x6b58994c2cbdd78c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.301181:0:19199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66800/0x6b58994c2cbdd78c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.301195:0:19199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdd793 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.301201:0:19199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdd793 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.301206:0:19199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdd793 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.301211:0:19199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd67600 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:2.0:1783071654.301219:0:19199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdd793 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.301225:0:19199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdd793 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.301233:0:19199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8f8a02124400) 00010000:00010000:2.0:1783071654.301235:0:19199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071654.301238:0:19199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdd793 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.301243:0:19199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67600/0x6b58994c2cbdd793 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.301275:0:19199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66400/0x6b58994c2cbdd785 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99281 expref: 12 pid: 19199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.301284:0:19199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8b05a06800) 00010000:00010000:2.0:1783071654.301286:0:19199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783071654.301290:0:19199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd66400/0x6b58994c2cbdd785 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99281 expref: 12 pid: 19199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.301300:0:19199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b2fd66400, rc 0) 00000100:00100000:2.0:1783071654.301816:0:19199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16c37387-7795-4f66-bf99-555c21a639fc+11:15601:x1869685692953600:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1093us (1297us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1783071654.301824:0:19199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 34 00000100:00100000:3.0:1783071654.305716:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071654.305939:0:19285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692953728 00000100:00100000:2.0:1783071654.306052:0:19285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692953728 00000100:00100000:2.0:1783071654.306144:0:19285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 35 00000100:00100000:2.0:1783071654.306155:0:19285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16c37387-7795-4f66-bf99-555c21a639fc+11:15601:x1869685692953728:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1783071654.306203:0:19285:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071654.306225:0:19285:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67000/0x6b58994c2cbdd7a1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d99288 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.306332:0:19285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00030800/0x6b58994c2cbdd7a8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.306346:0:19285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00030800/0x6b58994c2cbdd7a8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.306356:0:19285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00030800/0x6b58994c2cbdd7a8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071654.306403:0:19285:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783071654.306407:0:19285:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783071654.306426:0:19285:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00030800/0x6b58994c2cbdd7a8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.306455:0:19285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67000/0x6b58994c2cbdd7a1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99288 expref: 13 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.306473:0:19285:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00030800/0x6b58994c2cbdd7a8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99288 expref: 12 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.306482:0:19285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f8a02124d00) 00010000:00010000:2.0:1783071654.306486:0:19285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783071654.306490:0:19285:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b00030800, rc 0) 00000100:00100000:2.0:1783071654.306550:0:19285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16c37387-7795-4f66-bf99-555c21a639fc+12:15601:x1869685692953728:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 398us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071654.306558:0:19285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 35 00000100:00100000:0.0:1783071654.312004:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071654.312125:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692953856 00000100:00100000:2.0:1783071654.312135:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692953856 00000100:00100000:2.0:1783071654.312197:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3 00000100:00100000:2.0:1783071654.312208:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:16c37387-7795-4f66-bf99-555c21a639fc+12:15601:x1869685692953856:12345-192.168.204.38@tcp:37:lfs.0 00000100:00100000:2.0:1783071654.317020:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:16c37387-7795-4f66-bf99-555c21a639fc+12:15601:x1869685692953856:12345-192.168.204.38@tcp:37:lfs.0 Request processed in 4800us (5013us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071654.317037:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3 00000100:00100000:1.0:1783071654.322912:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071654.323161:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692954112 00000100:00100000:0.0:1783071654.323172:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692954112 00000100:00100000:0.0:1783071654.323231:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 4 00000100:00100000:0.0:1783071654.323242:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0323a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:16c37387-7795-4f66-bf99-555c21a639fc+12:15601:x1869685692954112:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1783071654.323518:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0323a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:16c37387-7795-4f66-bf99-555c21a639fc+13:15601:x1869685692954112:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 278us (615us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1783071654.323526:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 4 00000100:00100000:0.0:1783071654.361978:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071654.362075:0:17085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692954240 00000100:00100000:2.0:1783071654.362085:0:17085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692954240 00000100:00100000:2.0:1783071654.362147:0:17085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 36 00000100:00100000:2.0:1783071654.362157:0:17085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5c8f6e7-f12c-493c-9545-6cf978dcf267+11:15607:x1869685692954240:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:2.0:1783071654.362188:0:17085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071654.362211:0:17085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031200/0x6b58994c2cbdd7af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d9928f expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.362292:0:17085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031600/0x6b58994c2cbdd7b6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.362307:0:17085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031600/0x6b58994c2cbdd7b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.362319:0:17085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031600/0x6b58994c2cbdd7b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.362331:0:17085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031a00/0x6b58994c2cbdd7bd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.362338:0:17085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031a00/0x6b58994c2cbdd7bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.362404:0:17085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031a00/0x6b58994c2cbdd7bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.362488:0:17085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00030c00/0x6b58994c2cbdd7c4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.362497:0:17085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00030c00/0x6b58994c2cbdd7c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.362503:0:17085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00030c00/0x6b58994c2cbdd7c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071654.362542:0:17085:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783071654.362546:0:17085:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783071654.362582:0:17085:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00030c00/0x6b58994c2cbdd7c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.362595:0:17085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031600/0x6b58994c2cbdd7b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.362602:0:17085:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031600/0x6b58994c2cbdd7b6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.362608:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031600/0x6b58994c2cbdd7b6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.362613:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b00031600 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:2.0:1783071654.362617:0:17085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031600/0x6b58994c2cbdd7b6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.362625:0:17085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031600/0x6b58994c2cbdd7b6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.362645:0:17085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8b05a06800) 00010000:00010000:2.0:1783071654.362648:0:17085:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071654.362653:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031600/0x6b58994c2cbdd7b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.362660:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031600/0x6b58994c2cbdd7b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.362675:0:17085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031a00/0x6b58994c2cbdd7bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.362681:0:17085:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031a00/0x6b58994c2cbdd7bd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.362686:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031a00/0x6b58994c2cbdd7bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.362691:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b00031a00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:2.0:1783071654.362693:0:17085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031a00/0x6b58994c2cbdd7bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.362699:0:17085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031a00/0x6b58994c2cbdd7bd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.362706:0:17085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8f8a02124400) 00010000:00010000:2.0:1783071654.362708:0:17085:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071654.362711:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031a00/0x6b58994c2cbdd7bd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.362717:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031a00/0x6b58994c2cbdd7bd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.362754:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031200/0x6b58994c2cbdd7af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9928f expref: 13 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.362767:0:17085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00030c00/0x6b58994c2cbdd7c4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9928f expref: 12 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.362775:0:17085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f8a02124d00) 00010000:00010000:2.0:1783071654.362777:0:17085:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1783071654.362779:0:17085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b00030c00, rc 0) 00000100:00100000:2.0:1783071654.362851:0:17085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5c8f6e7-f12c-493c-9545-6cf978dcf267+12:15607:x1869685692954240:12345-192.168.204.38@tcp:101:bash.0 Request processed in 695us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071654.362858:0:17085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 36 00000100:00100000:3.0:1783071654.367538:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071654.367663:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692954368 00000100:00100000:0.0:1783071654.367674:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692954368 00000100:00100000:0.0:1783071654.367740:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 7 00000100:00100000:0.0:1783071654.367751:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d5c8f6e7-f12c-493c-9545-6cf978dcf267+5:15607:x1869685692954368:12345-192.168.204.38@tcp:900:bash.0 00000100:00100000:0.0:1783071654.367842:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d5c8f6e7-f12c-493c-9545-6cf978dcf267+5:15607:x1869685692954368:12345-192.168.204.38@tcp:900:bash.0 Request processed in 93us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071654.367849:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 7 00000100:00100000:3.0:1783071654.371284:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071654.371419:0:19199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692954624 00000100:00100000:2.0:1783071654.371429:0:19199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692954624 00000100:00100000:2.0:1783071654.371490:0:19199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 37 00000100:00100000:2.0:1783071654.371500:0:19199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5c8f6e7-f12c-493c-9545-6cf978dcf267+12:15607:x1869685692954624:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:2.0:1783071654.371522:0:19199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071654.371544:0:19199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031200/0x6b58994c2cbdd7cb lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d99296 expref: -99 pid: 19199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.371678:0:19199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031a00/0x6b58994c2cbdd7d2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.371692:0:19199:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00030800/0x6b58994c2cbdd7a8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99288 expref: 12 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.371701:0:19199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031a00/0x6b58994c2cbdd7d2 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.371753:0:19199:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00030800/0x6b58994c2cbdd7a8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99288 expref: 12 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.371765:0:19199:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00030800/0x6b58994c2cbdd7a8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99288 expref: 12 pid: 19285 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071654.371779:0:19199:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0397dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19199:1869685707708288:192.168.204.38@tcp:104: 00000100:00100000:2.0:1783071654.371877:0:19199:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b18ffa780 going to sleep for 11 seconds 00000100:00100000:3.0:1783071654.376540:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071654.376845:0:19199:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0397dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19199:1869685707708288:192.168.204.38@tcp:104: 00010000:00010000:2.0:1783071654.376908:0:19199:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031a00/0x6b58994c2cbdd7d2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071654.377523:0:20112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692954752 00000100:00100000:0.0:1783071654.377531:0:20112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692954752 00010000:00010000:1.0:1783071654.377788:0:20112:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00030800/0x6b58994c2cbdd7a8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99288 expref: 13 pid: 19285 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071654.377873:0:20112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 16 00000100:00100000:1.0:1783071654.377884:0:20112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16c37387-7795-4f66-bf99-555c21a639fc+13:2405:x1869685692954752:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783071654.377899:0:20112:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071654.377906:0:20112:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00030800/0x6b58994c2cbdd7a8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99288 expref: 13 pid: 19285 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071654.377917:0:20112:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00030800/0x6b58994c2cbdd7a8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99288 expref: 13 pid: 19285 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071654.378011:0:20112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00030800/0x6b58994c2cbdd7a8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99288 expref: 13 pid: 19285 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071654.378029:0:20112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f8a02124d00) 00010000:00010000:1.0:1783071654.378034:0:20112:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031a00/0x6b58994c2cbdd7d2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071654.378044:0:20112:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031a00/0x6b58994c2cbdd7d2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071654.378052:0:20112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031a00/0x6b58994c2cbdd7d2 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071654.378084:0:20112:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071654.378157:0:20112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16c37387-7795-4f66-bf99-555c21a639fc+12:2405:x1869685692954752:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 275us (1628us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071654.378176:0:20112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 16 00010000:00010000:2.0:1783071654.378238:0:19199:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031a00/0x6b58994c2cbdd7d2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.378255:0:19199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031a00/0x6b58994c2cbdd7d2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.378279:0:19199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031600/0x6b58994c2cbdd7d9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.378290:0:19199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031600/0x6b58994c2cbdd7d9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.378298:0:19199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031600/0x6b58994c2cbdd7d9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.378835:0:19199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031400/0x6b58994c2cbdd7e0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.378855:0:19199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031400/0x6b58994c2cbdd7e0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.378877:0:19199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031400/0x6b58994c2cbdd7e0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071654.378890:0:19199:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1783071654.378920:0:19199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031a00/0x6b58994c2cbdd7d2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.378926:0:19199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031a00/0x6b58994c2cbdd7d2 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.378933:0:19199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031a00/0x6b58994c2cbdd7d2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.379147:0:19199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b00031a00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:2.0:1783071654.379152:0:19199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031a00/0x6b58994c2cbdd7d2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.379161:0:19199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031a00/0x6b58994c2cbdd7d2 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.379185:0:19199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f8a02124d00) 00010000:00010000:2.0:1783071654.379188:0:19199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071654.379192:0:19199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031a00/0x6b58994c2cbdd7d2 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.379200:0:19199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031a00/0x6b58994c2cbdd7d2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783071654.379214:0:19199:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000015d2c476 reply state 00000000471dbbbb transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031600/0x6b58994c2cbdd7d9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.379234:0:19199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031600/0x6b58994c2cbdd7d9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.379240:0:19199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8f8b1093b900) 00010000:00010000:2.0:1783071654.379296:0:19199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783071654.379299:0:19199:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783071654.379338:0:19199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031200/0x6b58994c2cbdd7cb lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99296 expref: 15 pid: 19199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.379354:0:19199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031400/0x6b58994c2cbdd7e0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99296 expref: 14 pid: 19199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.379361:0:19199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f8b1093b000) 00010000:00010000:2.0:1783071654.379411:0:19199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1783071654.379414:0:19199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b00031400, rc 0) 00000100:00100000:2.0:1783071654.379457:0:19199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5c8f6e7-f12c-493c-9545-6cf978dcf267+15:15607:x1869685692954624:12345-192.168.204.38@tcp:101:bash.0 Request processed in 7959us (8181us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1783071654.379464:0:19199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 37 00000100:00100000:2.0:1783071654.400556:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071654.403476:0:19285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692954880 00000100:00100000:3.0:1783071654.403491:0:19285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692954880 00000100:00100000:3.0:1783071654.403613:0:19285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 38 00000100:00100000:3.0:1783071654.403626:0:19285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0397dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d5c8f6e7-f12c-493c-9545-6cf978dcf267+15:15607:x1869685692954880:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:3.0:1783071654.403651:0:19285:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071654.403671:0:19285:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460a00/0x6b58994c2cbdd7ee lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d9929d expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.403749:0:19285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460800/0x6b58994c2cbdd7f5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.403778:0:19285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460800/0x6b58994c2cbdd7f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.404233:0:19285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460800/0x6b58994c2cbdd7f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783071654.404293:0:19285:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1783071654.404298:0:19285:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783071654.404321:0:19285:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460800/0x6b58994c2cbdd7f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.404332:0:19285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460800/0x6b58994c2cbdd7f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.404360:0:19285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460a00/0x6b58994c2cbdd7ee lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9929d expref: 17 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.404406:0:19285:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460800/0x6b58994c2cbdd7f5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9929d expref: 16 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.404414:0:19285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f8b1093b000) 00010000:00010000:3.0:1783071654.404417:0:19285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783071654.404421:0:19285:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b3c460800, rc 0) 00000100:00100000:3.0:1783071654.404491:0:19285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0397dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d5c8f6e7-f12c-493c-9545-6cf978dcf267+16:15607:x1869685692954880:12345-192.168.204.38@tcp:101:bash.0 Request processed in 869us (3948us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071654.404497:0:19285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 38 00000100:00100000:3.0:1783071654.407766:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071654.407996:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692955136 00000100:00100000:2.0:1783071654.408005:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692955136 00000100:00100000:2.0:1783071654.408063:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 5 00000100:00100000:2.0:1783071654.408074:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d5c8f6e7-f12c-493c-9545-6cf978dcf267+16:15607:x1869685692955136:12345-192.168.204.38@tcp:35:bash.0 00000100:00100000:2.0:1783071654.409337:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d5c8f6e7-f12c-493c-9545-6cf978dcf267+17:15607:x1869685692955136:12345-192.168.204.38@tcp:35:bash.0 Request processed in 292us (607us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1783071654.409348:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 5 00000100:00100000:0.0:1783071654.487981:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071654.488087:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692955392 00000100:00100000:1.0:1783071654.488098:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692955392 00000100:00100000:1.0:1783071654.488167:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 39 00000100:00100000:1.0:1783071654.488178:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d5c8f6e7-f12c-493c-9545-6cf978dcf267+17:15617:x1869685692955392:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1783071654.488205:0:17086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071654.488224:0:17086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03bd6400/0x6b58994c2cbdd7fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d992a4 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783071654.488338:0:17086:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1783071654.488478:0:17086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03bd6400/0x6b58994c2cbdd7fc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d992a4 expref: 19 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071654.488494:0:17086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8b05a06800) 00010000:00010000:1.0:1783071654.488497:0:17086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783071654.488502:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03bd6400/0x6b58994c2cbdd7fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d992a4 expref: 19 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071654.488516:0:17086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a03bd6400, rc 0) 00000100:00100000:1.0:1783071654.488616:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d5c8f6e7-f12c-493c-9545-6cf978dcf267+18:15617:x1869685692955392:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 439us (644us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1783071654.488623:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 39 00000100:00100000:0.0:1783071654.497847:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071654.497959:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692955648 00000100:00100000:1.0:1783071654.497969:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692955648 00000100:00100000:1.0:1783071654.498173:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 6 00000100:00100000:1.0:1783071654.498182:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d5c8f6e7-f12c-493c-9545-6cf978dcf267+18:15617:x1869685692955648:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1783071654.498575:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d5c8f6e7-f12c-493c-9545-6cf978dcf267+19:15617:x1869685692955648:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 393us (737us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1783071654.498582:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 6 00000100:00100000:3.0:1783071654.533886:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071654.534216:0:19199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692955904 00000100:00100000:2.0:1783071654.534226:0:19199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692955904 00000100:00100000:2.0:1783071654.534289:0:19199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 40 00000100:00100000:2.0:1783071654.534300:0:19199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5c8f6e7-f12c-493c-9545-6cf978dcf267+19:15620:x1869685692955904:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1783071654.534332:0:19199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071654.534352:0:19199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031200/0x6b58994c2cbdd80a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d992ab expref: -99 pid: 19199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.534498:0:19199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031a00/0x6b58994c2cbdd811 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.534519:0:19199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031a00/0x6b58994c2cbdd811 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.534532:0:19199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031a00/0x6b58994c2cbdd811 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071654.534544:0:19199:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1783071654.534739:0:19199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031200/0x6b58994c2cbdd80a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d992ab expref: 22 pid: 19199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.534772:0:19199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031a00/0x6b58994c2cbdd811 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d992ab expref: 21 pid: 19199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071654.534782:0:19199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f8b1093b000) 00010000:00010000:2.0:1783071654.534785:0:19199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783071654.534788:0:19199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b00031a00, rc 0) 00000100:00100000:2.0:1783071654.534875:0:19199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5c8f6e7-f12c-493c-9545-6cf978dcf267+21:15620:x1869685692955904:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 576us (999us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1783071654.534904:0:19199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 40 00000100:00100000:0.0:1783071654.538514:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071654.538658:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071654.538674:0:19285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692956032 00000100:00100000:3.0:1783071654.538699:0:19285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692956032 00000100:00100000:1.0:1783071654.538742:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692956160 00000100:00100000:1.0:1783071654.538747:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692956160 00000100:00100000:3.0:1783071654.538774:0:19285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 41 00000100:00100000:3.0:1783071654.538785:0:19285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d5c8f6e7-f12c-493c-9545-6cf978dcf267+22:15620:x1869685692956032:12345-192.168.204.38@tcp:54:lfs.0 00000100:00100000:1.0:1783071654.538847:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 0 00000100:00100000:1.0:1783071654.538855:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5c8f6e7-f12c-493c-9545-6cf978dcf267+22:2405:x1869685692956160:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783071654.538876:0:17073:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071654.538877:0:19285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460a00/0x6b58994c2cbdd81f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071654.538897:0:17073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031a00/0x6b58994c2cbdd811 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d992ab expref: 22 pid: 19199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.538900:0:19285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460a00/0x6b58994c2cbdd81f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.538910:0:19285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460a00/0x6b58994c2cbdd81f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071654.538914:0:17073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f8b1093b000) 00010000:00010000:1.0:1783071654.538918:0:17073:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783071654.538943:0:19285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460a00/0x6b58994c2cbdd81f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.538950:0:19285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460a00/0x6b58994c2cbdd81f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.538956:0:19285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460a00/0x6b58994c2cbdd81f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.538962:0:19285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b3c460a00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071654.538966:0:19285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460a00/0x6b58994c2cbdd81f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.538973:0:19285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460a00/0x6b58994c2cbdd81f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.538982:0:19285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f8b1093b000) 00010000:00010000:3.0:1783071654.538985:0:19285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00000100:00100000:1.0:1783071654.538986:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5c8f6e7-f12c-493c-9545-6cf978dcf267+21:2405:x1869685692956160:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 132us (333us total) trans 0 rc 0/0 00010000:00010000:3.0:1783071654.538989:0:19285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460a00/0x6b58994c2cbdd81f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071654.538993:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 0 00010000:00010000:3.0:1783071654.539004:0:19285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460a00/0x6b58994c2cbdd81f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071654.539037:0:19285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d5c8f6e7-f12c-493c-9545-6cf978dcf267+20:15620:x1869685692956032:12345-192.168.204.38@tcp:54:lfs.0 Request processed in 255us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071654.539044:0:19285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 41 00000100:00100000:0.0:1783071654.541140:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071654.541464:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692956416 00000100:00100000:2.0:1783071654.541473:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692956416 00000100:00100000:2.0:1783071654.541560:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 7 00000100:00100000:2.0:1783071654.541571:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d5c8f6e7-f12c-493c-9545-6cf978dcf267+20:15620:x1869685692956416:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1783071654.541779:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d5c8f6e7-f12c-493c-9545-6cf978dcf267+21:15620:x1869685692956416:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 210us (647us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1783071654.541788:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 7 00000100:00100000:0.0:1783071654.850171:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071654.850266:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692956672 00000100:00100000:3.0:1783071654.850277:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692956672 00000100:00100000:3.0:1783071654.850346:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 42 00000100:00100000:3.0:1783071654.850358:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5c8f6e7-f12c-493c-9545-6cf978dcf267+21:15651:x1869685692956672:12345-192.168.204.38@tcp:101:cat.0 00010000:00010000:3.0:1783071654.850428:0:17087:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071654.850451:0:17087:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460a00/0x6b58994c2cbdd826 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d992b2 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.850563:0:17087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460c00/0x6b58994c2cbdd82d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.850579:0:17087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460c00/0x6b58994c2cbdd82d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.850590:0:17087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460c00/0x6b58994c2cbdd82d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783071654.850603:0:17087:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1783071654.850813:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460a00/0x6b58994c2cbdd826 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d992b2 expref: 24 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.850832:0:17087:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460c00/0x6b58994c2cbdd82d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d992b2 expref: 23 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.850867:0:17087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f8b1093b000) 00010000:00010000:3.0:1783071654.850871:0:17087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783071654.850875:0:17087:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b3c460c00, rc 0) 00010000:00010000:2.0:1783071654.853055:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071654.853256:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5c8f6e7-f12c-493c-9545-6cf978dcf267+23:15651:x1869685692956672:12345-192.168.204.38@tcp:101:cat.0 Request processed in 2893us (3088us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1783071654.853267:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 42 00000100:00100000:0.0:1783071654.860733:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071654.861404:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692956800 00000100:00100000:1.0:1783071654.861416:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692956800 00000100:00100000:1.0:1783071654.861487:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1 00000100:00100000:1.0:1783071654.861497:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01767480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5c8f6e7-f12c-493c-9545-6cf978dcf267+23:2405:x1869685692956800:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783071654.861514:0:17072:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071654.861539:0:17072:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460c00/0x6b58994c2cbdd82d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d992b2 expref: 23 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071654.861557:0:17072:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f8b1093b000) 00010000:00010000:1.0:1783071654.861561:0:17072:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071654.861646:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01767480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5c8f6e7-f12c-493c-9545-6cf978dcf267+22:2405:x1869685692956800:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 149us (923us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071654.861655:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1 00000100:00100000:2.0:1783071654.861826:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071654.862305:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692957056 00000100:00100000:1.0:1783071654.862311:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692957056 00000100:00100000:1.0:1783071654.862420:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 8 00000100:00100000:1.0:1783071654.862430:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0397c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d5c8f6e7-f12c-493c-9545-6cf978dcf267+22:15651:x1869685692957056:12345-192.168.204.38@tcp:35:cat.0 00000100:00100000:1.0:1783071654.862724:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0397c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d5c8f6e7-f12c-493c-9545-6cf978dcf267+23:15651:x1869685692957056:12345-192.168.204.38@tcp:35:cat.0 Request processed in 295us (896us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1783071654.862732:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 8 00000100:00100000:2.0:1783071654.922723:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071654.923077:0:19199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692957312 00000100:00100000:1.0:1783071654.923087:0:19199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692957312 00000100:00100000:1.0:1783071654.923153:0:19199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 43 00000100:00100000:1.0:1783071654.923165:0:19199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0397c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5c8f6e7-f12c-493c-9545-6cf978dcf267+23:15657:x1869685692957312:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:1.0:1783071654.923196:0:19199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071654.923222:0:19199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03bd6400/0x6b58994c2cbdd83b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d992b9 expref: -99 pid: 19199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071654.923425:0:19199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03bd7000/0x6b58994c2cbdd842 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071654.923441:0:19199:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031400/0x6b58994c2cbdd7e0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99296 expref: 24 pid: 19199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071654.923451:0:19199:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460800/0x6b58994c2cbdd7f5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9929d expref: 24 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071654.923459:0:19199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03bd7000/0x6b58994c2cbdd842 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071654.923501:0:19199:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460800/0x6b58994c2cbdd7f5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9929d expref: 24 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071654.923516:0:19199:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460800/0x6b58994c2cbdd7f5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9929d expref: 24 pid: 19285 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071654.923530:0:19199:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19199:1869685707708416:192.168.204.38@tcp:104: 00010000:00010000:1.0:1783071654.923629:0:19199:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031400/0x6b58994c2cbdd7e0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99296 expref: 24 pid: 19199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071654.923638:0:19199:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031400/0x6b58994c2cbdd7e0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99296 expref: 24 pid: 19199 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071654.923646:0:19199:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19199:1869685707708544:192.168.204.38@tcp:104: 00000100:00100000:1.0:1783071654.923668:0:19199:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b06258d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783071654.931163:0:19199:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19199:1869685707708416:192.168.204.38@tcp:104: 00000100:00100000:1.0:1783071654.931183:0:19199:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19199:1869685707708544:192.168.204.38@tcp:104: 00010000:00010000:1.0:1783071654.931215:0:19199:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03bd7000/0x6b58994c2cbdd842 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071654.933634:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071654.933684:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071654.933776:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692957440 00000100:00100000:3.0:1783071654.933786:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692957440 00010000:00010000:3.0:1783071654.933827:0:17071:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460800/0x6b58994c2cbdd7f5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9929d expref: 25 pid: 19285 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071654.933875:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692957568 00000100:00100000:3.0:1783071654.933879:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692957568 00010000:00010000:3.0:1783071654.933892:0:17071:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031400/0x6b58994c2cbdd7e0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99296 expref: 26 pid: 19199 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071654.933924:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 17 00000100:00100000:3.0:1783071654.933944:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0397d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5c8f6e7-f12c-493c-9545-6cf978dcf267+26:2406:x1869685692957440:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783071654.933961:0:17071:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071654.933968:0:17071:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460800/0x6b58994c2cbdd7f5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9929d expref: 26 pid: 19285 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.933981:0:17071:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460800/0x6b58994c2cbdd7f5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9929d expref: 26 pid: 19285 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.934006:0:17071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460800/0x6b58994c2cbdd7f5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d9929d expref: 26 pid: 19285 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.934037:0:17071:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f8b1093b000) 00010000:00010000:3.0:1783071654.934043:0:17071:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03bd7000/0x6b58994c2cbdd842 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.934051:0:17071:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03bd7000/0x6b58994c2cbdd842 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.934057:0:17071:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783071654.934114:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0397d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5c8f6e7-f12c-493c-9545-6cf978dcf267+25:2406:x1869685692957440:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 170us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071654.934121:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 17 00000100:00100000:3.0:1783071654.934139:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18 00000100:00100000:3.0:1783071654.934146:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3eb8f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5c8f6e7-f12c-493c-9545-6cf978dcf267+24:2406:x1869685692957568:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783071654.934153:0:17071:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071654.934158:0:17071:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031400/0x6b58994c2cbdd7e0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99296 expref: 24 pid: 19199 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.934168:0:17071:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031400/0x6b58994c2cbdd7e0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99296 expref: 24 pid: 19199 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.934180:0:17071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031400/0x6b58994c2cbdd7e0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d99296 expref: 24 pid: 19199 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.934191:0:17071:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f8b1093b000) 00010000:00010000:3.0:1783071654.934195:0:17071:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03bd7000/0x6b58994c2cbdd842 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.934215:0:17071:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03bd7000/0x6b58994c2cbdd842 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.934222:0:17071:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03bd7000/0x6b58994c2cbdd842 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.934261:0:17071:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783071654.934283:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3eb8f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5c8f6e7-f12c-493c-9545-6cf978dcf267+23:2406:x1869685692957568:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 137us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071654.934291:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18 00010000:00010000:3.0:1783071654.934468:0:19199:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03bd7000/0x6b58994c2cbdd842 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.934477:0:19199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03bd7000/0x6b58994c2cbdd842 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783071654.934496:0:19199:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1783071654.934650:0:19199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03bd6400/0x6b58994c2cbdd83b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d992b9 expref: 24 pid: 19199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.934666:0:19199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03bd7000/0x6b58994c2cbdd842 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d992b9 expref: 23 pid: 19199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.934673:0:19199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f8b1093b000) 00010000:00010000:3.0:1783071654.934676:0:19199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783071654.934679:0:19199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a03bd7000, rc 0) 00000100:00100000:3.0:1783071654.934712:0:19199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0397c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5c8f6e7-f12c-493c-9545-6cf978dcf267+23:15657:x1869685692957312:12345-192.168.204.38@tcp:101:dd.0 Request processed in 11549us (11998us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1783071654.934728:0:19199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 43 00000100:00100000:2.0:1783071654.939712:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071654.939798:0:19285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692957696 00000100:00100000:3.0:1783071654.939808:0:19285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692957696 00000100:00100000:3.0:1783071654.939910:0:19285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 44 00000100:00100000:3.0:1783071654.939922:0:19285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0397c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d5c8f6e7-f12c-493c-9545-6cf978dcf267+23:15657:x1869685692957696:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:3.0:1783071654.939963:0:19285:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071654.939984:0:19285:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460000/0x6b58994c2cbdd850 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d992c0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.940018:0:19285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460a00/0x6b58994c2cbdd857 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.940033:0:19285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460a00/0x6b58994c2cbdd857 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.940045:0:19285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460a00/0x6b58994c2cbdd857 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.940159:0:19285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460000/0x6b58994c2cbdd850 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d992c0 expref: 25 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.940178:0:19285:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460a00/0x6b58994c2cbdd857 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d992c0 expref: 24 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.940187:0:19285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f8b1093b000) 00010000:00010000:3.0:1783071654.940190:0:19285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783071654.940195:0:19285:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b3c460a00, rc 0) 00000100:00100000:3.0:1783071654.940274:0:19285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0397c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d5c8f6e7-f12c-493c-9545-6cf978dcf267+24:15657:x1869685692957696:12345-192.168.204.38@tcp:101:dd.0 Request processed in 353us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071654.940288:0:19285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 44 00000100:00100000:3.0:1783071654.948196:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071654.948506:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692957952 00000100:00100000:0.0:1783071654.948517:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692957952 00000100:00100000:0.0:1783071654.948609:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 45 00000100:00100000:0.0:1783071654.948621:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5c8f6e7-f12c-493c-9545-6cf978dcf267+24:15657:x1869685692957952:12345-192.168.204.38@tcp:36:dd.0 00010000:00010000:0.0:1783071654.948866:0:17087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce8a00/0x6b58994c2cbdd85e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071654.948883:0:17087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce8a00/0x6b58994c2cbdd85e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071654.948895:0:17087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce8a00/0x6b58994c2cbdd85e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783071654.948947:0:17087:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1783071654.948968:0:17087:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b4960b7a reply state 00000000181c2bfa transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce8a00/0x6b58994c2cbdd85e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071654.948980:0:17087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce8a00/0x6b58994c2cbdd85e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071654.948987:0:17087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f8b1093b000) 00010000:00010000:0.0:1783071654.948990:0:17087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783071654.948994:0:17087:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783071654.949088:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5c8f6e7-f12c-493c-9545-6cf978dcf267+27:15657:x1869685692957952:12345-192.168.204.38@tcp:36:dd.0 Request processed in 469us (901us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1783071654.949097:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 45 00000020:00080000:0.0:1783071654.949101:0:17087:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1783071654.964654:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071654.971296:0:19199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692958080 00000100:00100000:3.0:1783071654.971314:0:19199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692958080 00000100:00100000:3.0:1783071654.971459:0:19199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 46 00000100:00100000:3.0:1783071654.971469:0:19199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a01767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5c8f6e7-f12c-493c-9545-6cf978dcf267+27:15657:x1869685692958080:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:3.0:1783071654.971491:0:19199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071654.971514:0:19199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460000/0x6b58994c2cbdd865 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d992c7 expref: -99 pid: 19199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.971574:0:19199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460000/0x6b58994c2cbdd865 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d992c7 expref: 28 pid: 19199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.971589:0:19199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460000/0x6b58994c2cbdd865 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d992c7 expref: 28 pid: 19199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.971610:0:19199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f8b1093b000) 00010000:00010000:3.0:1783071654.971613:0:19199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783071654.971616:0:19199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b3c460000, rc 0) 00000100:00100000:3.0:1783071654.971680:0:19199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a01767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5c8f6e7-f12c-493c-9545-6cf978dcf267+28:15657:x1869685692958080:12345-192.168.204.38@tcp:101:dd.0 Request processed in 213us (7318us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071654.971687:0:19199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 46 00000100:00100000:2.0:1783071654.985716:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071654.985812:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692958336 00000100:00100000:3.0:1783071654.985823:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692958336 00000100:00100000:3.0:1783071654.985907:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2 00000100:00100000:3.0:1783071654.985920:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0397f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5c8f6e7-f12c-493c-9545-6cf978dcf267+28:15657:x1869685692958336:12345-192.168.204.38@tcp:103:dd.0 00010000:00010000:3.0:1783071654.986228:0:17071:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071654.986256:0:17071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460000/0x6b58994c2cbdd865 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d992c7 expref: 28 pid: 19199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.986276:0:17071:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f8b1093b000) 00010000:00010000:3.0:1783071654.986282:0:17071:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783071654.986463:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0397f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5c8f6e7-f12c-493c-9545-6cf978dcf267+27:15657:x1869685692958336:12345-192.168.204.38@tcp:103:dd.0 Request processed in 546us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071654.986471:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2 00000100:00100000:0.0:1783071654.992549:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071654.992627:0:19285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692958464 00000100:00100000:3.0:1783071654.992637:0:19285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692958464 00000100:00100000:3.0:1783071654.992689:0:19285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 47 00000100:00100000:3.0:1783071654.992699:0:19285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02c08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d5c8f6e7-f12c-493c-9545-6cf978dcf267+27:15657:x1869685692958464:12345-192.168.204.38@tcp:58:dd.0 00010000:00010000:3.0:1783071654.992812:0:19285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460000/0x6b58994c2cbdd86c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.992843:0:19285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460000/0x6b58994c2cbdd86c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071654.992866:0:19285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460000/0x6b58994c2cbdd86c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783071654.998597:0:19285:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783071654.998631:0:19285:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1783071654.998779:0:19285:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1783071654.998895:0:19285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02c08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d5c8f6e7-f12c-493c-9545-6cf978dcf267+27:15657:x1869685692958464:12345-192.168.204.38@tcp:58:dd.0 Request processed in 6191us (6349us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071654.998906:0:19285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 47 00000100:00100000:0.0:1783071655.004805:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071655.005008:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692958592 00000100:00100000:1.0:1783071655.005020:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692958592 00000100:00100000:1.0:1783071655.005144:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 48 00000100:00100000:1.0:1783071655.005157:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02c09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d5c8f6e7-f12c-493c-9545-6cf978dcf267+27:15657:x1869685692958592:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:1.0:1783071655.005182:0:17086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071655.005226:0:17086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03bd6400/0x6b58994c2cbdd873 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d992ce expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.005400:0:17086:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460000/0x6b58994c2cbdd86c lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.005413:0:17086:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03bd6400/0x6b58994c2cbdd873 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d992ce expref: 28 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.005434:0:17086:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460000/0x6b58994c2cbdd86c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.005449:0:17086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03bd6400/0x6b58994c2cbdd873 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d992ce expref: 28 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.005538:0:17086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f8b1093b000) 00010000:00010000:1.0:1783071655.005542:0:17086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783071655.005546:0:17086:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03bd6400/0x6b58994c2cbdd873 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d992ce expref: 28 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.005555:0:17086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a03bd6400, rc 0) 00000100:00100000:1.0:1783071655.005769:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02c09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d5c8f6e7-f12c-493c-9545-6cf978dcf267+28:15657:x1869685692958592:12345-192.168.204.38@tcp:101:dd.0 Request processed in 614us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071655.005778:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 48 00000040:00080000:1.0:1783071655.043040:0:17836:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1783071655.300575:0:17119:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1783071655.300587:0:17119:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783071655.300635:0:17119:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1783071655.300652:0:17119:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1783071655.301973:0:17119:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02c0bb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17119:1869685707708672:192.168.204.38@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783071655.303951:0:17119:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b3af8c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783071655.311199:0:17119:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02c0bb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17119:1869685707708672:192.168.204.38@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783071655.314907:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071655.319411:0:19199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692958720 00000100:00100000:3.0:1783071655.319599:0:19199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692958720 00000100:00100000:3.0:1783071655.319761:0:19199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 49 00000100:00100000:3.0:1783071655.319774:0:19199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02c09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5c8f6e7-f12c-493c-9545-6cf978dcf267+28:15659:x1869685692958720:12345-192.168.204.38@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783071655.319823:0:19199:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783071655.320024:0:19199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02c09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5c8f6e7-f12c-493c-9545-6cf978dcf267+28:15659:x1869685692958720:12345-192.168.204.38@tcp:53:lhsmtool_posix.0 Request processed in 251us (5131us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071655.320052:0:19199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 49 00000100:00100000:0.0:1783071655.326867:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071655.327023:0:19285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692958848 00000100:00100000:2.0:1783071655.327037:0:19285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692958848 00000100:00100000:2.0:1783071655.329416:0:19285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 50 00000100:00100000:2.0:1783071655.329548:0:19285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02c08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d5c8f6e7-f12c-493c-9545-6cf978dcf267+28:15659:x1869685692958848:12345-192.168.204.38@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1783071655.329670:0:19285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031a00/0x6b58994c2cbdd87a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071655.329694:0:19285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031a00/0x6b58994c2cbdd87a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071655.329713:0:19285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031a00/0x6b58994c2cbdd87a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071655.332226:0:19285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00030800/0x6b58994c2cbdd881 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071655.332257:0:19285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00030800/0x6b58994c2cbdd881 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071655.332272:0:19285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00030800/0x6b58994c2cbdd881 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071655.332315:0:19285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031200/0x6b58994c2cbdd888 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071655.332326:0:19285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031200/0x6b58994c2cbdd888 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071655.332334:0:19285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031200/0x6b58994c2cbdd888 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071655.332429:0:19285:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1783071655.332434:0:19285:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783071655.332450:0:19285:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031200/0x6b58994c2cbdd888 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071655.332464:0:19285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031a00/0x6b58994c2cbdd87a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071655.332485:0:19285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031a00/0x6b58994c2cbdd87a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071655.332493:0:19285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031a00/0x6b58994c2cbdd87a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071655.332500:0:19285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b00031a00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:2.0:1783071655.332505:0:19285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031a00/0x6b58994c2cbdd87a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071655.332514:0:19285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031a00/0x6b58994c2cbdd87a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071655.332528:0:19285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f8b1093ba00) 00010000:00010000:2.0:1783071655.332531:0:19285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071655.332543:0:19285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031a00/0x6b58994c2cbdd87a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071655.332550:0:19285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031a00/0x6b58994c2cbdd87a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071655.332569:0:19285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00030800/0x6b58994c2cbdd881 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071655.332574:0:19285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00030800/0x6b58994c2cbdd881 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071655.332580:0:19285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00030800/0x6b58994c2cbdd881 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071655.332585:0:19285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b00030800 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:2.0:1783071655.332594:0:19285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00030800/0x6b58994c2cbdd881 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071655.332942:0:19285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00030800/0x6b58994c2cbdd881 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071655.332955:0:19285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8f8b1093b700) 00010000:00010000:2.0:1783071655.332958:0:19285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071655.332961:0:19285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00030800/0x6b58994c2cbdd881 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071655.332968:0:19285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00030800/0x6b58994c2cbdd881 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071655.332996:0:19285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031200/0x6b58994c2cbdd888 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071655.333002:0:19285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031200/0x6b58994c2cbdd888 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071655.333007:0:19285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031200/0x6b58994c2cbdd888 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071655.333011:0:19285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b00031200 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:2.0:1783071655.333014:0:19285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031200/0x6b58994c2cbdd888 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071655.333019:0:19285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031200/0x6b58994c2cbdd888 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071655.333027:0:19285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f8b1093b000) 00010000:00010000:2.0:1783071655.333029:0:19285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071655.333039:0:19285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031200/0x6b58994c2cbdd888 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071655.333044:0:19285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031200/0x6b58994c2cbdd888 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071655.333153:0:19285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02c08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d5c8f6e7-f12c-493c-9545-6cf978dcf267+28:15659:x1869685692958848:12345-192.168.204.38@tcp:34:lhsmtool_posix.0 Request processed in 3620us (6314us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071655.333165:0:19285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 50 00000100:00100000:2.0:1783071655.338830:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071655.338918:0:17085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692959104 00000100:00100000:3.0:1783071655.338934:0:17085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692959104 00000100:00100000:3.0:1783071655.339102:0:17085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 51 00000100:00100000:3.0:1783071655.339113:0:17085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0397d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5c8f6e7-f12c-493c-9545-6cf978dcf267+28:15659:x1869685692959104:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783071655.339137:0:17085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071655.339160:0:17085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460800/0x6b58994c2cbdd88f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d992d5 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.339608:0:17085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460e00/0x6b58994c2cbdd896 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.339628:0:17085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460e00/0x6b58994c2cbdd896 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.339640:0:17085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460e00/0x6b58994c2cbdd896 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783071655.339656:0:17085:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1783071655.341062:0:17085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460e00/0x6b58994c2cbdd896 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.341078:0:17085:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460e00/0x6b58994c2cbdd896 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.341085:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460e00/0x6b58994c2cbdd896 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.341091:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b3c460e00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071655.341096:0:17085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460e00/0x6b58994c2cbdd896 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.341119:0:17085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460e00/0x6b58994c2cbdd896 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.341135:0:17085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f8b1093b000) 00010000:00010000:3.0:1783071655.341138:0:17085:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783071655.341142:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460e00/0x6b58994c2cbdd896 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.341148:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460e00/0x6b58994c2cbdd896 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.341207:0:17085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460800/0x6b58994c2cbdd88f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d992d5 expref: 30 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.341217:0:17085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f8b1093ba00) 00010000:00010000:3.0:1783071655.341219:0:17085:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783071655.341223:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460800/0x6b58994c2cbdd88f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d992d5 expref: 30 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.341242:0:17085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b3c460800, rc 0) 00000100:00100000:3.0:1783071655.341493:0:17085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0397d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5c8f6e7-f12c-493c-9545-6cf978dcf267+29:15659:x1869685692959104:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 2381us (2669us total) trans 8589934611 rc 301/301 00000100:00100000:3.0:1783071655.341503:0:17085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 51 00000100:00100000:0.0:1783071655.351533:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071655.351663:0:19199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692959232 00000100:00100000:3.0:1783071655.351673:0:19199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692959232 00000100:00100000:3.0:1783071655.352512:0:19199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 52 00000100:00100000:3.0:1783071655.352526:0:19199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02c08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5c8f6e7-f12c-493c-9545-6cf978dcf267+29:15659:x1869685692959232:12345-192.168.204.38@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783071655.352579:0:19199:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783071655.352704:0:19199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02c08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5c8f6e7-f12c-493c-9545-6cf978dcf267+29:15659:x1869685692959232:12345-192.168.204.38@tcp:53:lhsmtool_posix.0 Request processed in 181us (1178us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071655.352712:0:19199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 52 00000100:00100000:0.0:1783071655.357184:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071655.357415:0:19285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692959488 00000100:00100000:2.0:1783071655.357426:0:19285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692959488 00000100:00100000:2.0:1783071655.357524:0:19285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 53 00000100:00100000:2.0:1783071655.357535:0:19285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02c0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d5c8f6e7-f12c-493c-9545-6cf978dcf267+29:15659:x1869685692959488:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783071655.357556:0:19285:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071655.357577:0:19285:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00030800/0x6b58994c2cbdd8a4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d992dc expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783071655.358004:0:19285:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x6:0x0], count =28 00000004:00080000:2.0:1783071655.358011:0:19285:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x6:0x0]+28 in llog 00000004:00080000:2.0:1783071655.358031:0:19285:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:2.0:1783071655.358187:0:19285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031a00/0x6b58994c2cbdd8ab lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071655.358201:0:19285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031a00/0x6b58994c2cbdd8ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071655.358212:0:19285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031a00/0x6b58994c2cbdd8ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071655.358264:0:19285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00030800/0x6b58994c2cbdd8a4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d992dc expref: 32 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071655.358296:0:19285:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031a00/0x6b58994c2cbdd8ab lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d992dc expref: 31 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071655.358304:0:19285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f8b1093b700) 00010000:00010000:2.0:1783071655.358307:0:19285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783071655.358310:0:19285:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b00031a00, rc 0) 00000100:00100000:2.0:1783071655.358610:0:19285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02c0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d5c8f6e7-f12c-493c-9545-6cf978dcf267+31:15659:x1869685692959488:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 1075us (1435us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1783071655.358618:0:19285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 53 00000100:00100000:2.0:1783071655.370619:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071655.371340:0:17085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692959744 00000100:00100000:3.0:1783071655.371351:0:17085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692959744 00000100:00100000:3.0:1783071655.371456:0:17085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 54 00000100:00100000:3.0:1783071655.371467:0:17085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0397d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5c8f6e7-f12c-493c-9545-6cf978dcf267+31:15659:x1869685692959744:12345-192.168.204.38@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783071655.371529:0:17085:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071655.371558:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031a00/0x6b58994c2cbdd8ab lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d992dc expref: 31 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.371580:0:17085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f8b1093b700) 00010000:00010000:3.0:1783071655.371589:0:17085:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783071655.371612:0:17085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460800/0x6b58994c2cbdd8b9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.371625:0:17085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460800/0x6b58994c2cbdd8b9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.371636:0:17085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460800/0x6b58994c2cbdd8b9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.371649:0:17085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460e00/0x6b58994c2cbdd8c0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xfb47a0e1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.371656:0:17085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460e00/0x6b58994c2cbdd8c0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfb47a0e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.371683:0:17085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460e00/0x6b58994c2cbdd8c0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfb47a0e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.371808:0:17085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460800/0x6b58994c2cbdd8b9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.371817:0:17085:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460800/0x6b58994c2cbdd8b9 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.371825:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460800/0x6b58994c2cbdd8b9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.371831:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b3c460800 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071655.371835:0:17085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460800/0x6b58994c2cbdd8b9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.371842:0:17085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460800/0x6b58994c2cbdd8b9 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.371863:0:17085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f8a02124d00) 00010000:00010000:3.0:1783071655.371865:0:17085:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071655.371868:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460800/0x6b58994c2cbdd8b9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.371873:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460800/0x6b58994c2cbdd8b9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.371881:0:17085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460e00/0x6b58994c2cbdd8c0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfb47a0e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.371886:0:17085:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460e00/0x6b58994c2cbdd8c0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfb47a0e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.371898:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460e00/0x6b58994c2cbdd8c0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfb47a0e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.371903:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b3c460e00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071655.371906:0:17085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460e00/0x6b58994c2cbdd8c0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfb47a0e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.371912:0:17085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460e00/0x6b58994c2cbdd8c0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfb47a0e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.371920:0:17085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xfb47a0e1 (ffff8f8a021bdf00) 00010000:00010000:3.0:1783071655.371922:0:17085:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071655.371925:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460e00/0x6b58994c2cbdd8c0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xfb47a0e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.371930:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460e00/0x6b58994c2cbdd8c0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xfb47a0e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071655.372007:0:17085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0397d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5c8f6e7-f12c-493c-9545-6cf978dcf267+30:15659:x1869685692959744:12345-192.168.204.38@tcp:36:lhsmtool_posix.0 Request processed in 541us (1397us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783071655.372014:0:17085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 54 00000100:00100000:0.0:1783071655.376957:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071655.377082:0:19199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692959872 00000100:00100000:3.0:1783071655.377092:0:19199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692959872 00000100:00100000:3.0:1783071655.377151:0:19199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 55 00000100:00100000:3.0:1783071655.377160:0:19199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02c0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5c8f6e7-f12c-493c-9545-6cf978dcf267+30:15659:x1869685692959872:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783071655.377181:0:19199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071655.377214:0:19199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460400/0x6b58994c2cbdd8c7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d992e3 expref: -99 pid: 19199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.377271:0:19199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461c00/0x6b58994c2cbdd8ce lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.377285:0:19199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461c00/0x6b58994c2cbdd8ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.377296:0:19199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461c00/0x6b58994c2cbdd8ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.377440:0:19199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460400/0x6b58994c2cbdd8c7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d992e3 expref: 32 pid: 19199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.377459:0:19199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c461c00/0x6b58994c2cbdd8ce lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d992e3 expref: 31 pid: 19199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.377468:0:19199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f8a021bd200) 00010000:00010000:3.0:1783071655.377681:0:19199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783071655.377686:0:19199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b3c461c00, rc 0) 00000100:00100000:3.0:1783071655.377752:0:19199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02c0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5c8f6e7-f12c-493c-9545-6cf978dcf267+31:15659:x1869685692959872:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 593us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071655.377760:0:19199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 55 00000100:00100000:0.0:1783071655.387696:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071655.387867:0:19285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692960128 00000100:00100000:2.0:1783071655.387877:0:19285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692960128 00000100:00100000:2.0:1783071655.387943:0:19285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 56 00000100:00100000:2.0:1783071655.387953:0:19285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02c0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d5c8f6e7-f12c-493c-9545-6cf978dcf267+31:15659:x1869685692960128:12345-192.168.204.38@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783071655.388035:0:19285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00030200/0x6b58994c2cbdd8d5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071655.388054:0:19285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00030200/0x6b58994c2cbdd8d5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071655.388066:0:19285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00030200/0x6b58994c2cbdd8d5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783071655.388228:0:19285:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:2.0:1783071655.388237:0:19285:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 557176872731ns, next at 558176870454ns, rc = 0 00000004:00010000:2.0:1783071655.388285:0:19285:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000052bc88 reply state 000000002d48aefe transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00030200/0x6b58994c2cbdd8d5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071655.388318:0:19285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00030200/0x6b58994c2cbdd8d5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071655.388325:0:19285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f8a021bd200) 00010000:00010000:2.0:1783071655.388328:0:19285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1783071655.388331:0:19285:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783071655.389229:0:19285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02c0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d5c8f6e7-f12c-493c-9545-6cf978dcf267+33:15659:x1869685692960128:12345-192.168.204.38@tcp:36:lhsmtool_posix.0 Request processed in 1272us (1538us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1783071655.389239:0:19285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 56 00000100:00100000:2.0:1783071655.399250:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071655.399346:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692960256 00000100:00100000:1.0:1783071655.399356:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692960256 00000100:00100000:1.0:1783071655.399461:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 57 00000100:00100000:1.0:1783071655.399681:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0411c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d5c8f6e7-f12c-493c-9545-6cf978dcf267+33:15659:x1869685692960256:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783071655.399720:0:17086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071655.399742:0:17086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdd8dc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d992ea expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.399800:0:17086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdd8dc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d992ea expref: 34 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.399815:0:17086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdd8dc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d992ea expref: 34 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.399832:0:17086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f8a021bd200) 00010000:00010000:1.0:1783071655.399835:0:17086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783071655.399838:0:17086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a01749c00, rc 0) 00000100:00100000:1.0:1783071655.399898:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0411c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d5c8f6e7-f12c-493c-9545-6cf978dcf267+34:15659:x1869685692960256:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 427us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071655.399905:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 57 00000100:00100000:0.0:1783071655.406107:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071655.406582:0:19700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692960384 00000100:00100000:2.0:1783071655.406594:0:19700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692960384 00000100:00100000:2.0:1783071655.406676:0:19700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 20 00000100:00100000:2.0:1783071655.406686:0:19700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02c0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d5c8f6e7-f12c-493c-9545-6cf978dcf267+5:2405:x1869685692960384:12345-192.168.204.38@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1783071655.406989:0:17082:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783071655.407027:0:19700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02c0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d5c8f6e7-f12c-493c-9545-6cf978dcf267+6:2405:x1869685692960384:12345-192.168.204.38@tcp:2:lhsmtool_posix.0 Request processed in 340us (927us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1783071655.407034:0:19700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 20 00000100:00100000:0.0:1783071655.413564:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071655.415046:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692960640 00000100:00100000:2.0:1783071655.415062:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692960640 00000100:00100000:2.0:1783071655.415134:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9 00000100:00100000:2.0:1783071655.415145:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02c09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d5c8f6e7-f12c-493c-9545-6cf978dcf267+34:15659:x1869685692960640:12345-192.168.204.38@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1783071655.415417:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02c09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d5c8f6e7-f12c-493c-9545-6cf978dcf267+35:15659:x1869685692960640:12345-192.168.204.38@tcp:35:lhsmtool_posix.0 Request processed in 273us (1865us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1783071655.415425:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9 00000100:00100000:3.0:1783071655.420313:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071655.420866:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692960896 00000100:00100000:0.0:1783071655.420876:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692960896 00000100:00100000:0.0:1783071655.420941:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 58 00000100:00100000:0.0:1783071655.420952:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5c8f6e7-f12c-493c-9545-6cf978dcf267+35:15659:x1869685692960896:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783071655.421074:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5c8f6e7-f12c-493c-9545-6cf978dcf267+35:15659:x1869685692960896:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 Request processed in 123us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071655.421082:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 58 00000100:00100000:0.0:1783071655.425176:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071655.425265:0:17085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692961024 00000100:00100000:3.0:1783071655.425276:0:17085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692961024 00000100:00100000:3.0:1783071655.425347:0:17085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 59 00000100:00100000:3.0:1783071655.425358:0:17085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02c09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5c8f6e7-f12c-493c-9545-6cf978dcf267+35:15659:x1869685692961024:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783071655.425424:0:17085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071655.425460:0:17085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460400/0x6b58994c2cbdd8e3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d992f1 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.425553:0:17085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460e00/0x6b58994c2cbdd8ea lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.425569:0:17085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460e00/0x6b58994c2cbdd8ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.425581:0:17085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460e00/0x6b58994c2cbdd8ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783071655.425625:0:17085:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783071655.425644:0:17085:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460e00/0x6b58994c2cbdd8ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.425668:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460400/0x6b58994c2cbdd8e3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d992f1 expref: 37 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.425685:0:17085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460e00/0x6b58994c2cbdd8ea lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d992f1 expref: 36 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.425695:0:17085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f8a021bd200) 00010000:00010000:3.0:1783071655.425711:0:17085:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1783071655.425715:0:17085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b3c460e00, rc 0) 00000100:00100000:3.0:1783071655.425773:0:17085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02c09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5c8f6e7-f12c-493c-9545-6cf978dcf267+36:15659:x1869685692961024:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 417us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071655.425781:0:17085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 59 00000100:00100000:3.0:1783071655.431085:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071655.431220:0:19286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692961152 00000100:00100000:0.0:1783071655.431239:0:19286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692961152 00000100:00100000:0.0:1783071655.431307:0:19286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 21 00000100:00100000:0.0:1783071655.431319:0:19286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d5c8f6e7-f12c-493c-9545-6cf978dcf267+6:2405:x1869685692961152:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783071655.431339:0:19286:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071655.431406:0:19286:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d81c8e4b/0x6b58994c2cbdd8f1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d992f8 expref: -99 pid: 19286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783071655.431453:0:19286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a4783a8, blocks: 0x0 00010000:00010000:0.0:1783071655.431475:0:19286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=557s v=(0 0) 00010000:00010000:0.0:1783071655.431480:0:19286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071655.431490:0:19286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d81c8e4b/0x6b58994c2cbdd8f1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d992f8 expref: 7 pid: 19286 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071655.431511:0:19286:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d81c8e4b/0x6b58994c2cbdd8f1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d992f8 expref: 7 pid: 19286 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071655.431525:0:19286:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a02ce9200, rc 0) 00000100:00100000:0.0:1783071655.431585:0:19286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d5c8f6e7-f12c-493c-9545-6cf978dcf267+7:2405:x1869685692961152:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 268us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071655.431592:0:19286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 21 00000100:00100000:0.0:1783071655.438927:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071655.439035:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692961408 00000100:00100000:1.0:1783071655.439045:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692961408 00000100:00100000:1.0:1783071655.439131:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 60 00000100:00100000:1.0:1783071655.439141:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02c08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d5c8f6e7-f12c-493c-9545-6cf978dcf267+36:15659:x1869685692961408:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1783071655.439251:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02c08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d5c8f6e7-f12c-493c-9545-6cf978dcf267+36:15659:x1869685692961408:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 Request processed in 111us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071655.439258:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 60 00000100:00100000:3.0:1783071655.450681:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071655.450857:0:17085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692961536 00000100:00100000:2.0:1783071655.450875:0:17085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692961536 00000100:00100000:2.0:1783071655.450947:0:17085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 61 00000100:00100000:2.0:1783071655.450957:0:17085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5c8f6e7-f12c-493c-9545-6cf978dcf267+36:15659:x1869685692961536:12345-192.168.204.38@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1783071655.455809:0:17066:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:0.0:1783071655.455826:0:17066:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:0.0:1783071655.455888:0:17066:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:3.0:1783071655.456087:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdd77e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.456099:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdd77e lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.456107:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdd77e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.456113:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b2fd67400 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:3.0:1783071655.456117:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdd77e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.456124:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdd77e lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.456141:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f8a02124d00) 00010000:00010000:3.0:1783071655.456145:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1783071655.456150:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdd77e lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.456156:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b2fd67400/0x6b58994c2cbdd77e lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071655.456459:0:17085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5c8f6e7-f12c-493c-9545-6cf978dcf267+19:15659:x1869685692961536:12345-192.168.204.38@tcp:44:lhsmtool_posix.0 Request processed in 5498us (5782us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071655.456471:0:17085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 61 00000100:00100000:0.0:1783071655.457107:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783071655.457127:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0411f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707708800:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1783071655.457188:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071655.457537:0:18592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707708800 00000100:00100000:2.0:1783071655.457545:0:18592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707708800 00000100:00100000:2.0:1783071655.457647:0:18592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783071655.457657:0:18592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02c08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707708800:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1783071655.457799:0:18592:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1783071655.457802:0:18592:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1783071655.457805:0:18592:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1783071655.457807:0:18592:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1783071656 -> 1783071656 00002000:00010000:2.0:1783071655.457809:0:18592:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1783071655.457865:0:18592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02c08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1869685707708800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 209us (676us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1783071655.457872:0:18592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1783071655.457927:0:17082:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1783071655.458169:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f8a0411f480/2, rc 0, transno 8589934596 00000100:00100000:1.0:1783071655.458177:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0411f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707708800:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1783071655.458218:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce8800/0x6b58994c2cbdd72a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.458240:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce8800/0x6b58994c2cbdd72a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.458248:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce8800/0x6b58994c2cbdd72a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.458254:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a02ce8800 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:1.0:1783071655.458259:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce8800/0x6b58994c2cbdd72a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.458267:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce8800/0x6b58994c2cbdd72a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.458284:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8f8a02124400) 00010000:00010000:1.0:1783071655.458287:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071655.458292:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce8800/0x6b58994c2cbdd72a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.458299:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce8800/0x6b58994c2cbdd72a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.458319:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce8c00/0x6b58994c2cbdd731 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.458326:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce8c00/0x6b58994c2cbdd731 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.458333:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce8c00/0x6b58994c2cbdd731 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.458337:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a02ce8c00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:1.0:1783071655.458346:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce8c00/0x6b58994c2cbdd731 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.458352:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce8c00/0x6b58994c2cbdd731 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.458360:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f8a02124d00) 00010000:00010000:1.0:1783071655.458382:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071655.458386:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce8c00/0x6b58994c2cbdd731 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.458392:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce8c00/0x6b58994c2cbdd731 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.458404:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031600/0x6b58994c2cbdd7d9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.458409:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031600/0x6b58994c2cbdd7d9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.458415:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031600/0x6b58994c2cbdd7d9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.458420:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b00031600 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:1.0:1783071655.458422:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031600/0x6b58994c2cbdd7d9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.458428:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031600/0x6b58994c2cbdd7d9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.458436:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8f8b1093b900) 00010000:00010000:1.0:1783071655.458438:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071655.458447:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031600/0x6b58994c2cbdd7d9 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.458453:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031600/0x6b58994c2cbdd7d9 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.458471:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce8a00/0x6b58994c2cbdd85e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.458477:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce8a00/0x6b58994c2cbdd85e lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.458483:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce8a00/0x6b58994c2cbdd85e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.458488:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a02ce8a00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:1.0:1783071655.458491:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce8a00/0x6b58994c2cbdd85e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.458497:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce8a00/0x6b58994c2cbdd85e lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.458505:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f8b1093b000) 00010000:00010000:1.0:1783071655.458508:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071655.458510:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce8a00/0x6b58994c2cbdd85e lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.458527:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce8a00/0x6b58994c2cbdd85e lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.458539:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00030200/0x6b58994c2cbdd8d5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.458555:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00030200/0x6b58994c2cbdd8d5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.458560:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00030200/0x6b58994c2cbdd8d5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.458565:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b00030200 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:1.0:1783071655.458567:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00030200/0x6b58994c2cbdd8d5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.458573:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00030200/0x6b58994c2cbdd8d5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.458583:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f8a021bd200) 00010000:00010000:1.0:1783071655.458585:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783071655.458588:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00030200/0x6b58994c2cbdd8d5 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.458593:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00030200/0x6b58994c2cbdd8d5 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071655.461766:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071655.461967:0:18589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692961664 00000100:00100000:1.0:1783071655.461976:0:18589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692961664 00000100:00100000:1.0:1783071655.462037:0:18589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 23 00000100:00100000:1.0:1783071655.462047:0:18589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d5c8f6e7-f12c-493c-9545-6cf978dcf267+7:2406:x1869685692961664:12345-192.168.204.38@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1783071655.462151:0:18589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d5c8f6e7-f12c-493c-9545-6cf978dcf267+7:2406:x1869685692961664:12345-192.168.204.38@tcp:16:lhsmtool_posix.0 Request processed in 105us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071655.462159:0:18589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 23 00000100:00100000:2.0:1783071655.477128:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071655.478439:0:19199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692961920 00000100:00100000:3.0:1783071655.478454:0:19199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692961920 00000100:00100000:3.0:1783071655.478514:0:19199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 62 00000100:00100000:3.0:1783071655.478525:0:19199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0411df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5c8f6e7-f12c-493c-9545-6cf978dcf267+15:15659:x1869685692961920:12345-192.168.204.38@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783071655.478585:0:19199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071655.478616:0:19199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460e00/0x6b58994c2cbdd8ea lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d992f1 expref: 15 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.478654:0:19199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f8a021bd200) 00010000:00010000:3.0:1783071655.478658:0:19199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783071655.478689:0:19199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460400/0x6b58994c2cbdd8f8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.478704:0:19199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460400/0x6b58994c2cbdd8f8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.478714:0:19199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460400/0x6b58994c2cbdd8f8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783071655.479191:0:19199:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d013dbe9 reply state 000000005750f46a transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460400/0x6b58994c2cbdd8f8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.479207:0:19199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460400/0x6b58994c2cbdd8f8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.479214:0:19199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f8a021bd200) 00010000:00010000:3.0:1783071655.479217:0:19199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783071655.479220:0:19199:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783071655.479343:0:19199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0411df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5c8f6e7-f12c-493c-9545-6cf978dcf267+16:15659:x1869685692961920:12345-192.168.204.38@tcp:36:lhsmtool_posix.0 Request processed in 818us (2221us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1783071655.479351:0:19199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 62 00000100:00100000:3.0:1783071655.481724:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071655.481911:0:19286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692962048 00000100:00100000:0.0:1783071655.481922:0:19286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692962048 00000100:00100000:0.0:1783071655.482016:0:19286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 24 00000100:00100000:0.0:1783071655.482027:0:19286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d5c8f6e7-f12c-493c-9545-6cf978dcf267+7:2406:x1869685692962048:12345-192.168.204.38@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1783071655.482214:0:19286:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1783071655.482218:0:19286:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1783071655 00002000:00010000:0.0:1783071655.482220:0:19286:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1783071655 00002000:00010000:0.0:1783071655.482222:0:19286:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1783071656 -> 1783071655 00002000:00010000:0.0:1783071655.482224:0:19286:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1783071655.482289:0:19286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d5c8f6e7-f12c-493c-9545-6cf978dcf267+8:2406:x1869685692962048:12345-192.168.204.38@tcp:2:lhsmtool_posix.0 Request processed in 264us (573us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1783071655.482297:0:19286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 24 00000100:00100000:0.0:1783071655.485553:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071655.486524:0:18592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692962176 00000100:00100000:2.0:1783071655.486535:0:18592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692962176 00000100:00100000:2.0:1783071655.486711:0:18592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 25 00000100:00100000:2.0:1783071655.486722:0:18592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a02c0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d5c8f6e7-f12c-493c-9545-6cf978dcf267+8:2406:x1869685692962176:12345-192.168.204.38@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1783071655.486770:0:18592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003b718b38/0x6b58994c2cbdd8ff lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071655.486787:0:18592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783071655.486906:0:18592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783071655.486924:0:18592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b718b38/0x6b58994c2cbdd8ff lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071655.486940:0:18592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b718b38/0x6b58994c2cbdd8ff lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071655.486968:0:18592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003b718b38/0x6b58994c2cbdd8ff lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071655.486977:0:18592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b718b38/0x6b58994c2cbdd8ff lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071655.486984:0:18592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b718b38/0x6b58994c2cbdd8ff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071655.486990:0:18592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b00031600 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:2.0:1783071655.486994:0:18592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b718b38/0x6b58994c2cbdd8ff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071655.487002:0:18592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b718b38/0x6b58994c2cbdd8ff lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071655.487017:0:18592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b718b38/0x6b58994c2cbdd8ff lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071655.487025:0:18592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b718b38/0x6b58994c2cbdd8ff lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071655.487134:0:18592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a02c0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d5c8f6e7-f12c-493c-9545-6cf978dcf267+8:2406:x1869685692962176:12345-192.168.204.38@tcp:1:lhsmtool_posix.0 Request processed in 412us (1587us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071655.487142:0:18592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 25 00000100:00100000:2.0:1783071655.490837:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071655.491348:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692962432 00000100:00100000:1.0:1783071655.491413:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692962432 00000100:00100000:1.0:1783071655.491468:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 63 00000100:00100000:1.0:1783071655.491478:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0411c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d5c8f6e7-f12c-493c-9545-6cf978dcf267+16:15659:x1869685692962432:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1783071655.491563:0:17086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdd906 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.491581:0:17086:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460a00/0x6b58994c2cbdd857 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d992c0 expref: 16 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.491591:0:17086:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdd906 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.491626:0:17086:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460a00/0x6b58994c2cbdd857 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d992c0 expref: 16 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.491640:0:17086:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460a00/0x6b58994c2cbdd857 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d992c0 expref: 16 pid: 19285 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071655.491654:0:17086:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17086:1869685707708928:192.168.204.38@tcp:104: 00000100:00100000:1.0:1783071655.491926:0:17086:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b06258d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783071655.497965:0:17086:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17086:1869685707708928:192.168.204.38@tcp:104: 00010000:00010000:1.0:1783071655.497994:0:17086:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdd906 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071655.500178:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071655.501669:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692962560 00000100:00100000:0.0:1783071655.501685:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692962560 00010000:00010000:0.0:1783071655.501740:0:17072:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460a00/0x6b58994c2cbdd857 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d992c0 expref: 17 pid: 19285 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071655.501830:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19 00000100:00100000:0.0:1783071655.501840:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0411dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5c8f6e7-f12c-493c-9545-6cf978dcf267+17:2406:x1869685692962560:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783071655.501865:0:17072:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071655.501872:0:17072:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460a00/0x6b58994c2cbdd857 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d992c0 expref: 17 pid: 19285 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071655.501886:0:17072:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460a00/0x6b58994c2cbdd857 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d992c0 expref: 17 pid: 19285 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071655.501914:0:17072:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460a00/0x6b58994c2cbdd857 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d992c0 expref: 17 pid: 19285 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071655.501969:0:17072:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f8b1093b000) 00010000:00010000:0.0:1783071655.501975:0:17072:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03bd6400/0x6b58994c2cbdd873 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d992ce expref: 16 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071655.501985:0:17072:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdd906 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071655.501994:0:17072:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdd906 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071655.502002:0:17072:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdd906 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071655.502043:0:17072:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071655.502122:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0411dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5c8f6e7-f12c-493c-9545-6cf978dcf267+16:2406:x1869685692962560:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 282us (1950us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071655.502130:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19 00010000:00010000:2.0:1783071655.502206:0:17086:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdd906 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071655.502217:0:17086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdd906 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071655.502464:0:17086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031600/0x6b58994c2cbdd90d lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071655.502477:0:17086:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdd8dc lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d992ea expref: 16 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071655.502485:0:17086:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031600/0x6b58994c2cbdd90d lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071655.502515:0:17086:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdd8dc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d992ea expref: 16 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071655.502529:0:17086:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdd8dc lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d992ea expref: 16 pid: 17086 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071655.502542:0:17086:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0411f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17086:1869685707709056:192.168.204.38@tcp:104: 00000100:00100000:2.0:1783071655.502624:0:17086:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b2fc82840 going to sleep for 11 seconds 00000100:00100000:2.0:1783071655.505542:0:17086:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0411f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17086:1869685707709056:192.168.204.38@tcp:104: 00010000:00010000:2.0:1783071655.505573:0:17086:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031600/0x6b58994c2cbdd90d lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071655.508482:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071655.508567:0:20112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692962688 00000100:00100000:3.0:1783071655.508577:0:20112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692962688 00010000:00010000:3.0:1783071655.508616:0:20112:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdd8dc lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d992ea expref: 17 pid: 17086 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071655.508677:0:20112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 20 00000100:00100000:3.0:1783071655.508687:0:20112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0411f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5c8f6e7-f12c-493c-9545-6cf978dcf267+17:2405:x1869685692962688:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783071655.508704:0:20112:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071655.508712:0:20112:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdd8dc lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d992ea expref: 17 pid: 17086 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.508726:0:20112:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdd8dc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d992ea expref: 17 pid: 17086 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.508752:0:20112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749c00/0x6b58994c2cbdd8dc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d992ea expref: 17 pid: 17086 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.508768:0:20112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f8a021bd200) 00010000:00010000:3.0:1783071655.508774:0:20112:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031600/0x6b58994c2cbdd90d lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.508784:0:20112:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031600/0x6b58994c2cbdd90d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.508792:0:20112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031600/0x6b58994c2cbdd90d lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.508826:0:20112:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783071655.508893:0:20112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0411f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5c8f6e7-f12c-493c-9545-6cf978dcf267+16:2405:x1869685692962688:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 206us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071655.508900:0:20112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 20 00010000:00010000:1.0:1783071655.509159:0:17086:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031600/0x6b58994c2cbdd90d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.509169:0:17086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031600/0x6b58994c2cbdd90d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783071655.509751:0:17086:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:1.0:1783071655.509948:0:17086:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:1.0:1783071655.509990:0:17086:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:1.0:1783071655.510086:0:17086:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17086:1869685707709184:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1783071655.510191:0:17086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071655.510229:0:17086:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8a01744600 going to sleep for 11 seconds 00000100:00100000:3.0:1783071655.510505:0:17825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707709184 00000100:00100000:3.0:1783071655.510523:0:17825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707709184 00000100:00100000:3.0:1783071655.510690:0:17825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783071655.510701:0:17825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c78c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17086:x1869685707709184:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1783071655.510798:0:17825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c78c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17086:x1869685707709184:12345-0@lo:1000:mdt00_001.0 Request processed in 99us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071655.510815:0:17825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783071655.510891:0:17086:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17086:1869685707709184:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1783071655.511046:0:17086:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:1.0:1783071655.511095:0:17086:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17086:1869685707709312:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1783071655.511139:0:17086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071655.512047:0:17086:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b10efde40 going to sleep for 11 seconds 00000100:00100000:0.0:1783071655.512198:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707709312 00000100:00100000:0.0:1783071655.512205:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707709312 00000100:00100000:0.0:1783071655.512248:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783071655.512257:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c78df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17086:x1869685707709312:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1783071655.512445:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c78df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17086:x1869685707709312:12345-0@lo:1000:mdt00_001.0 Request processed in 188us (1303us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1783071655.512452:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783071655.513959:0:17086:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17086:1869685707709312:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1783071655.514022:0:17086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031600/0x6b58994c2cbdd90d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.514033:0:17086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031600/0x6b58994c2cbdd90d lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.514042:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031600/0x6b58994c2cbdd90d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.514049:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b00031600 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:1.0:1783071655.514053:0:17086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031600/0x6b58994c2cbdd90d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.514074:0:17086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031600/0x6b58994c2cbdd90d lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.514116:0:17086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f8a021bd200) 00010000:00010000:1.0:1783071655.514119:0:17086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783071655.514125:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031600/0x6b58994c2cbdd90d lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.514131:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b00031600/0x6b58994c2cbdd90d lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.514172:0:17086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460000/0x6b58994c2cbdd86c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.514178:0:17086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460000/0x6b58994c2cbdd86c lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.514183:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460000/0x6b58994c2cbdd86c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.514188:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b3c460000 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:1.0:1783071655.514191:0:17086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460000/0x6b58994c2cbdd86c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.514196:0:17086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460000/0x6b58994c2cbdd86c lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.514203:0:17086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f8b1093b000) 00010000:00010000:1.0:1783071655.514206:0:17086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783071655.514212:0:17086:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03bd6400/0x6b58994c2cbdd873 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d992ce expref: 19 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.514224:0:17086:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03bd6400/0x6b58994c2cbdd873 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d992ce expref: 19 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.514240:0:17086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03bd6400/0x6b58994c2cbdd873 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d992ce expref: 19 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.514308:0:17086:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a03bd6400/0x6b58994c2cbdd873 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d992ce expref: 19 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071655.514323:0:17086:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17086:1869685707709440:192.168.204.38@tcp:105: 00000100:00100000:1.0:1783071655.514437:0:17086:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b10efde40 going to sleep for 11 seconds 00000100:00100000:2.0:1783071655.521835:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071655.522766:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692962816 00000100:00100000:3.0:1783071655.522777:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692962816 00000100:00100000:3.0:1783071655.522855:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 10 00000100:00100000:3.0:1783071655.522866:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03238c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d5c8f6e7-f12c-493c-9545-6cf978dcf267+20:15657:x1869685692962816:12345-192.168.204.38@tcp:49:dd.0 00000100:00100000:3.0:1783071655.523009:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03238c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d5c8f6e7-f12c-493c-9545-6cf978dcf267+20:15657:x1869685692962816:12345-192.168.204.38@tcp:49:dd.0 Request processed in 144us (1184us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071655.523017:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 10 00000100:00100000:1.0:1783071655.524245:0:17086:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17086:1869685707709440:192.168.204.38@tcp:105: 00010000:00010000:1.0:1783071655.524276:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460000/0x6b58994c2cbdd86c lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.524287:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8b3c460000/0x6b58994c2cbdd86c lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 19285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.524324:0:17086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdd914 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.524339:0:17086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdd914 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.524351:0:17086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdd914 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.524361:0:17086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdd914 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.524393:0:17086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdd914 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.524414:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdd914 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.524420:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01749600 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:1.0:1783071655.524424:0:17086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdd914 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.524431:0:17086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdd914 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.524443:0:17086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f8b1093b000) 00010000:00010000:1.0:1783071655.524446:0:17086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071655.524450:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdd914 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.524456:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749600/0x6b58994c2cbdd914 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.524466:0:17086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdd906 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.524473:0:17086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdd906 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.524478:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdd906 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.524483:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01749e00 already unused, calling callback (ffffffffc17944f0) 00010000:00010000:1.0:1783071655.524486:0:17086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdd906 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.524501:0:17086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdd906 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.524509:0:17086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f8b1093b000) 00010000:00010000:1.0:1783071655.524512:0:17086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783071655.524515:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdd906 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.524520:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a01749e00/0x6b58994c2cbdd906 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17086 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071655.524695:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0411c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d5c8f6e7-f12c-493c-9545-6cf978dcf267+19:15659:x1869685692962432:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 Request processed in 33217us (33867us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1783071655.524705:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 63 00000020:00080000:1.0:1783071655.524710:0:17086:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1783071655.525465:0:17119:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1783071655.525473:0:17119:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783071655.525490:0:17119:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1783071655.525497:0:17119:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1783071655.527873:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071655.528009:0:17085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692962944 00000100:00100000:0.0:1783071655.528021:0:17085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692962944 00000100:00100000:0.0:1783071655.528093:0:17085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 64 00000100:00100000:0.0:1783071655.528124:0:17085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0411d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5c8f6e7-f12c-493c-9545-6cf978dcf267+19:15657:x1869685692962944:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:0.0:1783071655.528151:0:17085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071655.528179:0:17085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce8e00/0x6b58994c2cbdd91b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19c722d6c2d992ff expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071655.528220:0:17085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce9600/0x6b58994c2cbdd922 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071655.528236:0:17085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce9600/0x6b58994c2cbdd922 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071655.528248:0:17085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce9600/0x6b58994c2cbdd922 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071655.528689:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce8e00/0x6b58994c2cbdd91b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d992ff expref: 21 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071655.528709:0:17085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce9600/0x6b58994c2cbdd922 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d992ff expref: 20 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071655.528719:0:17085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f8b1093b000) 00010000:00010000:0.0:1783071655.528722:0:17085:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783071655.528726:0:17085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a02ce9600, rc 0) 00000100:00100000:0.0:1783071655.528803:0:17085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0411d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5c8f6e7-f12c-493c-9545-6cf978dcf267+20:15657:x1869685692962944:12345-192.168.204.38@tcp:101:dd.0 Request processed in 676us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071655.528811:0:17085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 64 00000100:00100000:3.0:1783071655.529194:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071655.530478:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692963200 00000100:00100000:0.0:1783071655.530490:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692963200 00000100:00100000:0.0:1783071655.530536:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11 00000100:00100000:0.0:1783071655.530558:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d5c8f6e7-f12c-493c-9545-6cf978dcf267+20:15659:x1869685692963200:12345-192.168.204.38@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1783071655.532203:0:17089:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1783071655.532496:0:17089:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1783071655.532548:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce9e00/0x6b58994c2cbdd929 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071655.532566:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce9e00/0x6b58994c2cbdd929 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071655.532576:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce9e00/0x6b58994c2cbdd929 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071655.532584:0:17089:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce9e00/0x6b58994c2cbdd929 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071655.532590:0:17089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce9e00/0x6b58994c2cbdd929 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071655.532596:0:17089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce9e00/0x6b58994c2cbdd929 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071655.532618:0:17089:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783071655.532710:0:19422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1783071655.532718:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d5c8f6e7-f12c-493c-9545-6cf978dcf267+22:15659:x1869685692963200:12345-192.168.204.38@tcp:35:lhsmtool_posix.0 Request processed in 2158us (3519us total) trans 8589934622 rc 0/0 00010000:00010000:3.0:1783071655.532719:0:19422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce9e00/0x6b58994c2cbdd929 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.532734:0:19422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a02ce9e00 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:3.0:1783071655.532738:0:19422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce9e00/0x6b58994c2cbdd929 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.532749:0:19422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce9e00/0x6b58994c2cbdd929 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071655.532750:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11 00000020:00080000:0.0:1783071655.532759:0:17089:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1783071655.532782:0:19422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f8a021bd200) 00010000:00010000:3.0:1783071655.532785:0:19422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783071655.532791:0:19422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce9e00/0x6b58994c2cbdd929 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.532823:0:19422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8a02ce9e00/0x6b58994c2cbdd929 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.532836:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071655.532838:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071655.532839:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071655.678290:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071655.678490:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071655.678802:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692963328 00000100:00100000:1.0:1783071655.678813:0:18595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692963328 00000100:00100000:2.0:1783071655.678833:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692963456 00000100:00100000:2.0:1783071655.678850:0:18596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692963456 00000100:00100000:1.0:1783071655.678927:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 0 00000100:00100000:1.0:1783071655.678938:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b0ab60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d5c8f6e7-f12c-493c-9545-6cf978dcf267+9:2405:x1869685692963328:12345-192.168.204.38@tcp:4:dd.0 00010000:00010000:1.0:1783071655.679831:0:18595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000466281cd/0x6b58994c2cbdd930 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.679865:0:18595:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d81c8e4b/0x6b58994c2cbdd8f1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d992f8 expref: 9 pid: 19286 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.679875:0:18595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783071655.679879:0:18595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783071655.679896:0:18595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000466281cd/0x6b58994c2cbdd930 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.680005:0:18595:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d81c8e4b/0x6b58994c2cbdd8f1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d992f8 expref: 9 pid: 19286 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.680022:0:18595:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d81c8e4b/0x6b58994c2cbdd8f1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d992f8 expref: 9 pid: 19286 timeout: 657 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071655.680036:0:18595:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78d500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:18595:1869685707709568:192.168.204.38@tcp:104: 00000100:00100000:1.0:1783071655.680300:0:18595:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f8b10efde40 going to sleep for 11 seconds 00000100:00100000:2.0:1783071655.688898:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1783071655.688964:0:18595:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78d500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:18595:1869685707709568:192.168.204.38@tcp:104: 00010000:00010000:1.0:1783071655.688990:0:18595:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000466281cd/0x6b58994c2cbdd930 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071655.689039:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692963584 00000100:00100000:3.0:1783071655.689045:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692963584 00010000:00010000:3.0:1783071655.689081:0:17073:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d81c8e4b/0x6b58994c2cbdd8f1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d992f8 expref: 10 pid: 19286 timeout: 657 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071655.689183:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 21 00000100:00100000:3.0:1783071655.689194:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0411ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5c8f6e7-f12c-493c-9545-6cf978dcf267+10:2406:x1869685692963584:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783071655.689210:0:17073:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071655.689242:0:17073:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d81c8e4b/0x6b58994c2cbdd8f1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d992f8 expref: 10 pid: 19286 timeout: 657 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.689257:0:17073:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d81c8e4b/0x6b58994c2cbdd8f1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d992f8 expref: 10 pid: 19286 timeout: 657 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.689284:0:17073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d81c8e4b/0x6b58994c2cbdd8f1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0x19c722d6c2d992f8 expref: 10 pid: 19286 timeout: 657 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.689307:0:17073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783071655.689329:0:17073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783071655.689336:0:17073:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000466281cd/0x6b58994c2cbdd930 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.689346:0:17073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000466281cd/0x6b58994c2cbdd930 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071655.689432:0:17073:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783071655.689490:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0411ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5c8f6e7-f12c-493c-9545-6cf978dcf267+9:2406:x1869685692963584:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 296us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071655.689498:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 21 00010000:00010000:2.0:1783071655.689606:0:18595:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000466281cd/0x6b58994c2cbdd930 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071655.689615:0:18595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000466281cd/0x6b58994c2cbdd930 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071655.746619:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783071655.746643:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a0397c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707709696:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783071655.746713:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071655.747165:0:18593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707709696 00000100:00100000:1.0:1783071655.747174:0:18593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707709696 00000100:00100000:1.0:1783071655.747514:0:18593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783071655.747524:0:18593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a038b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707709696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783071655.747564:0:18593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783071655.747620:0:18593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a038b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869685707709696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071655.747627:0:18593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783071655.747671:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a0397c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1869685707709696:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1783071655.749085:0:17082:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1783071655.787119:0:19406:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:2.0:1783071655.787139:0:19406:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:1.0:1783071655.787393:0:18595:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:1.0:1783071655.787397:0:18595:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1783071655 -> 1783071656 00002000:00010000:1.0:1783071655.787414:0:18595:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1783071655 -> 1783071656 00002000:00010000:1.0:1783071655.787416:0:18595:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:1.0:1783071655.787502:0:18595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000466281cd/0x6b58994c2cbdd930 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.787513:0:18595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000466281cd/0x6b58994c2cbdd930 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.787520:0:18595:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000466281cd/0x6b58994c2cbdd930 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.787525:0:18595:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01749e00 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:1.0:1783071655.787529:0:18595:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000466281cd/0x6b58994c2cbdd930 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.787534:0:18595:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000466281cd/0x6b58994c2cbdd930 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.787550:0:18595:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000466281cd/0x6b58994c2cbdd930 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.787555:0:18595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000466281cd/0x6b58994c2cbdd930 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071655.787694:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b0ab60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d5c8f6e7-f12c-493c-9545-6cf978dcf267+6:2405:x1869685692963328:12345-192.168.204.38@tcp:4:dd.0 Request processed in 108753us (109410us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1783071655.787705:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 0 00000100:00100000:1.0:1783071655.787738:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1 00000100:00100000:1.0:1783071655.787760:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c6a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d5c8f6e7-f12c-493c-9545-6cf978dcf267+5:2405:x1869685692963456:12345-192.168.204.38@tcp:4:dd.0 00002000:00010000:1.0:1783071655.787800:0:18595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 4194304, mtime: 0x6a4783a8, atime: 0x6a4783a7, ctime: 0x6a4783a8, blocks: 0x2000 00010000:00010000:1.0:1783071655.787820:0:18595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070fd10ee/0x6b58994c2cbdd937 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.787833:0:18595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=557s v=(0 0) 00010000:00010000:1.0:1783071655.787844:0:18595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783071655.787851:0:18595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070fd10ee/0x6b58994c2cbdd937 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.787863:0:18595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070fd10ee/0x6b58994c2cbdd937 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071655.878443:0:17074:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1783071655.884729:0:19406:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:1.0:1783071655.885183:0:18595:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:1.0:1783071655.885189:0:18595:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:1.0:1783071655.885208:0:18595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070fd10ee/0x6b58994c2cbdd937 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.885221:0:18595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070fd10ee/0x6b58994c2cbdd937 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.885230:0:18595:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070fd10ee/0x6b58994c2cbdd937 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.885238:0:18595:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a01749000 already unused, calling callback (ffffffffc0b8ace0) 00010000:00010000:1.0:1783071655.885243:0:18595:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070fd10ee/0x6b58994c2cbdd937 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.885268:0:18595:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070fd10ee/0x6b58994c2cbdd937 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.885290:0:18595:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070fd10ee/0x6b58994c2cbdd937 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071655.885297:0:18595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070fd10ee/0x6b58994c2cbdd937 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071655.885452:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c6a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d5c8f6e7-f12c-493c-9545-6cf978dcf267+5:2405:x1869685692963456:12345-192.168.204.38@tcp:4:dd.0 Request processed in 97690us (206957us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1783071655.885462:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1 00000100:00100000:2.0:1783071656.259103:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a038b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707709824:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783071656.259233:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071656.259279:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783071656.259304:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a02c09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707709952:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783071656.259347:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071656.259504:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707709824 00000100:00100000:0.0:1783071656.259512:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707709824 00000100:00100000:0.0:1783071656.259571:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707709952 00000100:00100000:0.0:1783071656.259575:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707709952 00000100:00100000:0.0:1783071656.259606:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783071656.259616:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0411ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707709824:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783071656.259636:0:17825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1783071656.259648:0:17825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0411fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707709952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783071656.259661:0:17090:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000004:00000024:3.0:1783071656.259669:0:17825:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1783071656.259734:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0411ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1869685707709824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 119us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071656.259742:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783071656.259772:0:17825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0411fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1869685707709952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 127us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071656.259779:0:17825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783071656.259852:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a02c09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1869685707709952:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783071656.259868:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a038b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1869685707709824:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783071656.725352:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071656.725483:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071656.725517:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071656.725579:0:18591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692964096 00000100:00100000:0.0:1783071656.725589:0:18591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692964096 00000100:00100000:0.0:1783071656.725682:0:18591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 10 00000100:00100000:0.0:1783071656.725695:0:18591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d5c8f6e7-f12c-493c-9545-6cf978dcf267+5:2404:x1869685692964096:12345-192.168.204.38@tcp:400:kworker.0 00000100:00080000:1.0:1783071656.725700:0:17082:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783071656.725790:0:18591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d5c8f6e7-f12c-493c-9545-6cf978dcf267+5:2404:x1869685692964096:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 98us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071656.725798:0:18591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 10 00000100:00100000:3.0:1783071656.732107:0:19199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692963840 00000100:00100000:3.0:1783071656.732127:0:19199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692963840 00000100:00100000:2.0:1783071656.732170:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071656.732210:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071656.732233:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00080000:1.0:1783071656.732313:0:17082:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783071656.732403:0:19286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692964608 00000100:00100000:1.0:1783071656.732407:0:19286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692964608 00000100:00100000:1.0:1783071656.732446:0:19286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11 00000100:00100000:1.0:1783071656.732457:0:19286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:16c37387-7795-4f66-bf99-555c21a639fc+5:2404:x1869685692964608:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1783071656.732557:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1783071656.732576:0:18592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692964224 00000100:00100000:2.0:1783071656.732580:0:18592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692964224 00000100:00100000:2.0:1783071656.732608:0:18592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 12 00000100:00100000:1.0:1783071656.732691:0:19286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:16c37387-7795-4f66-bf99-555c21a639fc+5:2404:x1869685692964608:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 235us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071656.732699:0:19286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11 00000100:00080000:1.0:1783071656.732725:0:17082:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783071656.732743:0:18592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d5c8f6e7-f12c-493c-9545-6cf978dcf267+5:2404:x1869685692964224:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1783071656.732774:0:18592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d5c8f6e7-f12c-493c-9545-6cf978dcf267+5:2404:x1869685692964224:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 160us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071656.732781:0:18592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 12 00000100:00100000:2.0:1783071656.732827:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1783071656.732952:0:19285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692964352 00000100:00100000:0.0:1783071656.732957:0:19285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692964352 00000100:00100000:0.0:1783071656.732991:0:19285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692963968 00000100:00100000:0.0:1783071656.732994:0:19285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692963968 00000100:00100000:0.0:1783071656.733013:0:19285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 48 00000100:00100000:0.0:1783071656.733020:0:19285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d5c8f6e7-f12c-493c-9545-6cf978dcf267+22:2404:x1869685692963840:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1783071656.733052:0:19199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 49 00000100:00100000:0.0:1783071656.733055:0:19285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d5c8f6e7-f12c-493c-9545-6cf978dcf267+22:2404:x1869685692963840:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 36us (7714us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071656.733060:0:19199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16c37387-7795-4f66-bf99-555c21a639fc+6:2404:x1869685692964352:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1783071656.733062:0:19285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 48 00000100:00100000:0.0:1783071656.733086:0:19285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 50 00000100:00100000:3.0:1783071656.733088:0:19199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16c37387-7795-4f66-bf99-555c21a639fc+6:2404:x1869685692964352:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 30us (7571us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071656.733092:0:19285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d5c8f6e7-f12c-493c-9545-6cf978dcf267+5:2404:x1869685692963968:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1783071656.733095:0:19199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 49 00000100:00100000:0.0:1783071656.733113:0:19285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d5c8f6e7-f12c-493c-9545-6cf978dcf267+5:2404:x1869685692963968:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 22us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071656.733121:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692963712 00000100:00100000:3.0:1783071656.733124:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692963712 00000100:00100000:0.0:1783071656.733127:0:19285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 50 00000100:00080000:0.0:1783071656.733153:0:17082:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783071656.733154:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 163 00000100:00080000:0.0:1783071656.733156:0:17082:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783071656.733160:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f80a971-9117-430f-93b5-a8b601517f46+13:2404:x1869685692963712:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1783071656.733265:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f80a971-9117-430f-93b5-a8b601517f46+13:2404:x1869685692963712:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 105us (1054us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071656.733272:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 163 00000100:00100000:2.0:1783071656.734201:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1783071656.734275:0:19199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692964480 00000100:00100000:3.0:1783071656.734281:0:19199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692964480 00000100:00100000:3.0:1783071656.734334:0:19199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 51 00000100:00100000:3.0:1783071656.734343:0:19199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16c37387-7795-4f66-bf99-555c21a639fc+5:2404:x1869685692964480:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1783071656.734412:0:19199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16c37387-7795-4f66-bf99-555c21a639fc+5:2404:x1869685692964480:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 71us (1594us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071656.734419:0:19199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 51 00000100:00100000:0.0:1783071656.734892:0:18591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685692964736 00000100:00100000:0.0:1783071656.734897:0:18591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685692964736 00000100:00100000:0.0:1783071656.734936:0:18591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 13 00000100:00100000:0.0:1783071656.734944:0:18591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16c37387-7795-4f66-bf99-555c21a639fc+5:2404:x1869685692964736:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1783071656.734988:0:18591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16c37387-7795-4f66-bf99-555c21a639fc+5:2404:x1869685692964736:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 44us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071656.734995:0:18591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 13 00000100:00080000:1.0:1783071656.735438:0:17082:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783071656.735443:0:17082:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783071656.770626:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a038b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ed14122-6273-4ec6-b260-6e79c239c375:3647:1869685707710080:0@lo:400:kworker.0 00000100:00100000:1.0:1783071656.770670:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a038bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707710208:0@lo:400:kworker.0 00000100:00100000:3.0:1783071656.770712:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b3c78d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707710464:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783071656.770744:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071656.770844:0:18589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707710208 00000100:00100000:0.0:1783071656.770852:0:18589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707710208 00000100:00100000:0.0:1783071656.770912:0:18589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783071656.770922:0:18589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c78ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707710208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071656.771394:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a038bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707710720:0@lo:400:kworker.0 00000100:00100000:1.0:1783071656.771426:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071656.771450:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a038b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1869685707711232:0@lo:400:kworker.0 00000100:00100000:1.0:1783071656.771472:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071656.771488:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1783071656.771493:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a038ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869685707710592:0@lo:400:kworker.0 00000100:00100000:1.0:1783071656.771513:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071656.771529:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a038b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1869685707711104:0@lo:400:kworker.0 00000100:00100000:1.0:1783071656.771658:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783071656.771718:0:17082:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783071656.771728:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783071656.771735:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03af3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707711616:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783071656.771762:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071656.771788:0:18593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707711616 00000100:00100000:1.0:1783071656.771792:0:18593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707711616 00000100:00100000:1.0:1783071656.771836:0:18593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783071656.771843:0:18593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0178dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1869685707711616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783071656.771861:0:18593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783071656.771898:0:18593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0178dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1869685707711616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071656.771905:0:18593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783071656.772023:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03af3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707711616:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783071656.772063:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707711232 00000100:00100000:1.0:1783071656.772067:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707711232 00000100:00100000:1.0:1783071656.772096:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707710592 00000100:00100000:1.0:1783071656.772100:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707710592 00000100:00100000:1.0:1783071656.772116:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707711104 00000100:00100000:1.0:1783071656.772118:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707711104 00000100:00100000:1.0:1783071656.772133:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783071656.772138:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a0397c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869685707711232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071656.772250:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a0397c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869685707711232:12345-0@lo:400:kworker.0 Request processed in 111us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071656.772258:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783071656.772269:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783071656.772276:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03af2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869685707710592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071656.772304:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03af2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869685707710592:12345-0@lo:400:kworker.0 Request processed in 29us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071656.772310:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783071656.772320:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783071656.772325:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03af3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869685707711104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071656.772346:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03af3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869685707711104:12345-0@lo:400:kworker.0 Request processed in 21us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071656.772350:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1783071656.772383:0:17082:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783071656.772386:0:17082:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783071656.772402:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a038ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869685707710592:0@lo:400:kworker.0 00000100:00100000:1.0:1783071656.772411:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a038b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1869685707711104:0@lo:400:kworker.0 00010000:00080000:1.0:1783071656.772421:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a038b9f80 x1869685707711232/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071656.772437:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a038b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1869685707711232:0@lo:400:kworker.0 00000100:00100000:1.0:1783071656.772483:0:19700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707710720 00000100:00100000:1.0:1783071656.772487:0:19700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707710720 00000100:00100000:1.0:1783071656.772507:0:19700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783071656.772513:0:19700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3c78ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707710720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071656.772741:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071656.772773:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a038b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869685707710976:0@lo:400:kworker.0 00000100:00100000:3.0:1783071656.772806:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071656.772809:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071656.772847:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a038b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1869685707711488:0@lo:400:kworker.0 00000100:00100000:3.0:1783071656.772874:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071656.772899:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1783071656.772907:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a038bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707710336:0@lo:400:kworker.0 00000100:00100000:2.0:1783071656.772908:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783071656.772920:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a03b83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707711744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783071656.772935:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071656.772955:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a038b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707710848:0@lo:400:kworker.0 00000100:00100000:2.0:1783071656.772957:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071656.772987:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071656.772996:0:18594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707710464 00000100:00100000:2.0:1783071656.773001:0:18594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707710464 00000100:00100000:3.0:1783071656.773015:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a038b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1869685707711360:0@lo:400:kworker.0 00000100:00100000:1.0:1783071656.773018:0:19700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c78ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1869685707710720:12345-0@lo:400:kworker.0 Request processed in 35us (1121us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071656.773027:0:19700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783071656.773032:0:18594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707711744 00000100:00100000:2.0:1783071656.773035:0:18594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707711744 00000100:00100000:1.0:1783071656.773040:0:19700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707710336 00000100:00100000:3.0:1783071656.773044:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071656.773045:0:19700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707710336 00000100:00100000:1.0:1783071656.773059:0:19700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707710848 00000100:00100000:2.0:1783071656.773062:0:18594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783071656.773062:0:19700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707710848 00000100:00100000:2.0:1783071656.773069:0:18594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a038baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1869685707710464:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783071656.773075:0:19700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783071656.773080:0:19700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3d2e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3646:x1869685707710336:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1783071656.773081:0:18594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3923513344 avail 3684286464 00000100:00100000:0.0:1783071656.773287:0:18589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3c78ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869685707710208:12345-0@lo:400:kworker.0 Request processed in 2366us (2543us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071656.773295:0:18589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783071656.773313:0:18589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783071656.773319:0:18589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a038b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1869685707710848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071656.773715:0:19700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3d2e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3646:x1869685707710336:12345-0@lo:400:kworker.0 Request processed in 632us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071656.773722:0:19700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783071656.773880:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a038bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1869685707710208:0@lo:400:kworker.0 00000100:00100000:3.0:1783071656.773885:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707710976 00000100:00100000:3.0:1783071656.773892:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707710976 00000100:00100000:1.0:1783071656.773896:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a038bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1869685707710720:0@lo:400:kworker.0 00000100:00100000:3.0:1783071656.773921:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707711488 00000100:00100000:3.0:1783071656.773924:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707711488 00000100:00100000:3.0:1783071656.773940:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707711360 00000100:00100000:3.0:1783071656.773942:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707711360 00000100:00100000:3.0:1783071656.773957:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783071656.773964:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a038bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869685707710976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071656.774029:0:17085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783071656.774037:0:17085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a038ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869685707711488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071656.775257:0:18594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a038baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1869685707710464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2172us (2500us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071656.775275:0:18594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783071656.775324:0:18594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783071656.775334:0:18594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a03b83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707711744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783071656.775353:0:18594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3923513344 avail 3684286464 00000100:00100000:2.0:1783071656.775440:0:18594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a03b83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869685707711744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (2484us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071656.775446:0:18594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1783071656.775468:0:17082:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783071656.775473:0:17082:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783071656.775476:0:17082:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783071656.775521:0:3647:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:2.0:1783071656.775526:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f8a0411f480, transno 8589934596 00000004:00080000:2.0:1783071656.775539:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:2.0:1783071656.775808:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a03b83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1869685707711744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783071656.776069:0:19199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783071656.776087:0:19199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a038bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869685707711360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071656.776129:0:19199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a038bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869685707711360:12345-0@lo:400:kworker.0 Request processed in 45us (3089us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071656.776135:0:19199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783071656.776477:0:18589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a038b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869685707710848:12345-0@lo:400:kworker.0 Request processed in 3156us (3490us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071656.776486:0:18589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783071656.776494:0:17085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a038ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869685707711488:12345-0@lo:400:kworker.0 Request processed in 2459us (3620us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071656.776501:0:17085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783071656.776522:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685707710080 00000100:00100000:0.0:1783071656.776528:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685707710080 00000100:00100000:1.0:1783071656.776579:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a038bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1869685707710336:0@lo:400:kworker.0 00000100:00100000:1.0:1783071656.776604:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a038b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707710848:0@lo:400:kworker.0 00000100:00100000:1.0:1783071656.776617:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a038b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1869685707711360:0@lo:400:kworker.0 00000100:00100000:1.0:1783071656.776631:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8b3c78d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1869685707710464:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783071656.776748:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a038bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869685707710976:12345-0@lo:400:kworker.0 Request processed in 2783us (3942us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071656.776756:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783071656.776891:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1783071656.776899:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b3ea73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+24:3647:x1869685707710080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071656.776952:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b3ea73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ed14122-6273-4ec6-b260-6e79c239c375+24:3647:x1869685707710080:12345-0@lo:400:kworker.0 Request processed in 54us (4147us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071656.776958:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1783071656.777019:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a038b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ed14122-6273-4ec6-b260-6e79c239c375:3647:1869685707710080:0@lo:400:kworker.0 00000100:00100000:1.0:1783071656.777396:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a038b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869685707710976:0@lo:400:kworker.0 00010000:00080000:1.0:1783071656.777417:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a038b8700 x1869685707711488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071656.777428:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f8a038b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1869685707711488:0@lo:400:kworker.0 00010000:00010000:2.0:1783071656.900623:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783071657.378347:0:20261:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:3.0:1783071657.923239:0:19422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783071658.628307:0:17119:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1783071658.628322:0:17119:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783071658.628351:0:17119:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1783071658.628360:0:17119:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 Debug log: 41515 lines, 41515 kept, 0 dropped, 0 bad.